-- Logs begin at Fri 2022-08-05 06:31:18 UTC, end at Fri 2022-08-05 07:39:08 UTC. -- Aug 05 06:59:40.183295 dv-cinder-852007-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 05 06:59:40.191218 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 06:59:40 2022] *** Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: nodename: dv-cinder-852007-1-iscsi Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: machine: x86_64 Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: clock source: unix Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: pcre jit disabled Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: detected number of CPU cores: 4 Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: current working directory: / Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: detected binary path: /usr/bin/uwsgi-core Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: your processes number limit is 47680 Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: your memory page size is 4096 bytes Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: detected max file descriptor number: 2048 Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: lock engine: pthread robust mutexes Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: thunder lock: enabled Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 05 06:59:40.195649 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 06:59:40.234730 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: Python main interpreter initialized at 0x55d74cd2a9c0 Aug 05 06:59:40.234730 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: python threads support enabled Aug 05 06:59:40.234730 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: your server socket listen backlog is limited to 100 connections Aug 05 06:59:40.234730 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: your mercy for graceful operations on workers is 90 seconds Aug 05 06:59:40.235240 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 06:59:40.235240 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: *** Operational MODE: preforking *** Aug 05 06:59:40.235448 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: *** uWSGI is running in multiple interpreter mode *** Aug 05 06:59:40.235448 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: spawned uWSGI master process (pid: 80381) Aug 05 06:59:40.235700 dv-cinder-852007-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 05 06:59:40.236858 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: spawned uWSGI worker 1 (pid: 80394, cores: 1) Aug 05 06:59:40.236858 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: spawned uWSGI worker 2 (pid: 80395, cores: 1) Aug 05 06:59:40.236858 dv-cinder-852007-1-iscsi devstack@keystone.service[80381]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 06:59:45.690127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 06:59:45.690127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: from cryptography.utils import int_from_bytes Aug 05 06:59:45.691260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 06:59:45.691260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: from cryptography.utils import int_from_bytes Aug 05 06:59:45.691679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 06:59:45.691679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: from cryptography.utils import int_from_bytes Aug 05 06:59:45.691783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 06:59:45.691783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: from cryptography.utils import int_from_bytes Aug 05 06:59:45.739764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 06:59:45.740007 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 06:59:45.740103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] command line args: [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 06:59:45.740381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 06:59:45.740512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 06:59:45.740590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ================================================================================ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 06:59:45.740656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 06:59:45.740794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] admin_token = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.740966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] command line args: [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 06:59:45.741038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] config_dir = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.741103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 06:59:45.741291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.741424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ================================================================================ {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 06:59:45.741511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] config_source = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.741579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] admin_token = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.741643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] debug = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.741768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] config_dir = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.741897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.742090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.742090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] config_source = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.742214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.742272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.742327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] debug = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.742486 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.742627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.742696 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.742760 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.742895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.743016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.743088 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_config_append = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.743151 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.743288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.743396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.743458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_dir = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.743568 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.743645 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_file = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.743742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_config_append = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.743814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.743952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.744071 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.744149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_dir = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.744270 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_file = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.744374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.744492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.744568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.744699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.744855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.744977 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.745051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.745122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.745253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.745391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.745470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.745539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.745604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.745764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.745913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.745993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.746061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.746195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.746281 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.746467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.746592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.746678 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.746746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.746919 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.747067 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.747184 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.747432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.747615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.747615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] publish_errors = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.747852 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.747967 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.748087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.748205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.748316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.748433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] publish_errors = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.748556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.748675 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.748786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.748921 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.749059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] standard_threads = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.749176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.749296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.749415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.749525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.749642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.749826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.749826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] use_journal = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.750055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] standard_threads = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.750165 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] use_json = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.750324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.750439 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] use_stderr = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.750439 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] use_syslog = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.750663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.750663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.750878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.750988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] use_journal = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.751104 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.751223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] use_json = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.751334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.751458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] use_stderr = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.751458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] use_syslog = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.751680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.751798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 06:59:45.751920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.752033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.752149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.752261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.752370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.752482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.752604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.752716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.752832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.752960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.753085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.753198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.753316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.753428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.753538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.753647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.753756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.753865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.753983 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.754097 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.754206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.754315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.754431 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.754542 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.754664 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.754777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.754878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.754993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.755103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.755214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.755398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.755511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.755622 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.755731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.755840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.755840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.756054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.756166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.756275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.756386 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.756508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.756508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.756723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.756723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.756978 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.757092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.757202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.757313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.757440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.757560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.757674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.757784 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.757900 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.758023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.758135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.758251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.758362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.758471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.758581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.758702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.758821 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.758937 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.759050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.759160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.759269 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.759392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.759504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.759620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.759733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.759842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.759951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.760072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.760183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.760307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.760456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.760580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.760692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.760882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.761013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.761123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.761233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.761342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.761453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.761575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.761688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.761797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.761913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.762030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.762141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.762267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.762379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.762495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.762605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.762714 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.762824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.762947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.763059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.763169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.763270 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.763363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.763455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.763557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.763557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.763737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.763830 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.763924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.764049 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.764156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.764251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.764345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.764456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.764558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.764673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.764793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.764947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.765061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.765171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.765295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.765414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.765537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.765650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.765762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.765880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.765992 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.766109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.766220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.766329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.766440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.766550 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.766665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.766777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.766889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.766991 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.767108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.767226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.767344 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.767461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.767615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.767781 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.767896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.768007 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.768117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.768227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.768337 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.768456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.768569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.768678 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.768790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.768916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.769022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.769146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.769260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.769370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.769481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.769591 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.769701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.769820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.769932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.770044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.770154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.770264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.770375 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.770531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.770647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.770758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.770869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.770980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.771091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.771210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.771322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.771433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.771433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.771640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.771750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.771937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.772052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.772163 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.772273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.772383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.772496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.772615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.772736 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.772861 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.773005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.773118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.773228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.773350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.773474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.773595 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.773709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.773826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.773938 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.774050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.774160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.774279 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.774392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.774502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.774613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.774724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.774844 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.external = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.774963 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.775077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.775188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.775298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.775410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.775529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.775642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.775761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.password = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.775874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.775985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.token = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.776128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.776252 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.776366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.external = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.776490 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.776610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.776723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.776835 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.776962 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.777076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.777202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.777325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.password = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.777438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.777550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] auth.token = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.777661 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.777773 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.777893 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.778007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.778119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.778232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.778344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.778456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.778577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.778690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.778803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.778926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.779046 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.779164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.779285 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.779399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.779511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.779622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.779734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.779852 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.779973 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.780086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.780204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.780302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.780396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.780491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.780635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.780738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.780833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.780944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.781044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.781152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.781259 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.781356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.781451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.781545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.781639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.781639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.781831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.781927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.782021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.782124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.782219 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.782313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.782422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.782531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.782626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.782720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.782815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.782909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.783018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.783123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.783227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.783330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.783432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.783528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.783632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.783750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.783868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.783981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.784092 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.784203 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.784326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.784425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.784544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.784656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.784767 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.785018 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.785137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.785250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.785361 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.785473 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.785576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.785695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.785809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.785921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.786031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.786143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.786254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.786373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.786487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.786599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.786711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.786821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.786933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.787051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.787165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.787276 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.787387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.787497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.787608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.787728 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.787842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.787953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.788064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.788174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.788284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.788403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.788515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.788984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.789099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.789209 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.789319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.789443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.789443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.789655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.789768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.789879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.789989 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.790108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.790230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.790343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.790455 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.790566 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.790719 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.790847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.790961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.791073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.791185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.791297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.791408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.791514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.791627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.791739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.791850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.791961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.792072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.792192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.792305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.792421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.792534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.792645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.792755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.792875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.793066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.793179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.793291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.793403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.793514 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.793638 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.793753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.793865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.793977 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.794089 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.794200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.794320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.794433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.794545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.794656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.794768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.794879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.795000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.795113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.795225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.795335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.795446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.795557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.795677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.795790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.795790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.795999 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.795999 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.796210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.796330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.796443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.796555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.796666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.796779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.796922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.797039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.797151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.797357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.797474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.797474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.797696 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.797812 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.797925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.798045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.798159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.798270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.798390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.798504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.798616 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.798735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.798886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.799003 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.799123 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.799239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.799366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.799366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.799642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.799749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.799869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.799983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.800095 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.800206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.800318 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.800430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.800550 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.800671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.800817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.800984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.801099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.801212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.801339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.801454 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.801566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.801566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.801775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.801886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.802007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.802120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.802232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.802344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.802459 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.802571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.802690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.802810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.802923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.803034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.803145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.803257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.803377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.803491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.803602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.803713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.803824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.803936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.804055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.804169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.804280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.804390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.804502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.804613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.804732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.804846 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.804969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.805082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.805193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.805305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.805428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.805544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.805656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.805768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.805879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.805990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.806110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.806223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.806334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.806446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.806558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.806669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] role.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.806789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.806902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] role.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.806902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.807112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.807222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.807333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.807520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.807638 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.807750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.807861 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.807971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.808090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.808212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.808326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.808437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.808548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.808660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.808772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.808910 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.809027 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] role.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.809151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.809266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] role.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.809378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.809497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.809611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.809724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.809836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.809947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.810060 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.810180 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.810180 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.810392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.810504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.810615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.810727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.810884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.811002 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.811114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.811226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.811336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.811448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.811567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.811681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.811794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.811905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.812017 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.812128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.812270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.812388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.812503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.812503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.812711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.812823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.812994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.813111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.813223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.813335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.813446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.813558 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.813677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.813790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.813902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.814013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.814124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.814242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.814356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.814494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.814494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.814705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.814816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.814937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.815051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.815161 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.815273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.815385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.815385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.815602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.815715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.815826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.815826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.816033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.816144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.816264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.816377 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.816488 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.816599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.816710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.816820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.816985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.817103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.817216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.817328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.817439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.817551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.817670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.817784 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.817895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.818006 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.818120 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.818231 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.818351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.818464 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.818576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.818687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.818808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.818930 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.819044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.819157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.819277 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.819390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.819501 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.819612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.819724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.819835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.819956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.820070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.820182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.820294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.820404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.820517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.820637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.820750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.820861 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.821013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.821126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.821239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.821363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.connection = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.821492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.821616 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.821729 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.821840 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.821951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.822062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.822181 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.822296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.822411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.822523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.822634 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.822745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.822865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.822865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 06:59:45.823077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.823077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.823077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.823077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.823489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.823602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.823763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.824001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.824248 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.824482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.824724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.824987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 06:59:45.825159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 06:59:45.851813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.852032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.852257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.853505 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.853742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.853970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.860660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.862464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.890393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.890598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.892001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.892238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.944174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.944548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.994563 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.994787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.995424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:45.995658 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.060383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.060595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.060672 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.060851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.061060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.061170 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.061295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.061372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.061434 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.061547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.061624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.061747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.084666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.084946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.085059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.085210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.085316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.085396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.085519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.085641 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.085761 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.085887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.085967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.086029 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.086145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.086259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.097169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.097389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.109953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.110214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.110350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.110465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.110566 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.110632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.110757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.110835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.110979 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.111076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.111192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.111267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.111468 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.111684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80395) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 06:59:46.128184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.128364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 06:59:46.128599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.128726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.128803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 06:59:46.128865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 06:59:46.129160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.129285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.129362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 06:59:46.129423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.129626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.129766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.129845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.129907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.130124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.130375 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.139515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.139786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.140057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.140181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.140370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.140504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.140656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.140884 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.147256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.147895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.152024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.152304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.152577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.152746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.152844 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.153074 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.153200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.153358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.153493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.153635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.153715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.153893 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.154042 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.154125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.154199 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.154399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.154493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.154660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.154821 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.154947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.155218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.155482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.177808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.178875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.179281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.179557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.180376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.180657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.184141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.184393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.184671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.185336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.185584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.185893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.191359 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.191641 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.192558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.192841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.195896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.196119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.196389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.196675 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.196950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.197261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.197529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.197797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.197920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.198208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.198472 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.198764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.199049 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.199334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.199612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.199875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.213632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.213903 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.215878 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.216157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.217819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.220120 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.221053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.221342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.223374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.223659 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.225703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.228075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.229005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.231334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.232117 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.232406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.232683 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.232967 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.233267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.233950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.235428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.235714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.235998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.236328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.236575 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.236916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.251890 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.252391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.252704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.252999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.253155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.253457 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.253727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.254002 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.262282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.262636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.262819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.262819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.263316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.263316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.264941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.265264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.265505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.265775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.265974 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.266119 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.266275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.266437 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.266590 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.266897 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.279316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.279316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.281603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.282240 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.282335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.282414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.282497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.282574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.282647 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.282720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.282793 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.282866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.282948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.282948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.296461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.296843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.300554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.300951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.303517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.303917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.306190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.306599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.307752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.308041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.308121 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.308324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.308404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.308659 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.314924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.315304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.316529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.316932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.319500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.319788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.319869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.320074 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.320154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.320353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.320442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.320685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.328448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.328738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.328818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.329043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.329138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.329326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.336007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80395) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.336277 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.336359 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 06:59:46.336561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.336647 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.336839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.336935 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.337137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.337217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.337408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.337489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.337678 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.337758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.337951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.338047 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.338236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.338342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.338615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.338751 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.338888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.338957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.339163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.339231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.339429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.339498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.339741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80395) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.339819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.339982 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 06:59:46.373394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d74cd2a9c0 pid: 80395 (default app) Aug 05 06:59:46.373604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d74cd2a9c0 pid: 80394 (default app) Aug 05 06:59:46.376919 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f2f4b-98e2-458e-85f1-37ad71c06c04 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:46.377262 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f2f4b-98e2-458e-85f1-37ad71c06c04 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:46.377546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f2f4b-98e2-458e-85f1-37ad71c06c04 None None] PATH_INFO: `/v3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:46.381893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Fri Aug 5 06:59:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 06:59:53.984624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9c1d6-c1c6-4e2a-940c-7f14452f5b6f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:53.985254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9c1d6-c1c6-4e2a-940c-7f14452f5b6f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:53.985254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9c1d6-c1c6-4e2a-940c-7f14452f5b6f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:53.989754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 06:59:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 06:59:53.995293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc9e09-8e08-4126-9f05-3cde6da9c5c6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:53.995740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc9e09-8e08-4126-9f05-3cde6da9c5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:53.995836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc9e09-8e08-4126-9f05-3cde6da9c5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:54.067159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: INFO dbcounter [None req-c1dc9e09-8e08-4126-9f05-3cde6da9c5c6 None None] Registered counter for database keystone Aug 05 06:59:54.088004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG oslo_db.sqlalchemy.engines [None req-c1dc9e09-8e08-4126-9f05-3cde6da9c5c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 06:59:54.095561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writer thread running {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 06:59:54.278326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG passlib.handlers.bcrypt [None req-c1dc9e09-8e08-4126-9f05-3cde6da9c5c6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80395) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 05 06:59:54.278665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG passlib.handlers.bcrypt [None req-c1dc9e09-8e08-4126-9f05-3cde6da9c5c6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80395) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 05 06:59:54.334420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c1dc9e09-8e08-4126-9f05-3cde6da9c5c6 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 06:59:54.336081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c1dc9e09-8e08-4126-9f05-3cde6da9c5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 06:59:54.472386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 06:59:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 05 06:59:54.639039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9c1d6-c1c6-4e2a-940c-7f14452f5b6f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 06:59:54.708705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: INFO dbcounter [None req-4ef9c1d6-c1c6-4e2a-940c-7f14452f5b6f None None] Registered counter for database keystone Aug 05 06:59:54.730493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG oslo_db.sqlalchemy.engines [None req-4ef9c1d6-c1c6-4e2a-940c-7f14452f5b6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80394) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 06:59:54.738260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writer thread running {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 06:59:54.857462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9c1d6-c1c6-4e2a-940c-7f14452f5b6f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 06:59:54.863038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9be453-babb-4c81-93d1-94431598d493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 06:59:54.863770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9be453-babb-4c81-93d1-94431598d493 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:54.864028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9be453-babb-4c81-93d1-94431598d493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:54.864319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9be453-babb-4c81-93d1-94431598d493 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:54.873745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9be453-babb-4c81-93d1-94431598d493 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 06:59:54.925225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8d9be453-babb-4c81-93d1-94431598d493 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 05 06:59:54.925486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9be453-babb-4c81-93d1-94431598d493 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 06:59:54.936016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Aug 5 06:59:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 06:59:54.942514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc9e09-8e08-4126-9f05-3cde6da9c5c6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 06:59:54.957507 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc9e09-8e08-4126-9f05-3cde6da9c5c6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 06:59:54.963202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614718f1-f3b7-4ffb-a1f2-aea944b0076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 06:59:54.964352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614718f1-f3b7-4ffb-a1f2-aea944b0076c admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:54.964635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614718f1-f3b7-4ffb-a1f2-aea944b0076c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:54.964949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614718f1-f3b7-4ffb-a1f2-aea944b0076c admin admin] PATH_INFO: `/v3/projects/c0ce80734b754922ab08055a8061587e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:54.966602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614718f1-f3b7-4ffb-a1f2-aea944b0076c admin admin] RBAC: Authorizing `identity:get_project(project_id=c0ce80734b754922ab08055a8061587e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 06:59:55.016051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: WARNING keystone.common.rbac_enforcer.enforcer [None req-614718f1-f3b7-4ffb-a1f2-aea944b0076c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 05 06:59:55.016639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614718f1-f3b7-4ffb-a1f2-aea944b0076c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 06:59:55.021404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Fri Aug 5 06:59:54 2022] GET /identity/v3/projects/c0ce80734b754922ab08055a8061587e => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 06:59:57.022505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481023c-41a5-4663-a8ac-80af6e9929a0 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:57.023088 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481023c-41a5-4663-a8ac-80af6e9929a0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:57.023088 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481023c-41a5-4663-a8ac-80af6e9929a0 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:57.027187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 06:59:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 06:59:57.032806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f521d7-16e1-4331-8fda-049931f9f6d1 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:57.033270 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f521d7-16e1-4331-8fda-049931f9f6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:57.033435 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f521d7-16e1-4331-8fda-049931f9f6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:57.054269 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d7f521d7-16e1-4331-8fda-049931f9f6d1 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 06:59:57.055794 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d7f521d7-16e1-4331-8fda-049931f9f6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 06:59:57.064400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 06:59:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 05 06:59:57.086523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481023c-41a5-4663-a8ac-80af6e9929a0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 06:59:57.100402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481023c-41a5-4663-a8ac-80af6e9929a0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 06:59:57.105280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b54fc8-dd27-45d4-868e-166066447937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 06:59:57.105896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b54fc8-dd27-45d4-868e-166066447937 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:57.106175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b54fc8-dd27-45d4-868e-166066447937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:57.106447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b54fc8-dd27-45d4-868e-166066447937 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:57.114302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b54fc8-dd27-45d4-868e-166066447937 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 06:59:57.116083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b54fc8-dd27-45d4-868e-166066447937 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 06:59:57.124988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Aug 5 06:59:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 06:59:57.130737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f521d7-16e1-4331-8fda-049931f9f6d1 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 06:59:57.140436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f521d7-16e1-4331-8fda-049931f9f6d1 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 06:59:57.146361 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a681ef-d39f-4c64-89f4-b4206ec194f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 06:59:57.147005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a681ef-d39f-4c64-89f4-b4206ec194f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:57.147285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a681ef-d39f-4c64-89f4-b4206ec194f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:57.147559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a681ef-d39f-4c64-89f4-b4206ec194f9 admin admin] PATH_INFO: `/v3/users/1acd68042e0349f6afed23e5889b5da6` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:57.149135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a681ef-d39f-4c64-89f4-b4206ec194f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=1acd68042e0349f6afed23e5889b5da6)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 06:59:57.150970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a681ef-d39f-4c64-89f4-b4206ec194f9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 06:59:57.152562 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Fri Aug 5 06:59:57 2022] GET /identity/v3/users/1acd68042e0349f6afed23e5889b5da6 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 06:59:59.197590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bacd4d-28d1-43d8-a6b8-be403b28d305 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:59.198187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bacd4d-28d1-43d8-a6b8-be403b28d305 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:59.198187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bacd4d-28d1-43d8-a6b8-be403b28d305 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:59.199548 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 06:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 06:59:59.205031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd322a-65ad-4e99-9c84-eff4b583e763 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:59.205556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd322a-65ad-4e99-9c84-eff4b583e763 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:59.205686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd322a-65ad-4e99-9c84-eff4b583e763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:59.225710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-90fd322a-65ad-4e99-9c84-eff4b583e763 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 06:59:59.226906 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-90fd322a-65ad-4e99-9c84-eff4b583e763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 06:59:59.236263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80a30f-71e4-48b8-a209-d7f51e4c63c7 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:59.236587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80a30f-71e4-48b8-a209-d7f51e4c63c7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:59.236867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80a30f-71e4-48b8-a209-d7f51e4c63c7 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:59.238452 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 06:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 06:59:59.243510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38dcc-00b5-481a-91ab-16fe11df1da4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:59.243795 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38dcc-00b5-481a-91ab-16fe11df1da4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:59.244068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c38dcc-00b5-481a-91ab-16fe11df1da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:59.287624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG passlib.handlers.bcrypt [None req-f3c38dcc-00b5-481a-91ab-16fe11df1da4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80394) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 05 06:59:59.288065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG passlib.handlers.bcrypt [None req-f3c38dcc-00b5-481a-91ab-16fe11df1da4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80394) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 05 06:59:59.313981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 06:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 06:59:59.333545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f3c38dcc-00b5-481a-91ab-16fe11df1da4 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 06:59:59.335173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f3c38dcc-00b5-481a-91ab-16fe11df1da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 06:59:59.337078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd322a-65ad-4e99-9c84-eff4b583e763 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 06:59:59.363862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:59:59.437716 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 06:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 06:59:59.447787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd322a-65ad-4e99-9c84-eff4b583e763 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 06:59:59.459296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38dcc-00b5-481a-91ab-16fe11df1da4 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 06:59:59.481330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b1adb-b657-4c24-8f2a-d90559355af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 06:59:59.481984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b1adb-b657-4c24-8f2a-d90559355af8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:59.482266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b1adb-b657-4c24-8f2a-d90559355af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:59.482584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b1adb-b657-4c24-8f2a-d90559355af8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:59.493689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b1adb-b657-4c24-8f2a-d90559355af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-754b1adb-b657-4c24-8f2a-d90559355af8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 06:59:59.502665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 06:59:59.503581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 06:59:59.504596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 06:59:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 06:59:59.509815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b1adb-b657-4c24-8f2a-d90559355af8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 06:59:59.565181 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c38dcc-00b5-481a-91ab-16fe11df1da4 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 06:59:59.567510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:59:59.591162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:59:59.602289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4255f7b-aab0-453f-89a6-8a40ab648978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 06:59:59.603177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4255f7b-aab0-453f-89a6-8a40ab648978 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:59.603462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4255f7b-aab0-453f-89a6-8a40ab648978 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:59.603732 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4255f7b-aab0-453f-89a6-8a40ab648978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:59.609704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b1adb-b657-4c24-8f2a-d90559355af8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 06:59:59.645441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d081f-b2d4-4f19-ac0c-6a28e56c0f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 06:59:59.646056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d081f-b2d4-4f19-ac0c-6a28e56c0f48 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:59.646332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d081f-b2d4-4f19-ac0c-6a28e56c0f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:59.646576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d081f-b2d4-4f19-ac0c-6a28e56c0f48 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:59.647289 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d081f-b2d4-4f19-ac0c-6a28e56c0f48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 06:59:59.647589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d081f-b2d4-4f19-ac0c-6a28e56c0f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 06:59:59.649026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d081f-b2d4-4f19-ac0c-6a28e56c0f48 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 06:59:59.662186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 06:59:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 06:59:59.668580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d081f-b2d4-4f19-ac0c-6a28e56c0f48 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 06:59:59.672348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4255f7b-aab0-453f-89a6-8a40ab648978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 06:59:59.673975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4255f7b-aab0-453f-89a6-8a40ab648978 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 06:59:59.788497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 06:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 06:59:59.790227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4255f7b-aab0-453f-89a6-8a40ab648978 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 06:59:59.793948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:59:59.882555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d081f-b2d4-4f19-ac0c-6a28e56c0f48 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 06:59:59.894655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4255f7b-aab0-453f-89a6-8a40ab648978 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 06:59:59.917004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2095c-92f3-4658-9b42-73db729e1889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 06:59:59.917662 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2095c-92f3-4658-9b42-73db729e1889 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:59.917948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2095c-92f3-4658-9b42-73db729e1889 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:59.918216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2095c-92f3-4658-9b42-73db729e1889 None admin] PATH_INFO: `/v3/users/1acd68042e0349f6afed23e5889b5da6` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:59.919415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2095c-92f3-4658-9b42-73db729e1889 None admin] RBAC: Authorizing `identity:get_user(user_id=1acd68042e0349f6afed23e5889b5da6)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 06:59:59.920911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2095c-92f3-4658-9b42-73db729e1889 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 06:59:59.922514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 06:59:59 2022] GET /identity/v3/users/1acd68042e0349f6afed23e5889b5da6 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 06:59:59.928234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2095c-92f3-4658-9b42-73db729e1889 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 06:59:59.930970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15849f-e30d-4c89-8bbd-502fcf305505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 06:59:59.931846 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15849f-e30d-4c89-8bbd-502fcf305505 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 06:59:59.932123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15849f-e30d-4c89-8bbd-502fcf305505 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 06:59:59.932416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15849f-e30d-4c89-8bbd-502fcf305505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 06:59:59.943253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 06:59:59.951602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15849f-e30d-4c89-8bbd-502fcf305505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 06:59:59.953150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15849f-e30d-4c89-8bbd-502fcf305505 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6a15849f-e30d-4c89-8bbd-502fcf305505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 06:59:59.971589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 06:59:59.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 06:59:59.973350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 06:59:59.973350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 06:59:59.973350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 06:59:59.973350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 06:59:59.973350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 06:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 06:59:59.978755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15849f-e30d-4c89-8bbd-502fcf305505 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:00.033585 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2095c-92f3-4658-9b42-73db729e1889 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:00.036483 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:00.069106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669050da-d594-4b4d-8994-0f0248b30b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:00.069678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669050da-d594-4b4d-8994-0f0248b30b00 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:00.069960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669050da-d594-4b4d-8994-0f0248b30b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:00.070236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669050da-d594-4b4d-8994-0f0248b30b00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:00.071410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669050da-d594-4b4d-8994-0f0248b30b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:00.072886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669050da-d594-4b4d-8994-0f0248b30b00 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:00.074512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 06:59:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:00.080472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15849f-e30d-4c89-8bbd-502fcf305505 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:00.080626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669050da-d594-4b4d-8994-0f0248b30b00 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:00.113449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2920d37-929d-4b7b-a2ec-aaa37db1a34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:00.114069 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920d37-929d-4b7b-a2ec-aaa37db1a34f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:00.114345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920d37-929d-4b7b-a2ec-aaa37db1a34f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:00.114614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920d37-929d-4b7b-a2ec-aaa37db1a34f None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:00.115287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2920d37-929d-4b7b-a2ec-aaa37db1a34f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:00.115584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2920d37-929d-4b7b-a2ec-aaa37db1a34f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:00.116999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2920d37-929d-4b7b-a2ec-aaa37db1a34f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:00.134644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 06:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:00.168220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:00.191772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669050da-d594-4b4d-8994-0f0248b30b00 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:00.232988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132037e-25fe-4a26-b301-cd28267b4943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:00.233669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132037e-25fe-4a26-b301-cd28267b4943 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:00.233922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132037e-25fe-4a26-b301-cd28267b4943 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:00.234195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132037e-25fe-4a26-b301-cd28267b4943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:00.235007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132037e-25fe-4a26-b301-cd28267b4943 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.domain.id=default, user.id=1acd68042e0349f6afed23e5889b5da6) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:00.235329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132037e-25fe-4a26-b301-cd28267b4943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:00.236933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132037e-25fe-4a26-b301-cd28267b4943 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:00.245028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Aug 5 07:00:00 2022] GET /identity/v3/role_assignments?user.id=1acd68042e0349f6afed23e5889b5da6&scope.domain.id=default&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:02.644618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b760783-ce06-4ee6-bba4-fc986d1ed648 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:02.645462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b760783-ce06-4ee6-bba4-fc986d1ed648 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:02.645902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b760783-ce06-4ee6-bba4-fc986d1ed648 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:02.647867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:02.653435 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd27df-5990-4af5-b713-a39c2cbc3268 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:02.654293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd27df-5990-4af5-b713-a39c2cbc3268 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:02.654707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd27df-5990-4af5-b713-a39c2cbc3268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:02.682388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e7bd27df-5990-4af5-b713-a39c2cbc3268 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:02.683862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e7bd27df-5990-4af5-b713-a39c2cbc3268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:02.774481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 12/23] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:02.809107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b760783-ce06-4ee6-bba4-fc986d1ed648 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:02.883884 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d6915-564a-4da7-aa97-5362ae0bd3c5 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:02.884396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d6915-564a-4da7-aa97-5362ae0bd3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:02.884809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d6915-564a-4da7-aa97-5362ae0bd3c5 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:02.886354 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:00:02.904825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a8ca5-8cb7-41a3-8735-ccdf954dc644 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:02.905416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a8ca5-8cb7-41a3-8735-ccdf954dc644 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:02.905830 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a8ca5-8cb7-41a3-8735-ccdf954dc644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:02.938483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3c4a8ca5-8cb7-41a3-8735-ccdf954dc644 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:02.940709 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3c4a8ca5-8cb7-41a3-8735-ccdf954dc644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:02.983121 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b760783-ce06-4ee6-bba4-fc986d1ed648 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:03.016936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:03.057798 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06309b-1b45-47f1-bd5b-031bb27dd322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:03.058442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06309b-1b45-47f1-bd5b-031bb27dd322 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:03.058724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06309b-1b45-47f1-bd5b-031bb27dd322 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:03.058996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06309b-1b45-47f1-bd5b-031bb27dd322 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:03.059736 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06309b-1b45-47f1-bd5b-031bb27dd322 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:03.061214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06309b-1b45-47f1-bd5b-031bb27dd322 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:03.083944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 14/25] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 05 07:00:03.085278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c799b2c-a32b-47f5-baa8-d7fdc775f6f5 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:03.085620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c799b2c-a32b-47f5-baa8-d7fdc775f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:03.085907 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c799b2c-a32b-47f5-baa8-d7fdc775f6f5 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:03.087342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 15/26] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:03.092685 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944b063-f656-493c-9d75-0691a265468f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:03.092988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944b063-f656-493c-9d75-0691a265468f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:03.093265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944b063-f656-493c-9d75-0691a265468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:03.116665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:03.140610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8944b063-f656-493c-9d75-0691a265468f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:03.141834 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8944b063-f656-493c-9d75-0691a265468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:03.231371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 16/27] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:03.232622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944b063-f656-493c-9d75-0691a265468f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:03.358556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944b063-f656-493c-9d75-0691a265468f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:03.378662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 12/28] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 5 07:00:02 2022] POST /identity/v3/roles => generated 219 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:00:03.380518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aad01-e4bd-4a89-a0ce-a6dab858da38 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:03.381000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aad01-e4bd-4a89-a0ce-a6dab858da38 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:03.381443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aad01-e4bd-4a89-a0ce-a6dab858da38 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:03.382954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 13/29] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:03.383893 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aad01-e4bd-4a89-a0ce-a6dab858da38 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:03.403520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497eabc-e14a-4887-a5d9-ede3912bca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:03.404629 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497eabc-e14a-4887-a5d9-ede3912bca51 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:03.405097 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497eabc-e14a-4887-a5d9-ede3912bca51 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:03.405674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497eabc-e14a-4887-a5d9-ede3912bca51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:03.408255 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:03.436321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497eabc-e14a-4887-a5d9-ede3912bca51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:03.439003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497eabc-e14a-4887-a5d9-ede3912bca51 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9497eabc-e14a-4887-a5d9-ede3912bca51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:00:03.470150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:03.471158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:03.471967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:00:03.471967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:00:03.471967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:00:03.471967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:03.473743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 17/30] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:03.475356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528872b9-dfb7-4233-bcac-612bf70d4607 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:03.475843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528872b9-dfb7-4233-bcac-612bf70d4607 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:03.476264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528872b9-dfb7-4233-bcac-612bf70d4607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:03.497227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-528872b9-dfb7-4233-bcac-612bf70d4607 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:03.498704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-528872b9-dfb7-4233-bcac-612bf70d4607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:03.594211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aad01-e4bd-4a89-a0ce-a6dab858da38 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:03.618478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 18/31] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:03.619134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528872b9-dfb7-4233-bcac-612bf70d4607 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:03.640386 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f4f0f-a7fc-47f2-b30d-707aacf8719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:03.641280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f4f0f-a7fc-47f2-b30d-707aacf8719d None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:03.641569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f4f0f-a7fc-47f2-b30d-707aacf8719d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:03.641854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f4f0f-a7fc-47f2-b30d-707aacf8719d None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:03.642785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f4f0f-a7fc-47f2-b30d-707aacf8719d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:03.644411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f4f0f-a7fc-47f2-b30d-707aacf8719d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:03.664667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 14/32] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 5 07:00:03 2022] POST /identity/v3/roles => generated 225 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:00:03.667317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65299cd4-bd9c-430f-bb85-8c05a3a969a1 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:03.667879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65299cd4-bd9c-430f-bb85-8c05a3a969a1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:03.668396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65299cd4-bd9c-430f-bb85-8c05a3a969a1 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:03.670722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 15/33] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:03.671957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65299cd4-bd9c-430f-bb85-8c05a3a969a1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:03.739848 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:03.769809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528872b9-dfb7-4233-bcac-612bf70d4607 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:03.803010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:03.824533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65299cd4-bd9c-430f-bb85-8c05a3a969a1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:03.831195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31a891-a914-4219-ab3f-e4411af6a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:03.831908 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31a891-a914-4219-ab3f-e4411af6a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:03.832212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31a891-a914-4219-ab3f-e4411af6a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:03.832464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31a891-a914-4219-ab3f-e4411af6a4a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:03.833209 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31a891-a914-4219-ab3f-e4411af6a4a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:03.833521 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31a891-a914-4219-ab3f-e4411af6a4a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:03.834954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31a891-a914-4219-ab3f-e4411af6a4a1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:03.860948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 19/34] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:03.862233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51b548-3c37-4cc1-9056-8e59c863f929 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:03.862518 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51b548-3c37-4cc1-9056-8e59c863f929 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:03.862793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51b548-3c37-4cc1-9056-8e59c863f929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:03.874196 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b144f-ca73-47e3-8281-f5767783f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:03.874516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b144f-ca73-47e3-8281-f5767783f561 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:03.874781 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b144f-ca73-47e3-8281-f5767783f561 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:03.875056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b144f-ca73-47e3-8281-f5767783f561 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:03.885137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-eb51b548-3c37-4cc1-9056-8e59c863f929 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:03.886769 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-eb51b548-3c37-4cc1-9056-8e59c863f929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:03.889006 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b144f-ca73-47e3-8281-f5767783f561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f84b144f-ca73-47e3-8281-f5767783f561 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:03.896223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:03.897129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:03.897884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 16/35] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:03.898501 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b144f-ca73-47e3-8281-f5767783f561 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:03.972961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 20/36] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:03.972961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51b548-3c37-4cc1-9056-8e59c863f929 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:04.004437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:04.010907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b144f-ca73-47e3-8281-f5767783f561 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:04.046283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3115014-d295-44c8-bf91-ae77c73ad4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:04.046853 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3115014-d295-44c8-bf91-ae77c73ad4b6 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:04.047141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3115014-d295-44c8-bf91-ae77c73ad4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:04.047420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3115014-d295-44c8-bf91-ae77c73ad4b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:04.048440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3115014-d295-44c8-bf91-ae77c73ad4b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:04.050118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3115014-d295-44c8-bf91-ae77c73ad4b6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:04.088925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 17/37] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:00:03 2022] POST /identity/v3/projects => generated 301 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:00:04.088925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3115014-d295-44c8-bf91-ae77c73ad4b6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:04.098473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51b548-3c37-4cc1-9056-8e59c863f929 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:04.107156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:04.157896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cb29c-19d2-45d8-9e3f-45ab6916d91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:04.158846 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb29c-19d2-45d8-9e3f-45ab6916d91e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:04.159193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb29c-19d2-45d8-9e3f-45ab6916d91e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:04.159542 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cb29c-19d2-45d8-9e3f-45ab6916d91e None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:04.160595 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cb29c-19d2-45d8-9e3f-45ab6916d91e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:04.161143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cb29c-19d2-45d8-9e3f-45ab6916d91e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:04.162692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cb29c-19d2-45d8-9e3f-45ab6916d91e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:04.174352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 21/38] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:04.180186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cb29c-19d2-45d8-9e3f-45ab6916d91e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:04.219214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3115014-d295-44c8-bf91-ae77c73ad4b6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:04.260253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4da3c-0181-412b-8611-e1c5b9e3ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:04.260949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4da3c-0181-412b-8611-e1c5b9e3ff73 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:04.261239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4da3c-0181-412b-8611-e1c5b9e3ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:04.261527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4da3c-0181-412b-8611-e1c5b9e3ff73 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:04.262350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4da3c-0181-412b-8611-e1c5b9e3ff73 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:04.263825 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4da3c-0181-412b-8611-e1c5b9e3ff73 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:04.283516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 18/39] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 5 07:00:04 2022] POST /identity/v3/roles => generated 223 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:00:04.284837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57554f8-811b-4aaa-99c5-11c696b84caf None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:04.285156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57554f8-811b-4aaa-99c5-11c696b84caf None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:04.285431 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57554f8-811b-4aaa-99c5-11c696b84caf None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:04.286746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 19/40] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:04.293708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b02aeb-9413-4454-978b-f40e203ab2cf None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:04.293904 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b02aeb-9413-4454-978b-f40e203ab2cf None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:04.294140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b02aeb-9413-4454-978b-f40e203ab2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:04.317089 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-94b02aeb-9413-4454-978b-f40e203ab2cf None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:04.317649 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cb29c-19d2-45d8-9e3f-45ab6916d91e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:04.319260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-94b02aeb-9413-4454-978b-f40e203ab2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:04.321959 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:04.362480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c3c6c-0674-41cd-8736-8653b323b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:04.363288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c3c6c-0674-41cd-8736-8653b323b482 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:04.363462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c3c6c-0674-41cd-8736-8653b323b482 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:04.363724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c3c6c-0674-41cd-8736-8653b323b482 None admin] PATH_INFO: `/v3/users/1acd68042e0349f6afed23e5889b5da6` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:04.365767 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c3c6c-0674-41cd-8736-8653b323b482 None admin] RBAC: Authorizing `identity:get_user(user_id=1acd68042e0349f6afed23e5889b5da6)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:04.367617 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c3c6c-0674-41cd-8736-8653b323b482 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:04.371096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 22/41] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:04 2022] GET /identity/v3/users/1acd68042e0349f6afed23e5889b5da6 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:04.377297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c3c6c-0674-41cd-8736-8653b323b482 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:04.410126 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 20/42] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:04.423556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:04.433338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b02aeb-9413-4454-978b-f40e203ab2cf None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:04.506129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c3c6c-0674-41cd-8736-8653b323b482 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:04.543108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c709c-a74d-4405-b620-3851995e1eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:04.543765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c709c-a74d-4405-b620-3851995e1eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:04.544042 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c709c-a74d-4405-b620-3851995e1eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:04.544322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c709c-a74d-4405-b620-3851995e1eb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:04.545500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c709c-a74d-4405-b620-3851995e1eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:04.546964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c709c-a74d-4405-b620-3851995e1eb2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:04.548557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 23/43] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:04.549940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b02aeb-9413-4454-978b-f40e203ab2cf None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:04.554240 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c709c-a74d-4405-b620-3851995e1eb2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:04.584178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba2f9e-e608-4219-8b5c-db60af2cc737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:04.584748 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba2f9e-e608-4219-8b5c-db60af2cc737 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:04.585053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba2f9e-e608-4219-8b5c-db60af2cc737 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:04.585334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba2f9e-e608-4219-8b5c-db60af2cc737 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:04.586809 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba2f9e-e608-4219-8b5c-db60af2cc737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:04.588247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba2f9e-e608-4219-8b5c-db60af2cc737 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:04.589875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 21/44] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:04.595769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba2f9e-e608-4219-8b5c-db60af2cc737 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:04.604367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:04.656341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c709c-a74d-4405-b620-3851995e1eb2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:04.658658 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:04.691997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7007ef-0617-409b-aa5e-67e5b8f1d465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:04.692698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7007ef-0617-409b-aa5e-67e5b8f1d465 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:04.693009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7007ef-0617-409b-aa5e-67e5b8f1d465 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:04.693285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7007ef-0617-409b-aa5e-67e5b8f1d465 None admin] PATH_INFO: `/v3/domains/default/users/1acd68042e0349f6afed23e5889b5da6/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:04.695323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7007ef-0617-409b-aa5e-67e5b8f1d465 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1acd68042e0349f6afed23e5889b5da6, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:04.695567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba2f9e-e608-4219-8b5c-db60af2cc737 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:04.696793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7007ef-0617-409b-aa5e-67e5b8f1d465 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:04.729528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc36d8c-fa7b-4be7-a7bc-222ae004d07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:04.730155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc36d8c-fa7b-4be7-a7bc-222ae004d07a None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:04.730435 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc36d8c-fa7b-4be7-a7bc-222ae004d07a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:04.730708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc36d8c-fa7b-4be7-a7bc-222ae004d07a None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:04.731389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc36d8c-fa7b-4be7-a7bc-222ae004d07a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:04.732822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc36d8c-fa7b-4be7-a7bc-222ae004d07a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:04.759062 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:00:04 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:00:04.810953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 24/46] 10.222.0.27 () {58 vars in 1361 bytes} [Fri Aug 5 07:00:04 2022] PUT /identity/v3/domains/default/users/1acd68042e0349f6afed23e5889b5da6/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:00:06.773222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86a304-9508-4c4d-a23c-97b9b34bf4df None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:06.773771 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86a304-9508-4c4d-a23c-97b9b34bf4df None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:06.773771 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86a304-9508-4c4d-a23c-97b9b34bf4df None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:06.774498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2446c-de02-40d6-b261-79f0cca1ebb9 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:06.774903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2446c-de02-40d6-b261-79f0cca1ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:06.775301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2446c-de02-40d6-b261-79f0cca1ebb9 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:06.775448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 23/47] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:06.779803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 25/48] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:00:06.780165 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83cd71-9e20-44b1-b666-e4243ed24572 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:06.780538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83cd71-9e20-44b1-b666-e4243ed24572 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:06.780875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83cd71-9e20-44b1-b666-e4243ed24572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:06.785141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564074a-e26e-4af2-8f02-7e7fa24eff6d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:06.785434 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564074a-e26e-4af2-8f02-7e7fa24eff6d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:06.785714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564074a-e26e-4af2-8f02-7e7fa24eff6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:06.800208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5b83cd71-9e20-44b1-b666-e4243ed24572 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:06.801442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5b83cd71-9e20-44b1-b666-e4243ed24572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:06.804959 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6564074a-e26e-4af2-8f02-7e7fa24eff6d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:06.806467 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6564074a-e26e-4af2-8f02-7e7fa24eff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:06.859257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:06.875097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 24/49] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:06.878426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 26/50] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:06.897665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83cd71-9e20-44b1-b666-e4243ed24572 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:06.901463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564074a-e26e-4af2-8f02-7e7fa24eff6d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:06.996597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:07.001842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83cd71-9e20-44b1-b666-e4243ed24572 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:07.004241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564074a-e26e-4af2-8f02-7e7fa24eff6d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:07.037394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4469a-16bc-4687-948d-015a473e37ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:07.037957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4469a-16bc-4687-948d-015a473e37ec None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:07.038241 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4469a-16bc-4687-948d-015a473e37ec None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:07.038518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4469a-16bc-4687-948d-015a473e37ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:07.039128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24a264-fe57-48bf-8fd4-5f69b754502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:07.039821 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24a264-fe57-48bf-8fd4-5f69b754502a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:07.040103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24a264-fe57-48bf-8fd4-5f69b754502a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:07.040381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24a264-fe57-48bf-8fd4-5f69b754502a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:07.041556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24a264-fe57-48bf-8fd4-5f69b754502a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:07.043152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24a264-fe57-48bf-8fd4-5f69b754502a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:07.044764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 27/51] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:07.049200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4469a-16bc-4687-948d-015a473e37ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:07.050683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24a264-fe57-48bf-8fd4-5f69b754502a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-30a4469a-16bc-4687-948d-015a473e37ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:07.054260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:07.055162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:07.055908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 25/52] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:00:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:07.061504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4469a-16bc-4687-948d-015a473e37ec None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:07.111877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:07.155046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24a264-fe57-48bf-8fd4-5f69b754502a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:07.162147 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4469a-16bc-4687-948d-015a473e37ec None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:07.190234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef280ee3-8bfe-407e-acfe-ea6f5ad90b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:07.190868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef280ee3-8bfe-407e-acfe-ea6f5ad90b7f None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:07.191154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef280ee3-8bfe-407e-acfe-ea6f5ad90b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:07.191458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef280ee3-8bfe-407e-acfe-ea6f5ad90b7f None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:07.192147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef280ee3-8bfe-407e-acfe-ea6f5ad90b7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:07.193660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef280ee3-8bfe-407e-acfe-ea6f5ad90b7f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:07.196432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dedfbc-307d-4cb2-9c5b-44581b80e223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:07.197119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dedfbc-307d-4cb2-9c5b-44581b80e223 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:07.197403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dedfbc-307d-4cb2-9c5b-44581b80e223 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:07.197676 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dedfbc-307d-4cb2-9c5b-44581b80e223 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:07.198392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dedfbc-307d-4cb2-9c5b-44581b80e223 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:07.198698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dedfbc-307d-4cb2-9c5b-44581b80e223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:07.200080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dedfbc-307d-4cb2-9c5b-44581b80e223 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:07.212618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:07.219421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dedfbc-307d-4cb2-9c5b-44581b80e223 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:07.225094 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 28/54] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Aug 5 07:00:07 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:00:07.333097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dedfbc-307d-4cb2-9c5b-44581b80e223 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:07.344766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:07.370355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a8922-2174-4c2e-85fd-317928695b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:07.370997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a8922-2174-4c2e-85fd-317928695b28 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:07.371304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a8922-2174-4c2e-85fd-317928695b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:07.371580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a8922-2174-4c2e-85fd-317928695b28 None admin] PATH_INFO: `/v3/users/1acd68042e0349f6afed23e5889b5da6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:07.373075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a8922-2174-4c2e-85fd-317928695b28 None admin] RBAC: Authorizing `identity:get_user(user_id=1acd68042e0349f6afed23e5889b5da6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:07.374531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a8922-2174-4c2e-85fd-317928695b28 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:07.376135 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:07 2022] GET /identity/v3/users/1acd68042e0349f6afed23e5889b5da6 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:07.382155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef280ee3-8bfe-407e-acfe-ea6f5ad90b7f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:07.400063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:07.485538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef280ee3-8bfe-407e-acfe-ea6f5ad90b7f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:07.520859 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b9bf6-c9eb-4c37-9171-35b918a30f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:07.521537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b9bf6-c9eb-4c37-9171-35b918a30f84 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:07.521814 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b9bf6-c9eb-4c37-9171-35b918a30f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:07.522093 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b9bf6-c9eb-4c37-9171-35b918a30f84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:07.523274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b9bf6-c9eb-4c37-9171-35b918a30f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:07.524737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b9bf6-c9eb-4c37-9171-35b918a30f84 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:07.526366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 29/56] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:07.532283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a8922-2174-4c2e-85fd-317928695b28 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:07.636455 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a8922-2174-4c2e-85fd-317928695b28 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:07.671576 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046db69-a8ca-4379-b330-0f99a9986d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:07.672199 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046db69-a8ca-4379-b330-0f99a9986d33 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:07.672475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046db69-a8ca-4379-b330-0f99a9986d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:07.672753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046db69-a8ca-4379-b330-0f99a9986d33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:07.673571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046db69-a8ca-4379-b330-0f99a9986d33 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.domain.id=default, user.id=1acd68042e0349f6afed23e5889b5da6) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:07.673876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046db69-a8ca-4379-b330-0f99a9986d33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:07.675399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046db69-a8ca-4379-b330-0f99a9986d33 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:07.685296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Aug 5 07:00:07 2022] GET /identity/v3/role_assignments?user.id=1acd68042e0349f6afed23e5889b5da6&scope.domain.id=default&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:09.223207 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9801cd-2cf3-4824-b393-07222812b744 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:09.223733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9801cd-2cf3-4824-b393-07222812b744 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:09.223733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9801cd-2cf3-4824-b393-07222812b744 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:09.225260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 30/58] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:09.230696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0e63c-1cec-4c34-9f01-2dce30346c65 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:09.231078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0e63c-1cec-4c34-9f01-2dce30346c65 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:09.231242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0e63c-1cec-4c34-9f01-2dce30346c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:09.250492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a8a0e63c-1cec-4c34-9f01-2dce30346c65 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:09.251692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a8a0e63c-1cec-4c34-9f01-2dce30346c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:09.290818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:09.322896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:09.347574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9801cd-2cf3-4824-b393-07222812b744 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:09.435576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:09.456186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9801cd-2cf3-4824-b393-07222812b744 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:09.491523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edbc75-a557-4b9c-b596-b78c31ea740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:09.492098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edbc75-a557-4b9c-b596-b78c31ea740c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:09.492386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edbc75-a557-4b9c-b596-b78c31ea740c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:09.492661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edbc75-a557-4b9c-b596-b78c31ea740c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:09.493906 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edbc75-a557-4b9c-b596-b78c31ea740c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:09.495381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edbc75-a557-4b9c-b596-b78c31ea740c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:09.497007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 31/60] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:09.502976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0e63c-1cec-4c34-9f01-2dce30346c65 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:09.604921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0e63c-1cec-4c34-9f01-2dce30346c65 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:09.640938 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353e0bd-ed83-4632-a0e4-45bd717e2462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:09.641592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353e0bd-ed83-4632-a0e4-45bd717e2462 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:09.641874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353e0bd-ed83-4632-a0e4-45bd717e2462 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:09.642149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353e0bd-ed83-4632-a0e4-45bd717e2462 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:09.643038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353e0bd-ed83-4632-a0e4-45bd717e2462 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:09.644531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353e0bd-ed83-4632-a0e4-45bd717e2462 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:09.674610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 30/61] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:00:09 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:00:12.628866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fce9f1-6be5-416e-baa9-9b98d7bf48b2 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:12.628866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fce9f1-6be5-416e-baa9-9b98d7bf48b2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:12.628866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fce9f1-6be5-416e-baa9-9b98d7bf48b2 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:12.630018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 32/62] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:12.634260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0852a-c769-411d-a809-5b6ca9696377 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:12.635117 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0852a-c769-411d-a809-5b6ca9696377 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:12.635594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0852a-c769-411d-a809-5b6ca9696377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:12.657101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-11f0852a-c769-411d-a809-5b6ca9696377 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:12.658716 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-11f0852a-c769-411d-a809-5b6ca9696377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:12.691243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:12.749673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 31/63] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:12.784759 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fce9f1-6be5-416e-baa9-9b98d7bf48b2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:12.912806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fce9f1-6be5-416e-baa9-9b98d7bf48b2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:12.957059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e99012-7a4b-4ba6-8ce2-d521c349a75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:12.958131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e99012-7a4b-4ba6-8ce2-d521c349a75d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:12.958612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e99012-7a4b-4ba6-8ce2-d521c349a75d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:12.959083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e99012-7a4b-4ba6-8ce2-d521c349a75d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:12.970169 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e99012-7a4b-4ba6-8ce2-d521c349a75d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-93e99012-7a4b-4ba6-8ce2-d521c349a75d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:12.975818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:12.976674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:12.977455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:12.977455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:12.977455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:12.977455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:12.977455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:12.977455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:12.977455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:12.977455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:12.977455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:12.977455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:12.977455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:12.977455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:12.980160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 33/64] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:12.985823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0852a-c769-411d-a809-5b6ca9696377 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:12.992949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a1eca-a634-4472-b228-7c75e934a940 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:12.993504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a1eca-a634-4472-b228-7c75e934a940 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:12.993979 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a1eca-a634-4472-b228-7c75e934a940 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:12.995971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 34/65] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:13.005536 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be06bcc-7cd6-436b-89f3-62ee851cece2 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.006082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be06bcc-7cd6-436b-89f3-62ee851cece2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.006557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be06bcc-7cd6-436b-89f3-62ee851cece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.032581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6be06bcc-7cd6-436b-89f3-62ee851cece2 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:13.034322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6be06bcc-7cd6-436b-89f3-62ee851cece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:13.041049 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:13.145131 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0852a-c769-411d-a809-5b6ca9696377 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:13.171180 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 35/66] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:13.188113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0250b0-4163-4a8d-97a0-1c837d933e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:13.188813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0250b0-4163-4a8d-97a0-1c837d933e51 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.189115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0250b0-4163-4a8d-97a0-1c837d933e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.189389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0250b0-4163-4a8d-97a0-1c837d933e51 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.190242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0250b0-4163-4a8d-97a0-1c837d933e51 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:13.190542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0250b0-4163-4a8d-97a0-1c837d933e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:13.191931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0250b0-4163-4a8d-97a0-1c837d933e51 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:13.194020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be06bcc-7cd6-436b-89f3-62ee851cece2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:13.201296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 32/67] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:13.209422 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0250b0-4163-4a8d-97a0-1c837d933e51 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:13.243667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:13.306106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be06bcc-7cd6-436b-89f3-62ee851cece2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:13.331204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0250b0-4163-4a8d-97a0-1c837d933e51 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:13.343523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fb7e7-a958-43c8-8e8f-c3ebe97f6140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:13.344544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb7e7-a958-43c8-8e8f-c3ebe97f6140 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.345061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb7e7-a958-43c8-8e8f-c3ebe97f6140 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.345561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb7e7-a958-43c8-8e8f-c3ebe97f6140 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.354315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:13.357964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fb7e7-a958-43c8-8e8f-c3ebe97f6140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-040fb7e7-a958-43c8-8e8f-c3ebe97f6140 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:13.363735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:13.364591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:13.365692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:13.365692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:13.365692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:13.365692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:13.365692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:13.365692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:13.365692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:13.365692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:13.365692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:13.365692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:13.365692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:13.365692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:13.366266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 36/68] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:00:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:00:13.367494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d39875-d2e1-4189-803e-06a73f3ed46e None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.367787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d39875-d2e1-4189-803e-06a73f3ed46e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.368067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d39875-d2e1-4189-803e-06a73f3ed46e None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.369873 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 37/69] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:13.372377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac43f0-b7ce-4f4e-9537-178aed2aff0a None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.372660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac43f0-b7ce-4f4e-9537-178aed2aff0a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.372956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac43f0-b7ce-4f4e-9537-178aed2aff0a None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.374262 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 38/70] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:13.375134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac43f0-b7ce-4f4e-9537-178aed2aff0a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:13.378799 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75f6ee-a5e4-4f5d-902b-edc0ff562826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:13.379473 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f6ee-a5e4-4f5d-902b-edc0ff562826 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.379756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f6ee-a5e4-4f5d-902b-edc0ff562826 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.380030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75f6ee-a5e4-4f5d-902b-edc0ff562826 None admin] PATH_INFO: `/v3/users/11359104efc34da0960a532caed4dfd7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.397767 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75f6ee-a5e4-4f5d-902b-edc0ff562826 None admin] RBAC: Authorizing `identity:get_user(user_id=11359104efc34da0960a532caed4dfd7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:13.399367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75f6ee-a5e4-4f5d-902b-edc0ff562826 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:13.405735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 33/71] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:13 2022] GET /identity/v3/users/11359104efc34da0960a532caed4dfd7 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:13.405735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102fde5-395b-4214-911d-60f1d793843b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.405735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102fde5-395b-4214-911d-60f1d793843b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.405735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102fde5-395b-4214-911d-60f1d793843b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.422407 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2102fde5-395b-4214-911d-60f1d793843b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:13.423542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2102fde5-395b-4214-911d-60f1d793843b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:13.486901 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac43f0-b7ce-4f4e-9537-178aed2aff0a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:13.495696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 34/72] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:13.497013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c75f66-8d50-4395-86eb-79564a09e45b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.497316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c75f66-8d50-4395-86eb-79564a09e45b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.497548 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c75f66-8d50-4395-86eb-79564a09e45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.515055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b0c75f66-8d50-4395-86eb-79564a09e45b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:13.516265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b0c75f66-8d50-4395-86eb-79564a09e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:13.518459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:13.522555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a2bc5-9cfd-4a0a-9db2-a8ac3479fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:13.523187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a2bc5-9cfd-4a0a-9db2-a8ac3479fe7b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.523470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a2bc5-9cfd-4a0a-9db2-a8ac3479fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.523744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a2bc5-9cfd-4a0a-9db2-a8ac3479fe7b None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.524470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a2bc5-9cfd-4a0a-9db2-a8ac3479fe7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:13.524774 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a2bc5-9cfd-4a0a-9db2-a8ac3479fe7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:13.526204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a2bc5-9cfd-4a0a-9db2-a8ac3479fe7b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:13.534883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 39/73] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:13.535745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a2bc5-9cfd-4a0a-9db2-a8ac3479fe7b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:13.591644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 35/74] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:13.592922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f2667-73f7-4f77-a864-86adda8c85ea None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.593258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f2667-73f7-4f77-a864-86adda8c85ea None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.593795 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f2667-73f7-4f77-a864-86adda8c85ea None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.594753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 36/75] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:13.595459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f2667-73f7-4f77-a864-86adda8c85ea None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:13.599175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:13.644713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a2bc5-9cfd-4a0a-9db2-a8ac3479fe7b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:13.678122 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03944f-f97f-4aa0-b4a8-15e0e4da559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:13.678666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03944f-f97f-4aa0-b4a8-15e0e4da559e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.678946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03944f-f97f-4aa0-b4a8-15e0e4da559e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.679222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03944f-f97f-4aa0-b4a8-15e0e4da559e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.702946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f2667-73f7-4f77-a864-86adda8c85ea None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:13.739261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2c710-4158-4997-9b88-25fa9a478ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:13.739925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2c710-4158-4997-9b88-25fa9a478ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.740204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2c710-4158-4997-9b88-25fa9a478ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.740486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2c710-4158-4997-9b88-25fa9a478ef2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.746234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03944f-f97f-4aa0-b4a8-15e0e4da559e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:13.747469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:13.747729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03944f-f97f-4aa0-b4a8-15e0e4da559e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:13.751794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2c710-4158-4997-9b88-25fa9a478ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-83b2c710-4158-4997-9b88-25fa9a478ef2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:13.757300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:13.758174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:13.759120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 37/76] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:00:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:13.759951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2c710-4158-4997-9b88-25fa9a478ef2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:13.811866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:13.861092 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 40/77] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:13.861092 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8551-91da-4ddb-8e10-567ef3489876 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.861092 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8551-91da-4ddb-8e10-567ef3489876 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.861092 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8551-91da-4ddb-8e10-567ef3489876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.863882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2c710-4158-4997-9b88-25fa9a478ef2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:13.878681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c68a8551-91da-4ddb-8e10-567ef3489876 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:13.879887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c68a8551-91da-4ddb-8e10-567ef3489876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:13.898403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6a28d-a6e9-40fa-b442-5821d97163f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:13.899061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6a28d-a6e9-40fa-b442-5821d97163f0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:13.899343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6a28d-a6e9-40fa-b442-5821d97163f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:13.899620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6a28d-a6e9-40fa-b442-5821d97163f0 None admin] PATH_INFO: `/v3/users/1acd68042e0349f6afed23e5889b5da6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:13.900815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6a28d-a6e9-40fa-b442-5821d97163f0 None admin] RBAC: Authorizing `identity:get_user(user_id=1acd68042e0349f6afed23e5889b5da6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:13.902336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6a28d-a6e9-40fa-b442-5821d97163f0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:13.903944 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 38/78] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:13 2022] GET /identity/v3/users/1acd68042e0349f6afed23e5889b5da6 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:13.904709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6a28d-a6e9-40fa-b442-5821d97163f0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:13.947592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 41/79] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:13.948364 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a8551-91da-4ddb-8e10-567ef3489876 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:13.974294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:14.012046 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6a28d-a6e9-40fa-b442-5821d97163f0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:14.050033 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e85eb5-705b-4739-a88e-109da1b0b921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:14.050626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:14.050891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85eb5-705b-4739-a88e-109da1b0b921 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:14.051185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85eb5-705b-4739-a88e-109da1b0b921 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:14.051461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85eb5-705b-4739-a88e-109da1b0b921 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:14.060297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a8551-91da-4ddb-8e10-567ef3489876 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:14.063898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e85eb5-705b-4739-a88e-109da1b0b921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e1e85eb5-705b-4739-a88e-109da1b0b921 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:14.069168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:14.070312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:14.071061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 39/80] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:14.073122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e85eb5-705b-4739-a88e-109da1b0b921 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:14.099441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9116d9-ecfc-4d71-91e1-26a41f872e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:14.100075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9116d9-ecfc-4d71-91e1-26a41f872e2e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:14.100357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9116d9-ecfc-4d71-91e1-26a41f872e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:14.100632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9116d9-ecfc-4d71-91e1-26a41f872e2e None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:14.101394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9116d9-ecfc-4d71-91e1-26a41f872e2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:14.101702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9116d9-ecfc-4d71-91e1-26a41f872e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:14.103091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9116d9-ecfc-4d71-91e1-26a41f872e2e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:14.112006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 42/81] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:00:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:14.112878 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9116d9-ecfc-4d71-91e1-26a41f872e2e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:14.206672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e85eb5-705b-4739-a88e-109da1b0b921 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:14.239774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:14.246236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9116d9-ecfc-4d71-91e1-26a41f872e2e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:14.250302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299909b-fd8b-4954-9a08-173beda6903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:14.250964 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299909b-fd8b-4954-9a08-173beda6903f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:14.251246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299909b-fd8b-4954-9a08-173beda6903f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:14.251521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299909b-fd8b-4954-9a08-173beda6903f None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:14.253283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299909b-fd8b-4954-9a08-173beda6903f None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:14.254774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299909b-fd8b-4954-9a08-173beda6903f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:14.257047 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 40/82] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:14 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:14.257291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299909b-fd8b-4954-9a08-173beda6903f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:14.288036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee0207-6e3c-41ce-8a6e-e4308f0c9b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:14.288665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee0207-6e3c-41ce-8a6e-e4308f0c9b2e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:14.289331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee0207-6e3c-41ce-8a6e-e4308f0c9b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:14.289593 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee0207-6e3c-41ce-8a6e-e4308f0c9b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:14.314775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:14.360559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee0207-6e3c-41ce-8a6e-e4308f0c9b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:14.362301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee0207-6e3c-41ce-8a6e-e4308f0c9b2e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:14.370956 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299909b-fd8b-4954-9a08-173beda6903f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:14.406318 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63867416-1822-472f-bf7f-498ff4b439cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:14.406968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63867416-1822-472f-bf7f-498ff4b439cb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:14.407242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63867416-1822-472f-bf7f-498ff4b439cb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:14.407516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63867416-1822-472f-bf7f-498ff4b439cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:14.408747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63867416-1822-472f-bf7f-498ff4b439cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:14.410252 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63867416-1822-472f-bf7f-498ff4b439cb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:14.411886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 41/83] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:14.412641 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63867416-1822-472f-bf7f-498ff4b439cb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:14.472052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 43/84] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:14.473179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee0207-6e3c-41ce-8a6e-e4308f0c9b2e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:14.490534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:14.539760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:14.540011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63867416-1822-472f-bf7f-498ff4b439cb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:14.577478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c0cae-bf5c-4e8c-90cf-a1e655a8bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:14.578111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c0cae-bf5c-4e8c-90cf-a1e655a8bf5f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:14.578395 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c0cae-bf5c-4e8c-90cf-a1e655a8bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:14.578673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c0cae-bf5c-4e8c-90cf-a1e655a8bf5f None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:14.579401 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c0cae-bf5c-4e8c-90cf-a1e655a8bf5f None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:14.579709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c0cae-bf5c-4e8c-90cf-a1e655a8bf5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:14.581373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c0cae-bf5c-4e8c-90cf-a1e655a8bf5f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:14.590483 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 42/85] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:14.591315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c0cae-bf5c-4e8c-90cf-a1e655a8bf5f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:14.591764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee0207-6e3c-41ce-8a6e-e4308f0c9b2e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:14.634391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbc4d6-4276-4e57-8f41-7e19f9f34b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:14.635060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbc4d6-4276-4e57-8f41-7e19f9f34b4d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:14.635333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbc4d6-4276-4e57-8f41-7e19f9f34b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:14.635613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbc4d6-4276-4e57-8f41-7e19f9f34b4d None admin] PATH_INFO: `/v3/users/11359104efc34da0960a532caed4dfd7` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:14.636829 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbc4d6-4276-4e57-8f41-7e19f9f34b4d None admin] RBAC: Authorizing `identity:get_user(user_id=11359104efc34da0960a532caed4dfd7)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:14.638366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbc4d6-4276-4e57-8f41-7e19f9f34b4d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:14.640015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 44/86] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:14 2022] GET /identity/v3/users/11359104efc34da0960a532caed4dfd7 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:14.640770 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbc4d6-4276-4e57-8f41-7e19f9f34b4d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:14.709539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c0cae-bf5c-4e8c-90cf-a1e655a8bf5f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:14.733057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:14.747393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd660a4-7c2c-4753-9238-d55ced7d8ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:14.748202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd660a4-7c2c-4753-9238-d55ced7d8ead None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:14.748598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd660a4-7c2c-4753-9238-d55ced7d8ead None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:14.748981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd660a4-7c2c-4753-9238-d55ced7d8ead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:14.749914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd660a4-7c2c-4753-9238-d55ced7d8ead None admin] RBAC: Adding query filter params (role.id=2d65d41d83b24e36b4a751ac3f7fb178, scope.project.id=e917870b5e964ef4a1fecad71d41d379, user.id=11359104efc34da0960a532caed4dfd7) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:14.750273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd660a4-7c2c-4753-9238-d55ced7d8ead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:14.751786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd660a4-7c2c-4753-9238-d55ced7d8ead None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:14.755433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbc4d6-4276-4e57-8f41-7e19f9f34b4d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:14.757675 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 43/87] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:14 2022] GET /identity/v3/role_assignments?user.id=11359104efc34da0960a532caed4dfd7&scope.project.id=e917870b5e964ef4a1fecad71d41d379&role.id=2d65d41d83b24e36b4a751ac3f7fb178 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:14.758500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd660a4-7c2c-4753-9238-d55ced7d8ead None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:14.788028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:14.805226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4621d-f005-48f8-938c-b7738c84e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:14.805875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4621d-f005-48f8-938c-b7738c84e71a None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:14.806160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4621d-f005-48f8-938c-b7738c84e71a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:14.806434 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4621d-f005-48f8-938c-b7738c84e71a None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:14.807155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4621d-f005-48f8-938c-b7738c84e71a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:14.808685 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4621d-f005-48f8-938c-b7738c84e71a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:14.843308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 45/88] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:00:14 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:00:14.844216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4621d-f005-48f8-938c-b7738c84e71a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:14.939353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd660a4-7c2c-4753-9238-d55ced7d8ead None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:14.989650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b851882-62a8-4555-a7b5-0f694d32d148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:14.990230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b851882-62a8-4555-a7b5-0f694d32d148 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:14.992133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b851882-62a8-4555-a7b5-0f694d32d148 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:14.992412 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b851882-62a8-4555-a7b5-0f694d32d148 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:14.993788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b851882-62a8-4555-a7b5-0f694d32d148 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:14.995502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b851882-62a8-4555-a7b5-0f694d32d148 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:14.997182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 44/89] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:14 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:14.998006 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b851882-62a8-4555-a7b5-0f694d32d148 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:15.001546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4621d-f005-48f8-938c-b7738c84e71a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:15.045219 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dae43-1988-428c-a7ba-0e4acc2baae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:15.046337 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dae43-1988-428c-a7ba-0e4acc2baae2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:15.046625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dae43-1988-428c-a7ba-0e4acc2baae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:15.047761 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dae43-1988-428c-a7ba-0e4acc2baae2 None admin] PATH_INFO: `/v3/users/11359104efc34da0960a532caed4dfd7` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:15.049221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dae43-1988-428c-a7ba-0e4acc2baae2 None admin] RBAC: Authorizing `identity:get_user(user_id=11359104efc34da0960a532caed4dfd7)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:15.050849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dae43-1988-428c-a7ba-0e4acc2baae2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:15.056984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 46/90] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:14 2022] GET /identity/v3/users/11359104efc34da0960a532caed4dfd7 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:15.058316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dae43-1988-428c-a7ba-0e4acc2baae2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:15.064778 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:15.129329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:15.143238 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b851882-62a8-4555-a7b5-0f694d32d148 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:15.192119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f5f04-c67e-4cb0-9248-cadf24a27055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:15.193139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f5f04-c67e-4cb0-9248-cadf24a27055 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:15.193621 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f5f04-c67e-4cb0-9248-cadf24a27055 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:15.194074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f5f04-c67e-4cb0-9248-cadf24a27055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:15.218258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dae43-1988-428c-a7ba-0e4acc2baae2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:15.271424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608b942-55fb-401c-9fd4-d1d600116734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:15.272239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608b942-55fb-401c-9fd4-d1d600116734 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:15.272536 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608b942-55fb-401c-9fd4-d1d600116734 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:15.272813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608b942-55fb-401c-9fd4-d1d600116734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:15.273663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608b942-55fb-401c-9fd4-d1d600116734 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=e917870b5e964ef4a1fecad71d41d379, user.id=1acd68042e0349f6afed23e5889b5da6) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:15.273979 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608b942-55fb-401c-9fd4-d1d600116734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:15.275476 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608b942-55fb-401c-9fd4-d1d600116734 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:15.287266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 47/91] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:15 2022] GET /identity/v3/role_assignments?user.id=1acd68042e0349f6afed23e5889b5da6&scope.project.id=e917870b5e964ef4a1fecad71d41d379&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:15.288353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608b942-55fb-401c-9fd4-d1d600116734 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:15.308154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f5f04-c67e-4cb0-9248-cadf24a27055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:15.310142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f5f04-c67e-4cb0-9248-cadf24a27055 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:15.400398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:15.446021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608b942-55fb-401c-9fd4-d1d600116734 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:15.460433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 45/92] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:15.465414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:15.466718 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f5f04-c67e-4cb0-9248-cadf24a27055 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:15.519599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757c323-0d27-4e03-8092-0e0530f374ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:15.520273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757c323-0d27-4e03-8092-0e0530f374ad None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:15.520557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757c323-0d27-4e03-8092-0e0530f374ad None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:15.520845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757c323-0d27-4e03-8092-0e0530f374ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:15.672329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f5f04-c67e-4cb0-9248-cadf24a27055 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:15.696937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757c323-0d27-4e03-8092-0e0530f374ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:15.698157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757c323-0d27-4e03-8092-0e0530f374ad None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:15.756924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee8e55-c553-46c6-a570-cb6f3a48a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:15.756924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee8e55-c553-46c6-a570-cb6f3a48a425 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:15.756924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee8e55-c553-46c6-a570-cb6f3a48a425 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:15.756924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee8e55-c553-46c6-a570-cb6f3a48a425 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:15.759953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee8e55-c553-46c6-a570-cb6f3a48a425 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:15.761480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee8e55-c553-46c6-a570-cb6f3a48a425 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:15.763251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 46/93] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:15 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:15.771869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee8e55-c553-46c6-a570-cb6f3a48a425 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:15.831187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:15.935783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 48/94] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:15.938682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757c323-0d27-4e03-8092-0e0530f374ad None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:15.965276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:16.008182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee8e55-c553-46c6-a570-cb6f3a48a425 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:16.079188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fa32b-d225-4e11-bf7c-8021ab75f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:16.080259 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fa32b-d225-4e11-bf7c-8021ab75f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:16.080739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fa32b-d225-4e11-bf7c-8021ab75f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:16.082249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fa32b-d225-4e11-bf7c-8021ab75f6b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:16.086811 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fa32b-d225-4e11-bf7c-8021ab75f6b3 None admin] RBAC: Adding query filter params (role.id=04a9c139ed6d44d4bcd37b614aeb009e, scope.project.id=e917870b5e964ef4a1fecad71d41d379, user.id=11359104efc34da0960a532caed4dfd7) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:16.088444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fa32b-d225-4e11-bf7c-8021ab75f6b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:16.091159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fa32b-d225-4e11-bf7c-8021ab75f6b3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:16.104693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 47/95] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:15 2022] GET /identity/v3/role_assignments?user.id=11359104efc34da0960a532caed4dfd7&scope.project.id=e917870b5e964ef4a1fecad71d41d379&role.id=04a9c139ed6d44d4bcd37b614aeb009e => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:16.150136 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757c323-0d27-4e03-8092-0e0530f374ad None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:16.219296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcd960-e0b6-4810-9883-344e33955929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:16.219891 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcd960-e0b6-4810-9883-344e33955929 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:16.220173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcd960-e0b6-4810-9883-344e33955929 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:16.220455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcd960-e0b6-4810-9883-344e33955929 None admin] PATH_INFO: `/v3/projects/368cdbc1aa9248558ded3c3f0a94c2e2` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:16.221973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcd960-e0b6-4810-9883-344e33955929 None admin] RBAC: Authorizing `identity:get_project(project_id=368cdbc1aa9248558ded3c3f0a94c2e2)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:16.223477 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcd960-e0b6-4810-9883-344e33955929 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:16.225272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 49/96] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:15 2022] GET /identity/v3/projects/368cdbc1aa9248558ded3c3f0a94c2e2 => generated 312 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:16.231491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fa32b-d225-4e11-bf7c-8021ab75f6b3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:16.375518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:16.389854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fa32b-d225-4e11-bf7c-8021ab75f6b3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:16.426669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf204bd-8cdc-4a08-a1a2-c5e6c2d7f6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:16.427301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf204bd-8cdc-4a08-a1a2-c5e6c2d7f6aa None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:16.427581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf204bd-8cdc-4a08-a1a2-c5e6c2d7f6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:16.427899 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf204bd-8cdc-4a08-a1a2-c5e6c2d7f6aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:16.428699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf204bd-8cdc-4a08-a1a2-c5e6c2d7f6aa None admin] RBAC: Adding query filter params (role.id=2d65d41d83b24e36b4a751ac3f7fb178, scope.project.id=368cdbc1aa9248558ded3c3f0a94c2e2, user.id=11359104efc34da0960a532caed4dfd7) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:16.429030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf204bd-8cdc-4a08-a1a2-c5e6c2d7f6aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:16.430480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf204bd-8cdc-4a08-a1a2-c5e6c2d7f6aa None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:16.436699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 48/97] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:16 2022] GET /identity/v3/role_assignments?user.id=11359104efc34da0960a532caed4dfd7&scope.project.id=368cdbc1aa9248558ded3c3f0a94c2e2&role.id=2d65d41d83b24e36b4a751ac3f7fb178 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:17.698424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9914cb-ed9b-4349-a64d-726a92e2f632 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:17.699400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9914cb-ed9b-4349-a64d-726a92e2f632 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:17.699874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9914cb-ed9b-4349-a64d-726a92e2f632 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:17.701511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 50/98] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:17.707092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9cda7-731c-47f8-98f3-a7df37c083e1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:17.707940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9cda7-731c-47f8-98f3-a7df37c083e1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:17.708401 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9cda7-731c-47f8-98f3-a7df37c083e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:17.729594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7de9cda7-731c-47f8-98f3-a7df37c083e1 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:17.731124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7de9cda7-731c-47f8-98f3-a7df37c083e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:17.818450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 49/99] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:17.853332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9914cb-ed9b-4349-a64d-726a92e2f632 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:17.953681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:17.984422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9914cb-ed9b-4349-a64d-726a92e2f632 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:18.024433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad0d49-f8af-4b44-9d77-68a48c347cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:18.025142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad0d49-f8af-4b44-9d77-68a48c347cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.025424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad0d49-f8af-4b44-9d77-68a48c347cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.025698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad0d49-f8af-4b44-9d77-68a48c347cf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.040809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad0d49-f8af-4b44-9d77-68a48c347cf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-4fad0d49-f8af-4b44-9d77-68a48c347cf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:18.045953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:18.046789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:18.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:18.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:18.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:18.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:18.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:18.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:18.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:18.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:18.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:18.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:18.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:18.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:18.050385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 51/100] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:18.055965 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9cda7-731c-47f8-98f3-a7df37c083e1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:18.193202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:18.217211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9cda7-731c-47f8-98f3-a7df37c083e1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:18.266244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34822929-3dec-478b-8747-90082f5a1b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:18.266892 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34822929-3dec-478b-8747-90082f5a1b5c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.267174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34822929-3dec-478b-8747-90082f5a1b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.267451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34822929-3dec-478b-8747-90082f5a1b5c None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.268223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34822929-3dec-478b-8747-90082f5a1b5c None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:18.268530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34822929-3dec-478b-8747-90082f5a1b5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:18.269967 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34822929-3dec-478b-8747-90082f5a1b5c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:18.285323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 50/101] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:18.291025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad0d49-f8af-4b44-9d77-68a48c347cf4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:18.420165 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040288-e795-4ae3-bdac-3fa3f42b9416 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.420535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040288-e795-4ae3-bdac-3fa3f42b9416 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.420731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040288-e795-4ae3-bdac-3fa3f42b9416 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.422410 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 51/102] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:18.434259 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9873e-1fa4-45dc-b421-601490566434 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.434586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9873e-1fa4-45dc-b421-601490566434 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.434810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9873e-1fa4-45dc-b421-601490566434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.441621 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad0d49-f8af-4b44-9d77-68a48c347cf4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:18.474480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4ae9873e-1fa4-45dc-b421-601490566434 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:18.475746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4ae9873e-1fa4-45dc-b421-601490566434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:18.499960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3658d48-2cb2-4b76-bd7e-a37dad00ec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:18.501014 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3658d48-2cb2-4b76-bd7e-a37dad00ec39 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.501506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3658d48-2cb2-4b76-bd7e-a37dad00ec39 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.501964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3658d48-2cb2-4b76-bd7e-a37dad00ec39 None admin] PATH_INFO: `/v3/users/11359104efc34da0960a532caed4dfd7` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.503489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3658d48-2cb2-4b76-bd7e-a37dad00ec39 None admin] RBAC: Authorizing `identity:get_user(user_id=11359104efc34da0960a532caed4dfd7)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:18.509517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3658d48-2cb2-4b76-bd7e-a37dad00ec39 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:18.511902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 52/103] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:18 2022] GET /identity/v3/users/11359104efc34da0960a532caed4dfd7 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:18.517914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3658d48-2cb2-4b76-bd7e-a37dad00ec39 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:18.532970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:18.632573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 52/104] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 05 07:00:18.633947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c02b24-cd81-4bb6-ae2f-506c52096d8b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.634230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c02b24-cd81-4bb6-ae2f-506c52096d8b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.634510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c02b24-cd81-4bb6-ae2f-506c52096d8b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.641045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 53/105] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:18.642210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c4b8c-b65f-4931-956a-d7c4b4baa44f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.642492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c4b8c-b65f-4931-956a-d7c4b4baa44f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.642912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c4b8c-b65f-4931-956a-d7c4b4baa44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.674762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b44c4b8c-b65f-4931-956a-d7c4b4baa44f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:18.676472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b44c4b8c-b65f-4931-956a-d7c4b4baa44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:18.686018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3658d48-2cb2-4b76-bd7e-a37dad00ec39 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:18.730001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdb7fa-b999-4bbb-b61f-add47fe860b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:18.730643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb7fa-b999-4bbb-b61f-add47fe860b4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.730883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb7fa-b999-4bbb-b61f-add47fe860b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.731124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdb7fa-b999-4bbb-b61f-add47fe860b4 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.732844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdb7fa-b999-4bbb-b61f-add47fe860b4 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:18.734390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdb7fa-b999-4bbb-b61f-add47fe860b4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:18.736320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 53/106] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:18 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:18.738720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dc516-20d4-4621-a93f-b6b7b3daa60e None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.739694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dc516-20d4-4621-a93f-b6b7b3daa60e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.740450 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dc516-20d4-4621-a93f-b6b7b3daa60e None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.742817 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 54/107] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:18.744175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dc516-20d4-4621-a93f-b6b7b3daa60e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:18.747235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 54/108] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:18.749951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01fd42-2a9b-46c8-b562-3255b7b2a320 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.750324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01fd42-2a9b-46c8-b562-3255b7b2a320 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.750613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01fd42-2a9b-46c8-b562-3255b7b2a320 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.755870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 55/109] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:18.755870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01fd42-2a9b-46c8-b562-3255b7b2a320 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:18.770008 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:18.838686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:18.866827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dc516-20d4-4621-a93f-b6b7b3daa60e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:18.870903 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01fd42-2a9b-46c8-b562-3255b7b2a320 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:18.903437 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794eb53-05f1-45af-8236-a6b5e7c2a32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:18.904098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794eb53-05f1-45af-8236-a6b5e7c2a32b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.904377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794eb53-05f1-45af-8236-a6b5e7c2a32b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.904653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794eb53-05f1-45af-8236-a6b5e7c2a32b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.906795 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e81083-bf9a-4776-af01-06931ce2c7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:18.907500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e81083-bf9a-4776-af01-06931ce2c7e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.907787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e81083-bf9a-4776-af01-06931ce2c7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.908064 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e81083-bf9a-4776-af01-06931ce2c7e7 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379/users/11359104efc34da0960a532caed4dfd7/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.910110 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e81083-bf9a-4776-af01-06931ce2c7e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e917870b5e964ef4a1fecad71d41d379, user_id=11359104efc34da0960a532caed4dfd7, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:18.911595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e81083-bf9a-4776-af01-06931ce2c7e7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:18.917622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794eb53-05f1-45af-8236-a6b5e7c2a32b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-5794eb53-05f1-45af-8236-a6b5e7c2a32b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:18.923160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:18.924111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:18.924881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 55/110] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:18.925957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb2c04-6312-4338-904a-3c3b49dfa744 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.925957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb2c04-6312-4338-904a-3c3b49dfa744 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.926232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb2c04-6312-4338-904a-3c3b49dfa744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.933161 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 56/111] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:00:18 2022] PUT /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379/users/11359104efc34da0960a532caed4dfd7/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:18.934766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2951097-61f4-4c64-bb6f-ea96c24b17d9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:18.935063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2951097-61f4-4c64-bb6f-ea96c24b17d9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:18.935346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2951097-61f4-4c64-bb6f-ea96c24b17d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:18.953936 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7ebb2c04-6312-4338-904a-3c3b49dfa744 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:18.954427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b2951097-61f4-4c64-bb6f-ea96c24b17d9 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:18.955744 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b2951097-61f4-4c64-bb6f-ea96c24b17d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:18.956112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7ebb2c04-6312-4338-904a-3c3b49dfa744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:19.030517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:19.049163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 57/112] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:19.050756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2951097-61f4-4c64-bb6f-ea96c24b17d9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:19.054332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 56/113] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:19.055324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb2c04-6312-4338-904a-3c3b49dfa744 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:19.152072 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:19.193208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2951097-61f4-4c64-bb6f-ea96c24b17d9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:19.212957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb2c04-6312-4338-904a-3c3b49dfa744 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:19.229045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023c3cb-53aa-4880-add4-02e357665a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:19.229709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023c3cb-53aa-4880-add4-02e357665a7c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:19.230160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023c3cb-53aa-4880-add4-02e357665a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:19.230442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023c3cb-53aa-4880-add4-02e357665a7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:19.231618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023c3cb-53aa-4880-add4-02e357665a7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:19.233107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023c3cb-53aa-4880-add4-02e357665a7c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:19.234883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 58/114] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:19.235547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023c3cb-53aa-4880-add4-02e357665a7c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:19.256485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c3597-5e11-4ec7-9407-77e02e593e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:19.257720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c3597-5e11-4ec7-9407-77e02e593e57 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:19.258204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c3597-5e11-4ec7-9407-77e02e593e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:19.258893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c3597-5e11-4ec7-9407-77e02e593e57 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:19.260179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c3597-5e11-4ec7-9407-77e02e593e57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:19.260664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c3597-5e11-4ec7-9407-77e02e593e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:19.262817 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c3597-5e11-4ec7-9407-77e02e593e57 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:19.274763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 57/115] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:19.276141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c3597-5e11-4ec7-9407-77e02e593e57 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:19.310898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:19.356708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023c3cb-53aa-4880-add4-02e357665a7c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:19.395444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95c75a-33bd-4594-955f-da4143e5bc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:19.396393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95c75a-33bd-4594-955f-da4143e5bc70 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:19.396679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95c75a-33bd-4594-955f-da4143e5bc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:19.396995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95c75a-33bd-4594-955f-da4143e5bc70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:19.413479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95c75a-33bd-4594-955f-da4143e5bc70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:19.415396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c3597-5e11-4ec7-9407-77e02e593e57 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2e95c75a-33bd-4594-955f-da4143e5bc70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:19.420633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:19.421665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:19.422408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:19.422408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:19.422408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:19.422408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:19.422408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:19.422408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:19.422408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:19.422408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:19.422408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:19.422408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:19.422408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:19.422408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:19.430675 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 59/116] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:00:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:19.431314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95c75a-33bd-4594-955f-da4143e5bc70 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:19.447421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:19.457542 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a28f8-01a3-4710-bf44-54f9f6061a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:19.458200 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a28f8-01a3-4710-bf44-54f9f6061a41 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:19.458478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a28f8-01a3-4710-bf44-54f9f6061a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:19.458755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a28f8-01a3-4710-bf44-54f9f6061a41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:19.469656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a28f8-01a3-4710-bf44-54f9f6061a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e21a28f8-01a3-4710-bf44-54f9f6061a41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:19.475131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:19.475998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:19.476801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 58/117] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:00:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:19.478193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a28f8-01a3-4710-bf44-54f9f6061a41 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:19.547516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95c75a-33bd-4594-955f-da4143e5bc70 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:19.577925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:19.583141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a28f8-01a3-4710-bf44-54f9f6061a41 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:19.591403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d555a-4a62-4cb0-8544-82b0b9884d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:19.592301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d555a-4a62-4cb0-8544-82b0b9884d3d None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:19.593233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d555a-4a62-4cb0-8544-82b0b9884d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:19.593707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d555a-4a62-4cb0-8544-82b0b9884d3d None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:19.595082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d555a-4a62-4cb0-8544-82b0b9884d3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:19.597174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d555a-4a62-4cb0-8544-82b0b9884d3d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:19.618748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf98ed0-ed09-4ac2-b79b-80ce016e3b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:19.619487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf98ed0-ed09-4ac2-b79b-80ce016e3b43 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:19.619812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf98ed0-ed09-4ac2-b79b-80ce016e3b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:19.620092 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf98ed0-ed09-4ac2-b79b-80ce016e3b43 None admin] PATH_INFO: `/v3/users/787b85de0b5e4a3e9095d7d430cf7890` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:19.628235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 60/118] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:00:19 2022] POST /identity/v3/projects => generated 302 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:00:19.629221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d555a-4a62-4cb0-8544-82b0b9884d3d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:19.635417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf98ed0-ed09-4ac2-b79b-80ce016e3b43 None admin] RBAC: Authorizing `identity:get_user(user_id=787b85de0b5e4a3e9095d7d430cf7890)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:19.636974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf98ed0-ed09-4ac2-b79b-80ce016e3b43 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:19.638847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 59/119] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:19 2022] GET /identity/v3/users/787b85de0b5e4a3e9095d7d430cf7890 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:19.640148 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42e885-789d-47b6-a7cb-e872a75ce37d None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:19.640438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42e885-789d-47b6-a7cb-e872a75ce37d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:19.640718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42e885-789d-47b6-a7cb-e872a75ce37d None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:19.642519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 60/120] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:19.643497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42e885-789d-47b6-a7cb-e872a75ce37d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:19.710182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:19.781649 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42e885-789d-47b6-a7cb-e872a75ce37d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:19.806775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d555a-4a62-4cb0-8544-82b0b9884d3d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:19.828867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b98518-445a-4fc4-8681-5f014e6b8fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:19.829538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b98518-445a-4fc4-8681-5f014e6b8fef None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:19.829823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b98518-445a-4fc4-8681-5f014e6b8fef None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:19.830107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b98518-445a-4fc4-8681-5f014e6b8fef None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:19.830890 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b98518-445a-4fc4-8681-5f014e6b8fef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:19.831195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b98518-445a-4fc4-8681-5f014e6b8fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:19.832592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b98518-445a-4fc4-8681-5f014e6b8fef None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:19.845731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 61/121] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:00:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:19.847196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff25b3-20b8-42f7-91e3-273450cc6b71 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:19.847498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff25b3-20b8-42f7-91e3-273450cc6b71 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:19.847782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff25b3-20b8-42f7-91e3-273450cc6b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:19.854173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecd131-f6af-4cac-b99f-87f6d8dff148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:19.855269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd131-f6af-4cac-b99f-87f6d8dff148 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:19.855616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd131-f6af-4cac-b99f-87f6d8dff148 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:19.855966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd131-f6af-4cac-b99f-87f6d8dff148 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:19.856766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecd131-f6af-4cac-b99f-87f6d8dff148 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:19.857169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecd131-f6af-4cac-b99f-87f6d8dff148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:19.858644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecd131-f6af-4cac-b99f-87f6d8dff148 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:19.866916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f9ff25b3-20b8-42f7-91e3-273450cc6b71 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:19.868313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 61/122] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:19.868642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f9ff25b3-20b8-42f7-91e3-273450cc6b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:19.869394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecd131-f6af-4cac-b99f-87f6d8dff148 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:19.913448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:19.951899 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 62/123] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:19.952756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff25b3-20b8-42f7-91e3-273450cc6b71 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:19.990290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:19.995387 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecd131-f6af-4cac-b99f-87f6d8dff148 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:20.046084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd21fe-1efa-4770-a704-c5c744155737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:20.047145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd21fe-1efa-4770-a704-c5c744155737 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:20.047523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd21fe-1efa-4770-a704-c5c744155737 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:20.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd21fe-1efa-4770-a704-c5c744155737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:20.073528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff25b3-20b8-42f7-91e3-273450cc6b71 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:20.121129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bd1b2-68f0-493c-8723-424122a86ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:20.121909 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bd1b2-68f0-493c-8723-424122a86ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:20.122264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bd1b2-68f0-493c-8723-424122a86ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:20.123161 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bd1b2-68f0-493c-8723-424122a86ec9 None admin] PATH_INFO: `/v3/users/11359104efc34da0960a532caed4dfd7` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:20.123940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd21fe-1efa-4770-a704-c5c744155737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:20.124498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bd1b2-68f0-493c-8723-424122a86ec9 None admin] RBAC: Authorizing `identity:get_user(user_id=11359104efc34da0960a532caed4dfd7)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:20.125975 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bd1b2-68f0-493c-8723-424122a86ec9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:20.126190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd21fe-1efa-4770-a704-c5c744155737 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:20.127988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 63/124] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:19 2022] GET /identity/v3/users/11359104efc34da0960a532caed4dfd7 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:20.129056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bd1b2-68f0-493c-8723-424122a86ec9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:20.174743 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:20.265077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 62/125] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:20.266328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd21fe-1efa-4770-a704-c5c744155737 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:20.274229 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bd1b2-68f0-493c-8723-424122a86ec9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:20.277632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:20.332687 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1fa5c-24f2-4a60-977d-1ce5aa9fbb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:20.333731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1fa5c-24f2-4a60-977d-1ce5aa9fbb52 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:20.334209 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1fa5c-24f2-4a60-977d-1ce5aa9fbb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:20.335230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1fa5c-24f2-4a60-977d-1ce5aa9fbb52 None admin] PATH_INFO: `/v3/users/1acd68042e0349f6afed23e5889b5da6` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:20.337047 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1fa5c-24f2-4a60-977d-1ce5aa9fbb52 None admin] RBAC: Authorizing `identity:get_user(user_id=1acd68042e0349f6afed23e5889b5da6)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:20.339832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1fa5c-24f2-4a60-977d-1ce5aa9fbb52 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:20.347374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 64/126] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:20 2022] GET /identity/v3/users/1acd68042e0349f6afed23e5889b5da6 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:20.347374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1fa5c-24f2-4a60-977d-1ce5aa9fbb52 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:20.391284 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd21fe-1efa-4770-a704-c5c744155737 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:20.430257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f04b0a-72e5-4e79-8d55-35ab68d222bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:20.431330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f04b0a-72e5-4e79-8d55-35ab68d222bf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:20.432061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f04b0a-72e5-4e79-8d55-35ab68d222bf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:20.432533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f04b0a-72e5-4e79-8d55-35ab68d222bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:20.435746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:20.447059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f04b0a-72e5-4e79-8d55-35ab68d222bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:20.451290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1fa5c-24f2-4a60-977d-1ce5aa9fbb52 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-79f04b0a-72e5-4e79-8d55-35ab68d222bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:20.453794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:20.454640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:20.455454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:20.455454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:20.455454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:20.455454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:20.455454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:20.455454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:20.455454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:20.455454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:20.455454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:20.455454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:20.455454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:20.455454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:20.457808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 63/127] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:20.458939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f04b0a-72e5-4e79-8d55-35ab68d222bf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:20.486529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f707856-7585-43d3-b207-647c738c7b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:20.487203 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f707856-7585-43d3-b207-647c738c7b38 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:20.487483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f707856-7585-43d3-b207-647c738c7b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:20.487759 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f707856-7585-43d3-b207-647c738c7b38 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:20.488974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f707856-7585-43d3-b207-647c738c7b38 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:20.490463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f707856-7585-43d3-b207-647c738c7b38 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:20.492331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 65/128] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:20 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:20.497969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f707856-7585-43d3-b207-647c738c7b38 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:20.541776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:20.580058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f04b0a-72e5-4e79-8d55-35ab68d222bf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:20.602026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f707856-7585-43d3-b207-647c738c7b38 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:20.619607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bee21-7696-4b18-9f9c-2518001e7511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:20.620723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bee21-7696-4b18-9f9c-2518001e7511 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:20.621305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bee21-7696-4b18-9f9c-2518001e7511 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:20.621776 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bee21-7696-4b18-9f9c-2518001e7511 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:20.623244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bee21-7696-4b18-9f9c-2518001e7511 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:20.625070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bee21-7696-4b18-9f9c-2518001e7511 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:20.627142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 64/129] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:20 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:20.628112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bee21-7696-4b18-9f9c-2518001e7511 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:20.642442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2951fa-c7d4-42b6-aa96-d0f9c534a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:20.643235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2951fa-c7d4-42b6-aa96-d0f9c534a2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:20.643512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2951fa-c7d4-42b6-aa96-d0f9c534a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:20.643793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2951fa-c7d4-42b6-aa96-d0f9c534a2a2 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:20.645002 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2951fa-c7d4-42b6-aa96-d0f9c534a2a2 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:20.646486 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2951fa-c7d4-42b6-aa96-d0f9c534a2a2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:20.648173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 66/130] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:20 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:20.653526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2951fa-c7d4-42b6-aa96-d0f9c534a2a2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:20.705511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:20.746921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bee21-7696-4b18-9f9c-2518001e7511 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:20.782717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60533d-9385-4b66-ad7b-39629d2cba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:20.783184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60533d-9385-4b66-ad7b-39629d2cba6e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:20.783543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60533d-9385-4b66-ad7b-39629d2cba6e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:20.783821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60533d-9385-4b66-ad7b-39629d2cba6e None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:20.784544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60533d-9385-4b66-ad7b-39629d2cba6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:20.784911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60533d-9385-4b66-ad7b-39629d2cba6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:20.786466 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60533d-9385-4b66-ad7b-39629d2cba6e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:20.793717 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2951fa-c7d4-42b6-aa96-d0f9c534a2a2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:20.796000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 65/131] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:20.796765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60533d-9385-4b66-ad7b-39629d2cba6e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:20.805507 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:20.835645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca522497-ef19-4d1d-9301-0cb1a15e3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:20.836757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca522497-ef19-4d1d-9301-0cb1a15e3f34 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:20.837261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca522497-ef19-4d1d-9301-0cb1a15e3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:20.837774 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca522497-ef19-4d1d-9301-0cb1a15e3f34 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379/users/11359104efc34da0960a532caed4dfd7/roles/04a9c139ed6d44d4bcd37b614aeb009e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:20.840419 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca522497-ef19-4d1d-9301-0cb1a15e3f34 None admin] RBAC: Authorizing `identity:create_grant(project_id=e917870b5e964ef4a1fecad71d41d379, user_id=11359104efc34da0960a532caed4dfd7, role_id=04a9c139ed6d44d4bcd37b614aeb009e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:20.842318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca522497-ef19-4d1d-9301-0cb1a15e3f34 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:20.860851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 67/132] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:00:20 2022] PUT /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379/users/11359104efc34da0960a532caed4dfd7/roles/04a9c139ed6d44d4bcd37b614aeb009e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:20.862226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca522497-ef19-4d1d-9301-0cb1a15e3f34 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:20.941574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60533d-9385-4b66-ad7b-39629d2cba6e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:20.983028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca522497-ef19-4d1d-9301-0cb1a15e3f34 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:20.989270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:21.018456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22df4e-18be-4083-9dee-e0d8eb350729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:21.019047 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22df4e-18be-4083-9dee-e0d8eb350729 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:21.019325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22df4e-18be-4083-9dee-e0d8eb350729 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:21.019599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22df4e-18be-4083-9dee-e0d8eb350729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:21.020406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22df4e-18be-4083-9dee-e0d8eb350729 None admin] RBAC: Adding query filter params (role.id=c179515102c542798ce49a1bf0e8b98a, scope.project.id=e917870b5e964ef4a1fecad71d41d379, user.id=787b85de0b5e4a3e9095d7d430cf7890) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:21.020710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22df4e-18be-4083-9dee-e0d8eb350729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:21.022192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22df4e-18be-4083-9dee-e0d8eb350729 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:21.027355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b43bde-e092-4351-909a-ed05879da2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:21.028409 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b43bde-e092-4351-909a-ed05879da2a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:21.028929 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b43bde-e092-4351-909a-ed05879da2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:21.029407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b43bde-e092-4351-909a-ed05879da2a2 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379/users/1acd68042e0349f6afed23e5889b5da6/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:21.031730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b43bde-e092-4351-909a-ed05879da2a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e917870b5e964ef4a1fecad71d41d379, user_id=1acd68042e0349f6afed23e5889b5da6, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:21.033625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b43bde-e092-4351-909a-ed05879da2a2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:21.035702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 66/133] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:20 2022] GET /identity/v3/role_assignments?user.id=787b85de0b5e4a3e9095d7d430cf7890&scope.project.id=e917870b5e964ef4a1fecad71d41d379&role.id=c179515102c542798ce49a1bf0e8b98a => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:21.036612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22df4e-18be-4083-9dee-e0d8eb350729 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:21.049933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 68/134] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:00:20 2022] PUT /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379/users/1acd68042e0349f6afed23e5889b5da6/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:21.113515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdac87-eb54-4723-a687-789457913c29 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:21.114131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdac87-eb54-4723-a687-789457913c29 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:21.114630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdac87-eb54-4723-a687-789457913c29 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:21.116322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 69/135] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:00:21.122838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731d884-07bb-4eaa-b599-83dfc4bab521 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:21.123908 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731d884-07bb-4eaa-b599-83dfc4bab521 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:21.124476 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731d884-07bb-4eaa-b599-83dfc4bab521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:21.147032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0731d884-07bb-4eaa-b599-83dfc4bab521 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:21.148617 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0731d884-07bb-4eaa-b599-83dfc4bab521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:21.178293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:21.196605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22df4e-18be-4083-9dee-e0d8eb350729 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:21.237653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 70/136] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:21.240972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93fe71-30e4-46d8-a1c5-6ca354dfacc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:21.240972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93fe71-30e4-46d8-a1c5-6ca354dfacc9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:21.240972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93fe71-30e4-46d8-a1c5-6ca354dfacc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:21.240972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93fe71-30e4-46d8-a1c5-6ca354dfacc9 None admin] PATH_INFO: `/v3/users/11359104efc34da0960a532caed4dfd7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:21.242120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93fe71-30e4-46d8-a1c5-6ca354dfacc9 None admin] RBAC: Authorizing `identity:get_user(user_id=11359104efc34da0960a532caed4dfd7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:21.243762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93fe71-30e4-46d8-a1c5-6ca354dfacc9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:21.246145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 67/137] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:21 2022] GET /identity/v3/users/11359104efc34da0960a532caed4dfd7 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:21.251936 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731d884-07bb-4eaa-b599-83dfc4bab521 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:21.285317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93fe71-30e4-46d8-a1c5-6ca354dfacc9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:21.381973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731d884-07bb-4eaa-b599-83dfc4bab521 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:21.385644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:21.430503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ae4c4-670f-4ffa-85c1-2ebe8be41040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:21.431182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ae4c4-670f-4ffa-85c1-2ebe8be41040 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:21.431466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ae4c4-670f-4ffa-85c1-2ebe8be41040 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:21.431743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ae4c4-670f-4ffa-85c1-2ebe8be41040 None admin] PATH_INFO: `/v3/projects/368cdbc1aa9248558ded3c3f0a94c2e2` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:21.433950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ae4c4-670f-4ffa-85c1-2ebe8be41040 None admin] RBAC: Authorizing `identity:get_project(project_id=368cdbc1aa9248558ded3c3f0a94c2e2)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:21.435421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ae4c4-670f-4ffa-85c1-2ebe8be41040 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:21.437162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 71/138] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:21 2022] GET /identity/v3/projects/368cdbc1aa9248558ded3c3f0a94c2e2 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:21.443631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ae4c4-670f-4ffa-85c1-2ebe8be41040 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:21.457553 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93fe71-30e4-46d8-a1c5-6ca354dfacc9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:21.493405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:21.533125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cd4e0-88dd-47ae-b62e-beff49bd035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:21.534065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cd4e0-88dd-47ae-b62e-beff49bd035a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:21.534351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cd4e0-88dd-47ae-b62e-beff49bd035a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:21.534791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cd4e0-88dd-47ae-b62e-beff49bd035a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:21.561887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cd4e0-88dd-47ae-b62e-beff49bd035a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a89cd4e0-88dd-47ae-b62e-beff49bd035a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:21.567533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:21.568404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:21.569195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 68/139] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:21.581903 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cd4e0-88dd-47ae-b62e-beff49bd035a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:21.583113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ae4c4-670f-4ffa-85c1-2ebe8be41040 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:21.641865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4439e-c490-432c-b66f-71996fe2b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:21.642593 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4439e-c490-432c-b66f-71996fe2b2ec None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:21.642951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4439e-c490-432c-b66f-71996fe2b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:21.643233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4439e-c490-432c-b66f-71996fe2b2ec None admin] PATH_INFO: `/v3/projects/368cdbc1aa9248558ded3c3f0a94c2e2/users/11359104efc34da0960a532caed4dfd7/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:21.647003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4439e-c490-432c-b66f-71996fe2b2ec None admin] RBAC: Authorizing `identity:create_grant(project_id=368cdbc1aa9248558ded3c3f0a94c2e2, user_id=11359104efc34da0960a532caed4dfd7, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:21.648542 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4439e-c490-432c-b66f-71996fe2b2ec None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:21.670661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 72/140] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:00:21 2022] PUT /identity/v3/projects/368cdbc1aa9248558ded3c3f0a94c2e2/users/11359104efc34da0960a532caed4dfd7/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:21.762658 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cd4e0-88dd-47ae-b62e-beff49bd035a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:21.784074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:21.806488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4114b-0764-4bec-bb9a-e14b9a325403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:21.807082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4114b-0764-4bec-bb9a-e14b9a325403 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:21.807357 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4114b-0764-4bec-bb9a-e14b9a325403 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:21.807629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4114b-0764-4bec-bb9a-e14b9a325403 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:21.808356 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4114b-0764-4bec-bb9a-e14b9a325403 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:21.808659 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4114b-0764-4bec-bb9a-e14b9a325403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:21.814310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4114b-0764-4bec-bb9a-e14b9a325403 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:21.831547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 69/141] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:21.836991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4439e-c490-432c-b66f-71996fe2b2ec None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:21.972646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:21.989441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4439e-c490-432c-b66f-71996fe2b2ec None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:22.030100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7718-9baa-47cd-821c-dc35884aaab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:22.030764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7718-9baa-47cd-821c-dc35884aaab1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:22.031045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7718-9baa-47cd-821c-dc35884aaab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:22.031324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7718-9baa-47cd-821c-dc35884aaab1 None admin] PATH_INFO: `/v3/users/11359104efc34da0960a532caed4dfd7` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:22.032513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff7718-9baa-47cd-821c-dc35884aaab1 None admin] RBAC: Authorizing `identity:get_user(user_id=11359104efc34da0960a532caed4dfd7)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:22.034074 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff7718-9baa-47cd-821c-dc35884aaab1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:22.036217 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 73/142] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:21 2022] GET /identity/v3/users/11359104efc34da0960a532caed4dfd7 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:22.041844 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4114b-0764-4bec-bb9a-e14b9a325403 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:22.186310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4114b-0764-4bec-bb9a-e14b9a325403 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:22.234656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d08ce-9f1c-4bf0-a03a-1a158b7017f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:22.235208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d08ce-9f1c-4bf0-a03a-1a158b7017f7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:22.235486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d08ce-9f1c-4bf0-a03a-1a158b7017f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:22.235762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d08ce-9f1c-4bf0-a03a-1a158b7017f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:22.307929 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:22.340377 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d08ce-9f1c-4bf0-a03a-1a158b7017f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:22.341890 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d08ce-9f1c-4bf0-a03a-1a158b7017f7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:22.406850 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119512a5-4258-40e0-b2ce-ffadf531a85a None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:22.407138 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119512a5-4258-40e0-b2ce-ffadf531a85a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:22.407543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119512a5-4258-40e0-b2ce-ffadf531a85a None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:22.412934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 74/143] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:22.421394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99722-e4f6-4168-90e4-adb9e3c451eb None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:22.421682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99722-e4f6-4168-90e4-adb9e3c451eb None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:22.421961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc99722-e4f6-4168-90e4-adb9e3c451eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:22.462015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5fc99722-e4f6-4168-90e4-adb9e3c451eb None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:22.463261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5fc99722-e4f6-4168-90e4-adb9e3c451eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:22.492726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 70/144] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:22.498477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d08ce-9f1c-4bf0-a03a-1a158b7017f7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:22.618500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 75/145] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:22.659359 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:22.662209 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99722-e4f6-4168-90e4-adb9e3c451eb None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:22.696711 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d08ce-9f1c-4bf0-a03a-1a158b7017f7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:22.782325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94c6b3-22da-40e9-ae24-49724c0eff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:22.782651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94c6b3-22da-40e9-ae24-49724c0eff3c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:22.782894 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94c6b3-22da-40e9-ae24-49724c0eff3c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:22.783167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94c6b3-22da-40e9-ae24-49724c0eff3c None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:22.784497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94c6b3-22da-40e9-ae24-49724c0eff3c None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:22.785982 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94c6b3-22da-40e9-ae24-49724c0eff3c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:22.791520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 71/146] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:22 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:22.793806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94c6b3-22da-40e9-ae24-49724c0eff3c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:22.798271 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:22.821643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc99722-e4f6-4168-90e4-adb9e3c451eb None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:22.883322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17601994-8d3a-4350-a1b6-a05a66011a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:22.884798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17601994-8d3a-4350-a1b6-a05a66011a96 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:22.885328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17601994-8d3a-4350-a1b6-a05a66011a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:22.885805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17601994-8d3a-4350-a1b6-a05a66011a96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:22.887721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17601994-8d3a-4350-a1b6-a05a66011a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:22.889451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17601994-8d3a-4350-a1b6-a05a66011a96 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:22.891281 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 76/147] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:22.896889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17601994-8d3a-4350-a1b6-a05a66011a96 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:22.942689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94c6b3-22da-40e9-ae24-49724c0eff3c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:22.979000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d4496-cc8d-4fbe-be1c-06b6ba569335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:22.979655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d4496-cc8d-4fbe-be1c-06b6ba569335 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:22.979929 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d4496-cc8d-4fbe-be1c-06b6ba569335 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:22.980205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d4496-cc8d-4fbe-be1c-06b6ba569335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:22.981054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d4496-cc8d-4fbe-be1c-06b6ba569335 None admin] RBAC: Adding query filter params (role.id=2d65d41d83b24e36b4a751ac3f7fb178, scope.project.id=e917870b5e964ef4a1fecad71d41d379, user.id=11359104efc34da0960a532caed4dfd7) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:22.981369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d4496-cc8d-4fbe-be1c-06b6ba569335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:22.982828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d4496-cc8d-4fbe-be1c-06b6ba569335 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:22.989433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 72/148] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:22 2022] GET /identity/v3/role_assignments?user.id=11359104efc34da0960a532caed4dfd7&scope.project.id=e917870b5e964ef4a1fecad71d41d379&role.id=2d65d41d83b24e36b4a751ac3f7fb178 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:23.100210 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17601994-8d3a-4350-a1b6-a05a66011a96 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:23.149942 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bba86-e5ff-41db-96ab-a826aaea103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:23.150597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bba86-e5ff-41db-96ab-a826aaea103c None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:23.150874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bba86-e5ff-41db-96ab-a826aaea103c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:23.151146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bba86-e5ff-41db-96ab-a826aaea103c None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:23.151850 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bba86-e5ff-41db-96ab-a826aaea103c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:23.153349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bba86-e5ff-41db-96ab-a826aaea103c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:23.177535 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 77/149] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:00:22 2022] POST /identity/v3/users => generated 283 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:00:23.695505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb33c7-f207-4bde-ba84-4aa00fc25d2f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:23.696044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb33c7-f207-4bde-ba84-4aa00fc25d2f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:23.696044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb33c7-f207-4bde-ba84-4aa00fc25d2f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:23.697807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 73/150] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:23.704352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ed3e4-0e49-4519-8357-c3ce11cd8091 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:23.704650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ed3e4-0e49-4519-8357-c3ce11cd8091 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:23.704973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ed3e4-0e49-4519-8357-c3ce11cd8091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:23.724447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ed8ed3e4-0e49-4519-8357-c3ce11cd8091 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:23.725701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ed8ed3e4-0e49-4519-8357-c3ce11cd8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:23.727845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:23.813709 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 78/151] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:23.815953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1195239-a0af-439f-926b-c88952e2cdf8 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:23.816242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1195239-a0af-439f-926b-c88952e2cdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:23.816522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1195239-a0af-439f-926b-c88952e2cdf8 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:23.818097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 74/152] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:23.823674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf95335-622d-4e8b-adef-2d5601c80c93 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:23.823958 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf95335-622d-4e8b-adef-2d5601c80c93 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:23.824236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf95335-622d-4e8b-adef-2d5601c80c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:23.839370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1195239-a0af-439f-926b-c88952e2cdf8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:23.845553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-fcf95335-622d-4e8b-adef-2d5601c80c93 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:23.847148 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fcf95335-622d-4e8b-adef-2d5601c80c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:23.858035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:23.929856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 79/153] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:23.963456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf95335-622d-4e8b-adef-2d5601c80c93 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:23.975681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1195239-a0af-439f-926b-c88952e2cdf8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:24.027391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a3afd-7bf6-4749-9032-5d7537f2f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:24.028167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a3afd-7bf6-4749-9032-5d7537f2f353 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.028370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a3afd-7bf6-4749-9032-5d7537f2f353 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.028608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a3afd-7bf6-4749-9032-5d7537f2f353 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.043554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a3afd-7bf6-4749-9032-5d7537f2f353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ae8a3afd-7bf6-4749-9032-5d7537f2f353 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:24.051208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:24.052157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:24.052988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 75/154] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:00:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:00:24.059571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a3afd-7bf6-4749-9032-5d7537f2f353 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:24.075649 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:24.110627 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf95335-622d-4e8b-adef-2d5601c80c93 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:24.139051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:24.154675 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971138d1-7b20-4b1f-9084-797645017ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:24.155741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971138d1-7b20-4b1f-9084-797645017ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.156222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971138d1-7b20-4b1f-9084-797645017ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.156751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971138d1-7b20-4b1f-9084-797645017ce4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.169650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971138d1-7b20-4b1f-9084-797645017ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:24.173145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a3afd-7bf6-4749-9032-5d7537f2f353 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-971138d1-7b20-4b1f-9084-797645017ce4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:24.177855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:24.178736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:24.179699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 80/155] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:00:24.186376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971138d1-7b20-4b1f-9084-797645017ce4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:24.210065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8783cc-0351-4519-bbd2-c77a249705a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:24.210761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8783cc-0351-4519-bbd2-c77a249705a4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.210987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8783cc-0351-4519-bbd2-c77a249705a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.211260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8783cc-0351-4519-bbd2-c77a249705a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.211988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8783cc-0351-4519-bbd2-c77a249705a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:24.212295 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8783cc-0351-4519-bbd2-c77a249705a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:24.214698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8783cc-0351-4519-bbd2-c77a249705a4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:24.224526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 76/156] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:00:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:24.230096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8783cc-0351-4519-bbd2-c77a249705a4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:24.355715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971138d1-7b20-4b1f-9084-797645017ce4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:24.369990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8783cc-0351-4519-bbd2-c77a249705a4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:24.392426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:24.404554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2005865-e074-4bb0-82d8-310a4f32773e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:24.405282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005865-e074-4bb0-82d8-310a4f32773e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.406013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005865-e074-4bb0-82d8-310a4f32773e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.406303 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005865-e074-4bb0-82d8-310a4f32773e None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.410093 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2005865-e074-4bb0-82d8-310a4f32773e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:24.410093 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2005865-e074-4bb0-82d8-310a4f32773e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:24.410093 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2005865-e074-4bb0-82d8-310a4f32773e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:24.420220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 81/157] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:24.426346 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a88e1-97bb-43fb-88f7-3fc0faac86f2 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.426636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a88e1-97bb-43fb-88f7-3fc0faac86f2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.426882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b5679-06b0-4549-a304-083f6d5656b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:24.426998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a88e1-97bb-43fb-88f7-3fc0faac86f2 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.427841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b5679-06b0-4549-a304-083f6d5656b1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.428441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 82/158] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:24.428790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b5679-06b0-4549-a304-083f6d5656b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.429295 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b5679-06b0-4549-a304-083f6d5656b1 None admin] PATH_INFO: `/v3/users/11359104efc34da0960a532caed4dfd7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.429395 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a88e1-97bb-43fb-88f7-3fc0faac86f2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:24.430927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b5679-06b0-4549-a304-083f6d5656b1 None admin] RBAC: Authorizing `identity:get_user(user_id=11359104efc34da0960a532caed4dfd7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:24.432601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b5679-06b0-4549-a304-083f6d5656b1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:24.434739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 77/159] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:24 2022] GET /identity/v3/users/11359104efc34da0960a532caed4dfd7 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:24.440586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab231738-2d0f-4f42-a776-bce32cf3b487 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.441238 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab231738-2d0f-4f42-a776-bce32cf3b487 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.441715 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab231738-2d0f-4f42-a776-bce32cf3b487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.452411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:24.469282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ab231738-2d0f-4f42-a776-bce32cf3b487 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:24.471054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ab231738-2d0f-4f42-a776-bce32cf3b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:24.573381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 78/160] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:24.574174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab231738-2d0f-4f42-a776-bce32cf3b487 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:24.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a88e1-97bb-43fb-88f7-3fc0faac86f2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:24.619289 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc8bfb-c0fb-47f5-84f6-24ba29fa24ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:24.620310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc8bfb-c0fb-47f5-84f6-24ba29fa24ca None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.620805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc8bfb-c0fb-47f5-84f6-24ba29fa24ca None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.621317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc8bfb-c0fb-47f5-84f6-24ba29fa24ca None admin] PATH_INFO: `/v3/users/787b85de0b5e4a3e9095d7d430cf7890` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.622764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc8bfb-c0fb-47f5-84f6-24ba29fa24ca None admin] RBAC: Authorizing `identity:get_user(user_id=787b85de0b5e4a3e9095d7d430cf7890)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:24.624448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc8bfb-c0fb-47f5-84f6-24ba29fa24ca None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:24.626402 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 83/161] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:24 2022] GET /identity/v3/users/787b85de0b5e4a3e9095d7d430cf7890 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:24.627464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc8bfb-c0fb-47f5-84f6-24ba29fa24ca None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:24.689787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:24.697704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab231738-2d0f-4f42-a776-bce32cf3b487 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:24.733318 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:24.737985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc8bfb-c0fb-47f5-84f6-24ba29fa24ca None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:24.740570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b8eeb-3dec-4157-a3c2-8c25380d6ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:24.741623 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b8eeb-3dec-4157-a3c2-8c25380d6ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.742135 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b8eeb-3dec-4157-a3c2-8c25380d6ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.742650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b8eeb-3dec-4157-a3c2-8c25380d6ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.777628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9a4fc-0d6f-4371-9696-b7466d04bca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:24.778283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9a4fc-0d6f-4371-9696-b7466d04bca1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.778563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9a4fc-0d6f-4371-9696-b7466d04bca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.778836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9a4fc-0d6f-4371-9696-b7466d04bca1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.791550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9a4fc-0d6f-4371-9696-b7466d04bca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-33a9a4fc-0d6f-4371-9696-b7466d04bca1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:24.797086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:24.797960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 84/162] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:00:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:24.799241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9a4fc-0d6f-4371-9696-b7466d04bca1 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:24.822250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b8eeb-3dec-4157-a3c2-8c25380d6ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:24.824162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b8eeb-3dec-4157-a3c2-8c25380d6ea5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:24.905180 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9a4fc-0d6f-4371-9696-b7466d04bca1 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:24.926276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:24.945544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 79/163] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:24.946838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e60003-4034-41dc-9621-070ed6d635f9 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.947123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e60003-4034-41dc-9621-070ed6d635f9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.947395 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e60003-4034-41dc-9621-070ed6d635f9 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.948655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 80/164] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:24.951321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c0d17-e527-4449-a54d-f0212a35b9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:24.952748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c0d17-e527-4449-a54d-f0212a35b9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.953320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c0d17-e527-4449-a54d-f0212a35b9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.953801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c0d17-e527-4449-a54d-f0212a35b9d9 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.953926 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e60003-4034-41dc-9621-070ed6d635f9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:24.955672 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c0d17-e527-4449-a54d-f0212a35b9d9 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:24.958846 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c0d17-e527-4449-a54d-f0212a35b9d9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:24.960858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 85/165] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:24 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:24.962375 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b117-0e55-45e0-8ffd-e39634a469fd None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:24.962912 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b117-0e55-45e0-8ffd-e39634a469fd None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:24.965156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b117-0e55-45e0-8ffd-e39634a469fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:24.992330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0eb2b117-0e55-45e0-8ffd-e39634a469fd None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:24.994242 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0eb2b117-0e55-45e0-8ffd-e39634a469fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:25.013715 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:25.079317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 86/166] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:25.080714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2b117-0e55-45e0-8ffd-e39634a469fd None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:25.174983 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e60003-4034-41dc-9621-070ed6d635f9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:25.200425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2b117-0e55-45e0-8ffd-e39634a469fd None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:25.221429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:25.240986 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85acb-64b3-4904-b63d-ee63c03a2dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:25.242150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85acb-64b3-4904-b63d-ee63c03a2dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:25.242699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85acb-64b3-4904-b63d-ee63c03a2dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:25.243183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85acb-64b3-4904-b63d-ee63c03a2dc2 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:25.244544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb85acb-64b3-4904-b63d-ee63c03a2dc2 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:25.246482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb85acb-64b3-4904-b63d-ee63c03a2dc2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:25.248366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 87/167] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:25 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:25.249279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc376-7260-4f61-a850-55637933b550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:25.249819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85acb-64b3-4904-b63d-ee63c03a2dc2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:25.250009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc376-7260-4f61-a850-55637933b550 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:25.250242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc376-7260-4f61-a850-55637933b550 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:25.250513 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc376-7260-4f61-a850-55637933b550 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:25.251260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cc376-7260-4f61-a850-55637933b550 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:25.251544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cc376-7260-4f61-a850-55637933b550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:25.253057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cc376-7260-4f61-a850-55637933b550 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:25.279210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 81/168] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:25.280163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc376-7260-4f61-a850-55637933b550 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:25.384043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85acb-64b3-4904-b63d-ee63c03a2dc2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:25.422679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5a395-64d6-40c6-bfc2-66e56957a88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:25.423763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a395-64d6-40c6-bfc2-66e56957a88c None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:25.424324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a395-64d6-40c6-bfc2-66e56957a88c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:25.424794 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a395-64d6-40c6-bfc2-66e56957a88c None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379/users/787b85de0b5e4a3e9095d7d430cf7890/roles/c179515102c542798ce49a1bf0e8b98a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:25.427448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5a395-64d6-40c6-bfc2-66e56957a88c None admin] RBAC: Authorizing `identity:create_grant(project_id=e917870b5e964ef4a1fecad71d41d379, user_id=787b85de0b5e4a3e9095d7d430cf7890, role_id=c179515102c542798ce49a1bf0e8b98a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:25.429290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5a395-64d6-40c6-bfc2-66e56957a88c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:25.448572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 88/169] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:00:25 2022] PUT /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379/users/787b85de0b5e4a3e9095d7d430cf7890/roles/c179515102c542798ce49a1bf0e8b98a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:25.454422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5a395-64d6-40c6-bfc2-66e56957a88c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:25.585993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:25.587164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:25.600070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc376-7260-4f61-a850-55637933b550 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:25.700198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5a395-64d6-40c6-bfc2-66e56957a88c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:25.710215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494689d-990a-41cf-8898-7b3b89614313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:25.710887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494689d-990a-41cf-8898-7b3b89614313 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:25.711167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494689d-990a-41cf-8898-7b3b89614313 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:25.711433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494689d-990a-41cf-8898-7b3b89614313 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:25.741376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665642-4c85-45aa-9d28-a4052ff18602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:25.742379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665642-4c85-45aa-9d28-a4052ff18602 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:25.742857 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665642-4c85-45aa-9d28-a4052ff18602 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:25.743327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665642-4c85-45aa-9d28-a4052ff18602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:25.744344 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54665642-4c85-45aa-9d28-a4052ff18602 None admin] RBAC: Adding query filter params (role.id=04a9c139ed6d44d4bcd37b614aeb009e, scope.project.id=e917870b5e964ef4a1fecad71d41d379, user.id=11359104efc34da0960a532caed4dfd7) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:25.744853 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54665642-4c85-45aa-9d28-a4052ff18602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:25.745577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494689d-990a-41cf-8898-7b3b89614313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:25.746790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54665642-4c85-45aa-9d28-a4052ff18602 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2494689d-990a-41cf-8898-7b3b89614313 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:25.751116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:25.752082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:25.753367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 82/170] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:25.754097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494689d-990a-41cf-8898-7b3b89614313 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:25.757274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 89/171] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:25 2022] GET /identity/v3/role_assignments?user.id=11359104efc34da0960a532caed4dfd7&scope.project.id=e917870b5e964ef4a1fecad71d41d379&role.id=04a9c139ed6d44d4bcd37b614aeb009e => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:25.763120 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665642-4c85-45aa-9d28-a4052ff18602 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:25.908438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665642-4c85-45aa-9d28-a4052ff18602 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:25.928153 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:25.959622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5ec3d-db4f-46c4-8919-228041a09a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:25.960287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5ec3d-db4f-46c4-8919-228041a09a37 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:25.960559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5ec3d-db4f-46c4-8919-228041a09a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:25.960797 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5ec3d-db4f-46c4-8919-228041a09a37 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:25.961584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5ec3d-db4f-46c4-8919-228041a09a37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:25.961885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5ec3d-db4f-46c4-8919-228041a09a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:25.963515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5ec3d-db4f-46c4-8919-228041a09a37 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:25.973729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 90/172] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:25.980494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5ec3d-db4f-46c4-8919-228041a09a37 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:26.019040 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494689d-990a-41cf-8898-7b3b89614313 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:26.082989 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa62b63-e6ea-4c51-97e1-86d2ef16b577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:26.084009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa62b63-e6ea-4c51-97e1-86d2ef16b577 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:26.084488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa62b63-e6ea-4c51-97e1-86d2ef16b577 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:26.085031 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa62b63-e6ea-4c51-97e1-86d2ef16b577 None admin] PATH_INFO: `/v3/users/1acd68042e0349f6afed23e5889b5da6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:26.086852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa62b63-e6ea-4c51-97e1-86d2ef16b577 None admin] RBAC: Authorizing `identity:get_user(user_id=1acd68042e0349f6afed23e5889b5da6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:26.088698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa62b63-e6ea-4c51-97e1-86d2ef16b577 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:26.090703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 83/173] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:25 2022] GET /identity/v3/users/1acd68042e0349f6afed23e5889b5da6 => generated 247 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:26.096861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa62b63-e6ea-4c51-97e1-86d2ef16b577 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:26.155136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:26.211296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5ec3d-db4f-46c4-8919-228041a09a37 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:26.272270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa62b63-e6ea-4c51-97e1-86d2ef16b577 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:26.286250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a8c7e-48dc-4610-8cb0-faf1bb52eadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:26.286949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8c7e-48dc-4610-8cb0-faf1bb52eadb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:26.287235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8c7e-48dc-4610-8cb0-faf1bb52eadb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:26.287514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8c7e-48dc-4610-8cb0-faf1bb52eadb None admin] PATH_INFO: `/v3/users/11359104efc34da0960a532caed4dfd7` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:26.289133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a8c7e-48dc-4610-8cb0-faf1bb52eadb None admin] RBAC: Authorizing `identity:get_user(user_id=11359104efc34da0960a532caed4dfd7)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:26.290752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a8c7e-48dc-4610-8cb0-faf1bb52eadb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:26.292865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 91/174] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:25 2022] GET /identity/v3/users/11359104efc34da0960a532caed4dfd7 => generated 275 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:26.301912 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a8c7e-48dc-4610-8cb0-faf1bb52eadb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:26.326636 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c5655-f6a2-4d50-adc4-413da95efe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:26.327679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c5655-f6a2-4d50-adc4-413da95efe3d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:26.328212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c5655-f6a2-4d50-adc4-413da95efe3d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:26.328697 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c5655-f6a2-4d50-adc4-413da95efe3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:26.381328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:26.431781 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c5655-f6a2-4d50-adc4-413da95efe3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:26.433702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c5655-f6a2-4d50-adc4-413da95efe3d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:26.469364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:26.480004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a8c7e-48dc-4610-8cb0-faf1bb52eadb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:26.565113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3e3d8-f88f-45d7-a085-0af4c4120cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:26.565764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3e3d8-f88f-45d7-a085-0af4c4120cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:26.566043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3e3d8-f88f-45d7-a085-0af4c4120cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:26.566319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3e3d8-f88f-45d7-a085-0af4c4120cc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:26.651554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 84/175] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:26.652924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f63b0-88ce-4342-b783-d04a9596b978 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:26.656826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f63b0-88ce-4342-b783-d04a9596b978 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:26.657009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f63b0-88ce-4342-b783-d04a9596b978 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:26.658520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 85/176] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:26.662148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f63b0-88ce-4342-b783-d04a9596b978 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:26.695767 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3e3d8-f88f-45d7-a085-0af4c4120cc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:26.697609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3e3d8-f88f-45d7-a085-0af4c4120cc5 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:26.785284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:26.842769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f63b0-88ce-4342-b783-d04a9596b978 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:26.874052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 92/177] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:26.875667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325bf38-64d9-42b4-a24c-2c24318c0fa5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:26.875958 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325bf38-64d9-42b4-a24c-2c24318c0fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:26.876233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325bf38-64d9-42b4-a24c-2c24318c0fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:26.893319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:26.897530 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f325bf38-64d9-42b4-a24c-2c24318c0fa5 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:26.899462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f325bf38-64d9-42b4-a24c-2c24318c0fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:26.920518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b00a50-5354-48a3-a433-c552ba8e6195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:26.921427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b00a50-5354-48a3-a433-c552ba8e6195 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:26.921773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b00a50-5354-48a3-a433-c552ba8e6195 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:26.922110 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b00a50-5354-48a3-a433-c552ba8e6195 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:26.929828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b00a50-5354-48a3-a433-c552ba8e6195 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:26.931526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b00a50-5354-48a3-a433-c552ba8e6195 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:26.933838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 86/178] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:26 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:26.934709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b00a50-5354-48a3-a433-c552ba8e6195 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:26.976607 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 93/179] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:26.977648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325bf38-64d9-42b4-a24c-2c24318c0fa5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:27.052401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:27.090976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325bf38-64d9-42b4-a24c-2c24318c0fa5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:27.131504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a11d33-ab23-4c4b-83a3-fce35872e88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:27.132493 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a11d33-ab23-4c4b-83a3-fce35872e88e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:27.132779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a11d33-ab23-4c4b-83a3-fce35872e88e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:27.133082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a11d33-ab23-4c4b-83a3-fce35872e88e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:27.133886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a11d33-ab23-4c4b-83a3-fce35872e88e None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=e917870b5e964ef4a1fecad71d41d379, user.id=1acd68042e0349f6afed23e5889b5da6) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:27.134197 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a11d33-ab23-4c4b-83a3-fce35872e88e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:27.135731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a11d33-ab23-4c4b-83a3-fce35872e88e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:27.143040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 94/180] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:26 2022] GET /identity/v3/role_assignments?user.id=1acd68042e0349f6afed23e5889b5da6&scope.project.id=e917870b5e964ef4a1fecad71d41d379&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:27.144172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a11d33-ab23-4c4b-83a3-fce35872e88e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:27.197877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b00a50-5354-48a3-a433-c552ba8e6195 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:27.293471 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a11d33-ab23-4c4b-83a3-fce35872e88e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:27.332442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:27.335685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67166c6c-8873-478c-a6cd-09704707b6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:27.336195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67166c6c-8873-478c-a6cd-09704707b6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:27.336472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67166c6c-8873-478c-a6cd-09704707b6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:27.337389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67166c6c-8873-478c-a6cd-09704707b6a2 None admin] PATH_INFO: `/v3/projects/368cdbc1aa9248558ded3c3f0a94c2e2` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:27.338215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67166c6c-8873-478c-a6cd-09704707b6a2 None admin] RBAC: Authorizing `identity:get_project(project_id=368cdbc1aa9248558ded3c3f0a94c2e2)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:27.340732 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67166c6c-8873-478c-a6cd-09704707b6a2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:27.340887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defe2b1-198e-441b-b814-f25d412aaaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:27.341756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defe2b1-198e-441b-b814-f25d412aaaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:27.342276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defe2b1-198e-441b-b814-f25d412aaaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:27.342553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defe2b1-198e-441b-b814-f25d412aaaf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:27.343535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 87/181] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:26 2022] GET /identity/v3/projects/368cdbc1aa9248558ded3c3f0a94c2e2 => generated 312 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:27.345112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23030d92-5d46-4908-8b67-42e31696f6b4 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:27.345392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23030d92-5d46-4908-8b67-42e31696f6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:27.345806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23030d92-5d46-4908-8b67-42e31696f6b4 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:27.347544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 88/182] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:27.348589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454c02-452f-47b8-aa89-80229370d420 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:27.348858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454c02-452f-47b8-aa89-80229370d420 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:27.349207 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454c02-452f-47b8-aa89-80229370d420 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:27.350776 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 89/183] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:27.351508 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454c02-452f-47b8-aa89-80229370d420 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:27.364123 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defe2b1-198e-441b-b814-f25d412aaaf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-7defe2b1-198e-441b-b814-f25d412aaaf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:27.370994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:27.371965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:27.372747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 95/184] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:00:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:27.373930 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a5462-5cb1-4c13-8355-0cb0d6e4e7e5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:27.373930 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a5462-5cb1-4c13-8355-0cb0d6e4e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:27.374476 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a5462-5cb1-4c13-8355-0cb0d6e4e7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:27.395785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5f1a5462-5cb1-4c13-8355-0cb0d6e4e7e5 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:27.397124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5f1a5462-5cb1-4c13-8355-0cb0d6e4e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:27.428171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:27.484306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 96/185] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:27.485635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f5c5a-e65a-42f0-9ef4-3de83362ba8d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:27.486009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f5c5a-e65a-42f0-9ef4-3de83362ba8d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:27.486287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f5c5a-e65a-42f0-9ef4-3de83362ba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:27.489060 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454c02-452f-47b8-aa89-80229370d420 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:27.513386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-658f5c5a-e65a-42f0-9ef4-3de83362ba8d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:27.514831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-658f5c5a-e65a-42f0-9ef4-3de83362ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:27.531279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a6fd2-a3d8-48d8-8937-0c1606316a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:27.531915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a6fd2-a3d8-48d8-8937-0c1606316a9b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:27.532194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a6fd2-a3d8-48d8-8937-0c1606316a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:27.532467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a6fd2-a3d8-48d8-8937-0c1606316a9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:27.533363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a6fd2-a3d8-48d8-8937-0c1606316a9b None admin] RBAC: Adding query filter params (role.id=2d65d41d83b24e36b4a751ac3f7fb178, scope.project.id=368cdbc1aa9248558ded3c3f0a94c2e2, user.id=11359104efc34da0960a532caed4dfd7) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:27.533683 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a6fd2-a3d8-48d8-8937-0c1606316a9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:27.535127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a6fd2-a3d8-48d8-8937-0c1606316a9b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:27.547543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 90/186] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:27 2022] GET /identity/v3/role_assignments?user.id=11359104efc34da0960a532caed4dfd7&scope.project.id=368cdbc1aa9248558ded3c3f0a94c2e2&role.id=2d65d41d83b24e36b4a751ac3f7fb178 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:27.547543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a6fd2-a3d8-48d8-8937-0c1606316a9b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:27.608722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 97/187] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:27.609730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f5c5a-e65a-42f0-9ef4-3de83362ba8d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:27.691427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a6fd2-a3d8-48d8-8937-0c1606316a9b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:27.693209 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:27.721027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:27.732656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34379c-df8c-4ac9-9f3b-e35e1d791f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:27.733327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34379c-df8c-4ac9-9f3b-e35e1d791f43 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:27.734278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34379c-df8c-4ac9-9f3b-e35e1d791f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:27.734278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34379c-df8c-4ac9-9f3b-e35e1d791f43 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:27.734597 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34379c-df8c-4ac9-9f3b-e35e1d791f43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:27.734902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34379c-df8c-4ac9-9f3b-e35e1d791f43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:27.736314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34379c-df8c-4ac9-9f3b-e35e1d791f43 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:27.745499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 91/188] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:27.746331 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34379c-df8c-4ac9-9f3b-e35e1d791f43 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:27.766529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f5c5a-e65a-42f0-9ef4-3de83362ba8d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:27.830146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6782d-c921-4d7e-bfa7-2d7e934a5ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:27.830848 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6782d-c921-4d7e-bfa7-2d7e934a5ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:27.831134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6782d-c921-4d7e-bfa7-2d7e934a5ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:27.831409 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6782d-c921-4d7e-bfa7-2d7e934a5ae7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:27.832572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6782d-c921-4d7e-bfa7-2d7e934a5ae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:27.834245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6782d-c921-4d7e-bfa7-2d7e934a5ae7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:27.840596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 98/189] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:27.840596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6782d-c921-4d7e-bfa7-2d7e934a5ae7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:27.878240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34379c-df8c-4ac9-9f3b-e35e1d791f43 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:27.918442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4243ddf-80a7-49c2-bd6c-4c605364b6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:27.919096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4243ddf-80a7-49c2-bd6c-4c605364b6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:27.919379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4243ddf-80a7-49c2-bd6c-4c605364b6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:27.919642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4243ddf-80a7-49c2-bd6c-4c605364b6c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:27.932265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4243ddf-80a7-49c2-bd6c-4c605364b6c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b4243ddf-80a7-49c2-bd6c-4c605364b6c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:27.937684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:27.938584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:27.939366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 92/190] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:00:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:27.940087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4243ddf-80a7-49c2-bd6c-4c605364b6c2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:27.949878 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6782d-c921-4d7e-bfa7-2d7e934a5ae7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:27.973287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:27.989437 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf81bd-512f-41f9-a764-af8465625fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:27.990612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:27.990973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf81bd-512f-41f9-a764-af8465625fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:27.991263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf81bd-512f-41f9-a764-af8465625fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:27.991608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf81bd-512f-41f9-a764-af8465625fe1 None admin] PATH_INFO: `/v3/users/66e781813546438298e27d5b328540cb` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:28.006968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf81bd-512f-41f9-a764-af8465625fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=66e781813546438298e27d5b328540cb)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:28.008480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf81bd-512f-41f9-a764-af8465625fe1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:28.010427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 99/191] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:27 2022] GET /identity/v3/users/66e781813546438298e27d5b328540cb => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:28.011036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf81bd-512f-41f9-a764-af8465625fe1 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:28.053848 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4243ddf-80a7-49c2-bd6c-4c605364b6c2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:28.089599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b080c8-6ccf-4847-aa07-8bbdb39ea630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:28.090224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b080c8-6ccf-4847-aa07-8bbdb39ea630 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:28.090496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b080c8-6ccf-4847-aa07-8bbdb39ea630 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:28.090859 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b080c8-6ccf-4847-aa07-8bbdb39ea630 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:28.091574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b080c8-6ccf-4847-aa07-8bbdb39ea630 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:28.093162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b080c8-6ccf-4847-aa07-8bbdb39ea630 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:28.115627 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf81bd-512f-41f9-a764-af8465625fe1 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:28.116855 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 93/192] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:00:27 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:00:28.130522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b080c8-6ccf-4847-aa07-8bbdb39ea630 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:28.161611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80bf74-7d21-4e71-8db0-b78f27bced5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:28.162789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80bf74-7d21-4e71-8db0-b78f27bced5a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:28.163262 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80bf74-7d21-4e71-8db0-b78f27bced5a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:28.164109 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80bf74-7d21-4e71-8db0-b78f27bced5a None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:28.165191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80bf74-7d21-4e71-8db0-b78f27bced5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:28.165731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80bf74-7d21-4e71-8db0-b78f27bced5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:28.167506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80bf74-7d21-4e71-8db0-b78f27bced5a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:28.178326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 100/193] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:00:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:28.184170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80bf74-7d21-4e71-8db0-b78f27bced5a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:28.249812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:28.256410 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:28.265908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b080c8-6ccf-4847-aa07-8bbdb39ea630 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:28.309113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611fd23-4d20-43eb-8397-ae5d2f12fbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:28.309749 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611fd23-4d20-43eb-8397-ae5d2f12fbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:28.310035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611fd23-4d20-43eb-8397-ae5d2f12fbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:28.310301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611fd23-4d20-43eb-8397-ae5d2f12fbc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:28.328829 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80bf74-7d21-4e71-8db0-b78f27bced5a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:28.366798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58650a1c-1325-4f22-b6d2-492aef5e48b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:28.367549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58650a1c-1325-4f22-b6d2-492aef5e48b2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:28.367902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58650a1c-1325-4f22-b6d2-492aef5e48b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:28.368170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58650a1c-1325-4f22-b6d2-492aef5e48b2 None admin] PATH_INFO: `/v3/users/66e781813546438298e27d5b328540cb` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:28.369483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58650a1c-1325-4f22-b6d2-492aef5e48b2 None admin] RBAC: Authorizing `identity:get_user(user_id=66e781813546438298e27d5b328540cb)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:28.370953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58650a1c-1325-4f22-b6d2-492aef5e48b2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:28.377551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 101/194] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:28 2022] GET /identity/v3/users/66e781813546438298e27d5b328540cb => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:28.377551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957018f-8826-4e0b-8d04-ff2a17b49cc2 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:28.377551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957018f-8826-4e0b-8d04-ff2a17b49cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:28.377551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957018f-8826-4e0b-8d04-ff2a17b49cc2 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:28.377551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 102/195] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:28.383081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957018f-8826-4e0b-8d04-ff2a17b49cc2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:28.400293 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611fd23-4d20-43eb-8397-ae5d2f12fbc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:28.401820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611fd23-4d20-43eb-8397-ae5d2f12fbc3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:28.507185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957018f-8826-4e0b-8d04-ff2a17b49cc2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:28.517982 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:28.525953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:28.530874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 94/196] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:28.536303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956814e-3ac7-4aea-9fd2-9ef05f89f145 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:28.536303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956814e-3ac7-4aea-9fd2-9ef05f89f145 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:28.536303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956814e-3ac7-4aea-9fd2-9ef05f89f145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:28.552654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8956814e-3ac7-4aea-9fd2-9ef05f89f145 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:28.553889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f19d1-9f9f-454b-bdb9-f5b6a38a3252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:28.554024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8956814e-3ac7-4aea-9fd2-9ef05f89f145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:28.554829 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f19d1-9f9f-454b-bdb9-f5b6a38a3252 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:28.555250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f19d1-9f9f-454b-bdb9-f5b6a38a3252 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:28.555714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f19d1-9f9f-454b-bdb9-f5b6a38a3252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:28.639557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 95/197] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:28.645914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f19d1-9f9f-454b-bdb9-f5b6a38a3252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:28.646082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956814e-3ac7-4aea-9fd2-9ef05f89f145 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:28.647396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f19d1-9f9f-454b-bdb9-f5b6a38a3252 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:28.761043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 103/198] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:28.762141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f19d1-9f9f-454b-bdb9-f5b6a38a3252 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:28.774179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:28.783126 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956814e-3ac7-4aea-9fd2-9ef05f89f145 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:28.816326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:28.823523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c338f8c-69e8-4517-9387-0af599f4a160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:28.824215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c338f8c-69e8-4517-9387-0af599f4a160 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:28.824496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c338f8c-69e8-4517-9387-0af599f4a160 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:28.824770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c338f8c-69e8-4517-9387-0af599f4a160 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:28.826180 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c338f8c-69e8-4517-9387-0af599f4a160 None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:28.827649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c338f8c-69e8-4517-9387-0af599f4a160 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:28.834454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 96/199] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:28 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:28.835354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c338f8c-69e8-4517-9387-0af599f4a160 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:28.896410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f19d1-9f9f-454b-bdb9-f5b6a38a3252 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:28.944143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f04e58-f240-45ee-a23a-91f7496dd838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:28.945854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f04e58-f240-45ee-a23a-91f7496dd838 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:28.946430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f04e58-f240-45ee-a23a-91f7496dd838 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:28.946899 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f04e58-f240-45ee-a23a-91f7496dd838 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:28.947907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c338f8c-69e8-4517-9387-0af599f4a160 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:28.965602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f04e58-f240-45ee-a23a-91f7496dd838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-53f04e58-f240-45ee-a23a-91f7496dd838 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:28.972763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:28.973703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:28.974513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:28.974513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:28.974513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:28.974513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:28.974513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:28.974513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:28.974513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:28.974513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:28.974513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:28.974513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:28.974513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:28.974513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:28.977403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 104/200] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:28.979036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f04e58-f240-45ee-a23a-91f7496dd838 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:28.995485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5631-fc2b-4d57-9d59-f5fec408a571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:28.996209 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5631-fc2b-4d57-9d59-f5fec408a571 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:28.996494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5631-fc2b-4d57-9d59-f5fec408a571 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:28.996766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5631-fc2b-4d57-9d59-f5fec408a571 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:28.998052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f5631-fc2b-4d57-9d59-f5fec408a571 None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:28.999689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f5631-fc2b-4d57-9d59-f5fec408a571 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:29.001561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 97/201] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:28 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:29.002503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5631-fc2b-4d57-9d59-f5fec408a571 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:29.073745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:29.076150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:29.112796 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5631-fc2b-4d57-9d59-f5fec408a571 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:29.114865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f04e58-f240-45ee-a23a-91f7496dd838 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:29.152238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee5b7e-aedb-48b5-a7de-f257dfa90768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:29.152826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee5b7e-aedb-48b5-a7de-f257dfa90768 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:29.153141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee5b7e-aedb-48b5-a7de-f257dfa90768 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:29.153418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee5b7e-aedb-48b5-a7de-f257dfa90768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:29.154222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee5b7e-aedb-48b5-a7de-f257dfa90768 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=4931005296114563946c84a7e790464a, user.id=66e781813546438298e27d5b328540cb) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:29.154538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee5b7e-aedb-48b5-a7de-f257dfa90768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:29.156033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee5b7e-aedb-48b5-a7de-f257dfa90768 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:29.157624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb48df-e0e8-4d3b-8d18-3de32a9f9920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:29.159023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb48df-e0e8-4d3b-8d18-3de32a9f9920 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:29.159434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb48df-e0e8-4d3b-8d18-3de32a9f9920 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:29.160382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb48df-e0e8-4d3b-8d18-3de32a9f9920 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:29.161547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb48df-e0e8-4d3b-8d18-3de32a9f9920 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:29.161990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb48df-e0e8-4d3b-8d18-3de32a9f9920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:29.163310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 105/202] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:28 2022] GET /identity/v3/role_assignments?user.id=66e781813546438298e27d5b328540cb&scope.project.id=4931005296114563946c84a7e790464a&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:29.163695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb48df-e0e8-4d3b-8d18-3de32a9f9920 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:29.170347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee5b7e-aedb-48b5-a7de-f257dfa90768 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:29.174216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 98/203] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:29.183224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb48df-e0e8-4d3b-8d18-3de32a9f9920 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:29.313000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb48df-e0e8-4d3b-8d18-3de32a9f9920 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:29.354902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:29.369230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f94d54-9cdb-4dcc-9c1d-9fcdf5176559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:29.370495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f94d54-9cdb-4dcc-9c1d-9fcdf5176559 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:29.371211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f94d54-9cdb-4dcc-9c1d-9fcdf5176559 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:29.371693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f94d54-9cdb-4dcc-9c1d-9fcdf5176559 None admin] PATH_INFO: `/v3/users/787b85de0b5e4a3e9095d7d430cf7890` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:29.374099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f94d54-9cdb-4dcc-9c1d-9fcdf5176559 None admin] RBAC: Authorizing `identity:get_user(user_id=787b85de0b5e4a3e9095d7d430cf7890)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:29.375749 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f94d54-9cdb-4dcc-9c1d-9fcdf5176559 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:29.378381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 99/204] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:29 2022] GET /identity/v3/users/787b85de0b5e4a3e9095d7d430cf7890 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:29.385882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f94d54-9cdb-4dcc-9c1d-9fcdf5176559 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:29.434552 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee5b7e-aedb-48b5-a7de-f257dfa90768 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:29.493152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:29.505399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cca60e-8291-44b8-8324-e8d5b7988cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:29.506105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cca60e-8291-44b8-8324-e8d5b7988cbf None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:29.506389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cca60e-8291-44b8-8324-e8d5b7988cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:29.506663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cca60e-8291-44b8-8324-e8d5b7988cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:29.507531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cca60e-8291-44b8-8324-e8d5b7988cbf None admin] RBAC: Adding query filter params (role.id=04a9c139ed6d44d4bcd37b614aeb009e, scope.project.id=4931005296114563946c84a7e790464a, user.id=66e781813546438298e27d5b328540cb) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:29.507843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cca60e-8291-44b8-8324-e8d5b7988cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:29.510416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cca60e-8291-44b8-8324-e8d5b7988cbf None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:29.525548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 106/205] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:29 2022] GET /identity/v3/role_assignments?user.id=66e781813546438298e27d5b328540cb&scope.project.id=4931005296114563946c84a7e790464a&role.id=04a9c139ed6d44d4bcd37b614aeb009e => generated 259 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:29.589804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f94d54-9cdb-4dcc-9c1d-9fcdf5176559 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:29.646507 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84ab12-35f8-45ed-ab3d-54875c8f9a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:29.647160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84ab12-35f8-45ed-ab3d-54875c8f9a29 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:29.647444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84ab12-35f8-45ed-ab3d-54875c8f9a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:29.647719 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84ab12-35f8-45ed-ab3d-54875c8f9a29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:29.730821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:29.738791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84ab12-35f8-45ed-ab3d-54875c8f9a29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:29.740274 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84ab12-35f8-45ed-ab3d-54875c8f9a29 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:29.853289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 100/206] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:29.859047 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cca60e-8291-44b8-8324-e8d5b7988cbf None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:29.997802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cca60e-8291-44b8-8324-e8d5b7988cbf None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:30.036499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bfd8f-4acc-4c32-9430-95551123b0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:30.037249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bfd8f-4acc-4c32-9430-95551123b0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:30.037531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bfd8f-4acc-4c32-9430-95551123b0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:30.037804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bfd8f-4acc-4c32-9430-95551123b0f5 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:30.041610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bfd8f-4acc-4c32-9430-95551123b0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:30.043099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6bfd8f-4acc-4c32-9430-95551123b0f5 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:30.045109 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 107/207] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:29 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:30.051263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84ab12-35f8-45ed-ab3d-54875c8f9a29 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:30.179283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:30.185939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84ab12-35f8-45ed-ab3d-54875c8f9a29 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:30.239151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7209a-2331-4dec-8b58-59992e698cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:30.239789 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7209a-2331-4dec-8b58-59992e698cab None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:30.240068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7209a-2331-4dec-8b58-59992e698cab None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:30.240344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7209a-2331-4dec-8b58-59992e698cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:30.241178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7209a-2331-4dec-8b58-59992e698cab None admin] RBAC: Adding query filter params (role.id=c179515102c542798ce49a1bf0e8b98a, scope.project.id=e917870b5e964ef4a1fecad71d41d379, user.id=787b85de0b5e4a3e9095d7d430cf7890) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:30.241491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7209a-2331-4dec-8b58-59992e698cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:30.242943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7209a-2331-4dec-8b58-59992e698cab None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:30.254118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 101/208] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:30 2022] GET /identity/v3/role_assignments?user.id=787b85de0b5e4a3e9095d7d430cf7890&scope.project.id=e917870b5e964ef4a1fecad71d41d379&role.id=c179515102c542798ce49a1bf0e8b98a => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:30.514969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb748e-0a0a-45c6-a3f2-9b12d7768edc None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:30.515477 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb748e-0a0a-45c6-a3f2-9b12d7768edc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:30.515477 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb748e-0a0a-45c6-a3f2-9b12d7768edc None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:30.516875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 108/209] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:30.527140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66d3fc-a620-44aa-8106-ea94b1952048 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:30.527476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66d3fc-a620-44aa-8106-ea94b1952048 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:30.527695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66d3fc-a620-44aa-8106-ea94b1952048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:30.550770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1e66d3fc-a620-44aa-8106-ea94b1952048 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:30.552035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1e66d3fc-a620-44aa-8106-ea94b1952048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:30.624408 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d94e6-04d1-4ae6-a9ba-bcbb13443c45 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:30.627112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d94e6-04d1-4ae6-a9ba-bcbb13443c45 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:30.627112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d94e6-04d1-4ae6-a9ba-bcbb13443c45 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:30.627112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 109/210] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:30.634499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f932-856a-446a-b33f-79eb3220b704 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:30.634925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f932-856a-446a-b33f-79eb3220b704 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:30.636679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f932-856a-446a-b33f-79eb3220b704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:30.653925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 102/211] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:30.668598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a776f932-856a-446a-b33f-79eb3220b704 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:30.670177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a776f932-856a-446a-b33f-79eb3220b704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:30.686262 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66d3fc-a620-44aa-8106-ea94b1952048 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:30.755652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:30.770370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 110/212] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:30.803620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f932-856a-446a-b33f-79eb3220b704 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:30.825096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:30.845287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66d3fc-a620-44aa-8106-ea94b1952048 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:30.893742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada869ba-bc80-495c-af44-5b1f3a58e0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:30.894946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada869ba-bc80-495c-af44-5b1f3a58e0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:30.895392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada869ba-bc80-495c-af44-5b1f3a58e0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:30.896055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada869ba-bc80-495c-af44-5b1f3a58e0a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:30.913000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada869ba-bc80-495c-af44-5b1f3a58e0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ada869ba-bc80-495c-af44-5b1f3a58e0a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:30.923242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:30.924320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:30.925140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:30.925140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:30.925140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:30.925140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:30.925140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:30.925140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:30.925140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:30.925140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:30.925140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:30.925140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:30.925140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:30.925140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:30.926411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 103/213] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:00:30.932228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada869ba-bc80-495c-af44-5b1f3a58e0a8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:30.943387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f932-856a-446a-b33f-79eb3220b704 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:30.992607 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c750806-917c-4e80-9301-d6f4ee257183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:30.993764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750806-917c-4e80-9301-d6f4ee257183 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:30.994882 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750806-917c-4e80-9301-d6f4ee257183 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:30.995372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750806-917c-4e80-9301-d6f4ee257183 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:30.997189 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c750806-917c-4e80-9301-d6f4ee257183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:30.999793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c750806-917c-4e80-9301-d6f4ee257183 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:31.003237 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 111/214] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:31.008705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c750806-917c-4e80-9301-d6f4ee257183 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:31.056446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada869ba-bc80-495c-af44-5b1f3a58e0a8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:31.076669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:31.093948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667150b5-67c2-4e9d-af66-561a8d085143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:31.094958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667150b5-67c2-4e9d-af66-561a8d085143 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:31.095425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667150b5-67c2-4e9d-af66-561a8d085143 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:31.096017 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667150b5-67c2-4e9d-af66-561a8d085143 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:31.096981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667150b5-67c2-4e9d-af66-561a8d085143 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:31.097487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667150b5-67c2-4e9d-af66-561a8d085143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:31.099054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667150b5-67c2-4e9d-af66-561a8d085143 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:31.108195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 104/215] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:31.113915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667150b5-67c2-4e9d-af66-561a8d085143 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:31.128873 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c750806-917c-4e80-9301-d6f4ee257183 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:31.135885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:31.175438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014babf-6478-4d85-b5f9-4c22919090a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:31.176571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014babf-6478-4d85-b5f9-4c22919090a9 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:31.177017 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014babf-6478-4d85-b5f9-4c22919090a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:31.177451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014babf-6478-4d85-b5f9-4c22919090a9 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:31.178516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014babf-6478-4d85-b5f9-4c22919090a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:31.180852 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014babf-6478-4d85-b5f9-4c22919090a9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:31.212425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 112/216] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:00:31 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:00:31.252981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667150b5-67c2-4e9d-af66-561a8d085143 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:31.293877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78151524-61cf-4c27-b3eb-73cf85d069c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:31.294546 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78151524-61cf-4c27-b3eb-73cf85d069c7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:31.294822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78151524-61cf-4c27-b3eb-73cf85d069c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:31.295144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78151524-61cf-4c27-b3eb-73cf85d069c7 None admin] PATH_INFO: `/v3/users/2ac17340548c458494b293fac4c485ad` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:31.311853 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78151524-61cf-4c27-b3eb-73cf85d069c7 None admin] RBAC: Authorizing `identity:get_user(user_id=2ac17340548c458494b293fac4c485ad)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:31.313385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78151524-61cf-4c27-b3eb-73cf85d069c7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:31.315724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 105/217] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:31 2022] GET /identity/v3/users/2ac17340548c458494b293fac4c485ad => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:31.322257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014babf-6478-4d85-b5f9-4c22919090a9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:31.437447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014babf-6478-4d85-b5f9-4c22919090a9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:31.456191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:31.465212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e0f67-35e3-4d88-aa72-901491d204d7 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:31.465494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e0f67-35e3-4d88-aa72-901491d204d7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:31.465773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e0f67-35e3-4d88-aa72-901491d204d7 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:31.467155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 106/218] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:31.475116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53857fea-be5d-44c1-ab31-ba1720456589 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:31.475431 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53857fea-be5d-44c1-ab31-ba1720456589 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:31.475656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53857fea-be5d-44c1-ab31-ba1720456589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:31.478245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a007a-ab74-486d-9a30-5fcefa6b5088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:31.478892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a007a-ab74-486d-9a30-5fcefa6b5088 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:31.479237 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a007a-ab74-486d-9a30-5fcefa6b5088 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:31.479510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a007a-ab74-486d-9a30-5fcefa6b5088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:31.496508 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-53857fea-be5d-44c1-ab31-ba1720456589 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:31.497741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-53857fea-be5d-44c1-ab31-ba1720456589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:31.566942 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a007a-ab74-486d-9a30-5fcefa6b5088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:31.568353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a007a-ab74-486d-9a30-5fcefa6b5088 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:31.590222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:31.596561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 107/219] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:31.619523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53857fea-be5d-44c1-ab31-ba1720456589 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:31.704326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 113/220] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:31.711628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a007a-ab74-486d-9a30-5fcefa6b5088 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:31.738251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:31.738449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53857fea-be5d-44c1-ab31-ba1720456589 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:31.785832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df99da-f903-4051-9fa0-3d263798dbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:31.786533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df99da-f903-4051-9fa0-3d263798dbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:31.786827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df99da-f903-4051-9fa0-3d263798dbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:31.787105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df99da-f903-4051-9fa0-3d263798dbe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:31.812083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df99da-f903-4051-9fa0-3d263798dbe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-01df99da-f903-4051-9fa0-3d263798dbe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:31.821449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:31.822330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:31.823119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 108/221] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:31.828471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df99da-f903-4051-9fa0-3d263798dbe1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:31.847970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a007a-ab74-486d-9a30-5fcefa6b5088 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:31.890097 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3599bd5-60ed-4e2f-908f-98a47fb014cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:31.891190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3599bd5-60ed-4e2f-908f-98a47fb014cd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:31.891669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3599bd5-60ed-4e2f-908f-98a47fb014cd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:31.892159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3599bd5-60ed-4e2f-908f-98a47fb014cd None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:31.894385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3599bd5-60ed-4e2f-908f-98a47fb014cd None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:31.896679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3599bd5-60ed-4e2f-908f-98a47fb014cd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:31.898852 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 114/222] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:31 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:31.908076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3599bd5-60ed-4e2f-908f-98a47fb014cd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:31.963917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:32.037825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:32.040418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df99da-f903-4051-9fa0-3d263798dbe1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:32.054613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3599bd5-60ed-4e2f-908f-98a47fb014cd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:32.081650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d34a46-9706-47a1-ad14-3ebaf19bc24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:32.082450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d34a46-9706-47a1-ad14-3ebaf19bc24a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:32.082733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d34a46-9706-47a1-ad14-3ebaf19bc24a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:32.083451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d34a46-9706-47a1-ad14-3ebaf19bc24a None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:32.084205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d34a46-9706-47a1-ad14-3ebaf19bc24a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:32.084515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d34a46-9706-47a1-ad14-3ebaf19bc24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:32.086242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d34a46-9706-47a1-ad14-3ebaf19bc24a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:32.093307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f71d0-6cad-47f0-850c-b999b1ca1504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:32.094031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f71d0-6cad-47f0-850c-b999b1ca1504 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:32.094376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f71d0-6cad-47f0-850c-b999b1ca1504 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:32.094715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f71d0-6cad-47f0-850c-b999b1ca1504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:32.095589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f71d0-6cad-47f0-850c-b999b1ca1504 None admin] RBAC: Adding query filter params (role.id=2d65d41d83b24e36b4a751ac3f7fb178, scope.project.id=4931005296114563946c84a7e790464a, user.id=2ac17340548c458494b293fac4c485ad) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:32.096130 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f71d0-6cad-47f0-850c-b999b1ca1504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:32.097770 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f71d0-6cad-47f0-850c-b999b1ca1504 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:32.101078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 109/223] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:32.102615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeffd3-7631-4acd-bd85-598a8bc4f40e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:32.102897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeffd3-7631-4acd-bd85-598a8bc4f40e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:32.103172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeffd3-7631-4acd-bd85-598a8bc4f40e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:32.104637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 110/224] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:32.107372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafeffd3-7631-4acd-bd85-598a8bc4f40e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:32.110471 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 115/225] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:31 2022] GET /identity/v3/role_assignments?user.id=2ac17340548c458494b293fac4c485ad&scope.project.id=4931005296114563946c84a7e790464a&role.id=2d65d41d83b24e36b4a751ac3f7fb178 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:32.111836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df682f-3091-462b-ad85-9094344b6b1f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:32.112119 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df682f-3091-462b-ad85-9094344b6b1f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:32.112400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df682f-3091-462b-ad85-9094344b6b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:32.133119 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f1df682f-3091-462b-ad85-9094344b6b1f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:32.134409 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f1df682f-3091-462b-ad85-9094344b6b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:32.235814 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 116/226] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:32.251728 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafeffd3-7631-4acd-bd85-598a8bc4f40e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:32.265002 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df682f-3091-462b-ad85-9094344b6b1f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:32.279160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:32.293336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bd763-30c9-484d-9a03-181ac9e89093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:32.294057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bd763-30c9-484d-9a03-181ac9e89093 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:32.294342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bd763-30c9-484d-9a03-181ac9e89093 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:32.294620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bd763-30c9-484d-9a03-181ac9e89093 None admin] PATH_INFO: `/v3/users/66e781813546438298e27d5b328540cb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:32.295877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bd763-30c9-484d-9a03-181ac9e89093 None admin] RBAC: Authorizing `identity:get_user(user_id=66e781813546438298e27d5b328540cb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:32.297542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bd763-30c9-484d-9a03-181ac9e89093 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:32.299353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 111/227] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:32 2022] GET /identity/v3/users/66e781813546438298e27d5b328540cb => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:32.310184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bd763-30c9-484d-9a03-181ac9e89093 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:32.377423 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:32.400431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df682f-3091-462b-ad85-9094344b6b1f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:32.438094 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a98da0-9c73-4c37-b820-d36fbad4b37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:32.439128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98da0-9c73-4c37-b820-d36fbad4b37b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:32.439774 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98da0-9c73-4c37-b820-d36fbad4b37b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:32.440276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98da0-9c73-4c37-b820-d36fbad4b37b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:32.452087 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a98da0-9c73-4c37-b820-d36fbad4b37b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a5a98da0-9c73-4c37-b820-d36fbad4b37b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:32.457609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:32.458500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:32.459268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:32.459268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:32.459268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:32.459268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:32.459268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:32.459268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:32.459268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:32.459268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:32.459268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:32.459268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:32.459268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:32.459268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:32.461956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 117/228] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:00:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:32.467982 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a98da0-9c73-4c37-b820-d36fbad4b37b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:32.565016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bd763-30c9-484d-9a03-181ac9e89093 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:32.576823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a98da0-9c73-4c37-b820-d36fbad4b37b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:32.615118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb267a83-b714-44c8-9e88-63d0ecb7acef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:32.616357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb267a83-b714-44c8-9e88-63d0ecb7acef None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:32.616855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb267a83-b714-44c8-9e88-63d0ecb7acef None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:32.617364 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb267a83-b714-44c8-9e88-63d0ecb7acef None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:32.618285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb267a83-b714-44c8-9e88-63d0ecb7acef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:32.618781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb267a83-b714-44c8-9e88-63d0ecb7acef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:32.620816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb267a83-b714-44c8-9e88-63d0ecb7acef None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:32.632155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 118/229] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:00:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:32.647361 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad4d37-4603-43b1-bb8b-b9e0045bddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:32.648432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad4d37-4603-43b1-bb8b-b9e0045bddca None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:32.648936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad4d37-4603-43b1-bb8b-b9e0045bddca None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:32.649450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad4d37-4603-43b1-bb8b-b9e0045bddca None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:32.650874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad4d37-4603-43b1-bb8b-b9e0045bddca None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:32.652537 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad4d37-4603-43b1-bb8b-b9e0045bddca None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:32.654878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 112/230] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:32 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:32.660970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb267a83-b714-44c8-9e88-63d0ecb7acef None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:32.666944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:32.679807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad4d37-4603-43b1-bb8b-b9e0045bddca None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:32.785069 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb267a83-b714-44c8-9e88-63d0ecb7acef None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:32.807489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:32.830142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025292f9-a98b-456c-9252-bd31d066471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:32.830893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025292f9-a98b-456c-9252-bd31d066471b None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:32.831180 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025292f9-a98b-456c-9252-bd31d066471b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:32.831439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025292f9-a98b-456c-9252-bd31d066471b None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a/users/66e781813546438298e27d5b328540cb/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:32.835203 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025292f9-a98b-456c-9252-bd31d066471b None admin] RBAC: Authorizing `identity:create_grant(project_id=4931005296114563946c84a7e790464a, user_id=66e781813546438298e27d5b328540cb, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:32.836683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025292f9-a98b-456c-9252-bd31d066471b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:32.860265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 119/231] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:00:32 2022] PUT /identity/v3/projects/4931005296114563946c84a7e790464a/users/66e781813546438298e27d5b328540cb/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:32.883530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad4d37-4603-43b1-bb8b-b9e0045bddca None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:32.937247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e11c5-2319-4e23-bac1-d622c684d305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:32.937934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e11c5-2319-4e23-bac1-d622c684d305 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:32.938263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e11c5-2319-4e23-bac1-d622c684d305 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:32.938600 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e11c5-2319-4e23-bac1-d622c684d305 None admin] PATH_INFO: `/v3/users/66e781813546438298e27d5b328540cb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:32.941159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e11c5-2319-4e23-bac1-d622c684d305 None admin] RBAC: Authorizing `identity:get_user(user_id=66e781813546438298e27d5b328540cb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:32.942693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e11c5-2319-4e23-bac1-d622c684d305 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:32.944804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 113/232] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:32 2022] GET /identity/v3/users/66e781813546438298e27d5b328540cb => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:32.953647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025292f9-a98b-456c-9252-bd31d066471b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:33.033080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:33.095897 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025292f9-a98b-456c-9252-bd31d066471b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:33.142144 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61444fd6-1063-44b1-9c1a-58dade3de371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:33.142763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61444fd6-1063-44b1-9c1a-58dade3de371 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:33.143045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61444fd6-1063-44b1-9c1a-58dade3de371 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:33.143321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61444fd6-1063-44b1-9c1a-58dade3de371 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:33.146042 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61444fd6-1063-44b1-9c1a-58dade3de371 None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:33.147528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61444fd6-1063-44b1-9c1a-58dade3de371 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:33.149299 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 120/233] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:32 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:33.158381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e11c5-2319-4e23-bac1-d622c684d305 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:33.417727 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e11c5-2319-4e23-bac1-d622c684d305 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:33.466665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:33.480920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdf6a8-0c8c-4f82-8889-7d51037e9cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:33.482048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdf6a8-0c8c-4f82-8889-7d51037e9cd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:33.482530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdf6a8-0c8c-4f82-8889-7d51037e9cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:33.483014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdf6a8-0c8c-4f82-8889-7d51037e9cd8 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a/users/66e781813546438298e27d5b328540cb/roles/04a9c139ed6d44d4bcd37b614aeb009e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:33.486829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdf6a8-0c8c-4f82-8889-7d51037e9cd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4931005296114563946c84a7e790464a, user_id=66e781813546438298e27d5b328540cb, role_id=04a9c139ed6d44d4bcd37b614aeb009e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:33.489641 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfdf6a8-0c8c-4f82-8889-7d51037e9cd8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:33.520821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 114/234] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:00:33 2022] PUT /identity/v3/projects/4931005296114563946c84a7e790464a/users/66e781813546438298e27d5b328540cb/roles/04a9c139ed6d44d4bcd37b614aeb009e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:00:33.827847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16149-db27-4801-bb27-3b0a3ef0a3da None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:33.828652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16149-db27-4801-bb27-3b0a3ef0a3da None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:33.828652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16149-db27-4801-bb27-3b0a3ef0a3da None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:33.830073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 121/235] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:33.835708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d5ae-34eb-441d-9c94-6c38a372b98b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:33.836027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d5ae-34eb-441d-9c94-6c38a372b98b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:33.836254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d5ae-34eb-441d-9c94-6c38a372b98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:33.862206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7532d5ae-34eb-441d-9c94-6c38a372b98b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:33.863514 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7532d5ae-34eb-441d-9c94-6c38a372b98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:33.949672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 115/236] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:33.982026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b16149-db27-4801-bb27-3b0a3ef0a3da None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:34.101782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b16149-db27-4801-bb27-3b0a3ef0a3da None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:34.142256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:34.149280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df104694-badd-436b-9ff9-2fc71d981ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:34.149955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df104694-badd-436b-9ff9-2fc71d981ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:34.150239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df104694-badd-436b-9ff9-2fc71d981ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:34.150517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df104694-badd-436b-9ff9-2fc71d981ec1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:34.166908 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df104694-badd-436b-9ff9-2fc71d981ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-df104694-badd-436b-9ff9-2fc71d981ec1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:34.171997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:34.174023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:34.175753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 122/237] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:00:34.180948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d5ae-34eb-441d-9c94-6c38a372b98b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:34.465649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d5ae-34eb-441d-9c94-6c38a372b98b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:34.507583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:34.555433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451b799-647e-4f76-b93c-77d8613fc77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:34.556460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b799-647e-4f76-b93c-77d8613fc77f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:34.556966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b799-647e-4f76-b93c-77d8613fc77f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:34.557443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b799-647e-4f76-b93c-77d8613fc77f None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:34.558709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451b799-647e-4f76-b93c-77d8613fc77f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:34.559241 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451b799-647e-4f76-b93c-77d8613fc77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:34.561819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451b799-647e-4f76-b93c-77d8613fc77f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:34.573648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 116/238] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:34.579358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df104694-badd-436b-9ff9-2fc71d981ec1 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:34.689282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df104694-badd-436b-9ff9-2fc71d981ec1 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:34.730605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010066a9-f55c-4584-8d00-a641ce64c464 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:34.730895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a63a7e-9397-43f9-ad58-547ad02d8269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:34.731052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010066a9-f55c-4584-8d00-a641ce64c464 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:34.731397 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a63a7e-9397-43f9-ad58-547ad02d8269 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:34.731545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010066a9-f55c-4584-8d00-a641ce64c464 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:34.731669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a63a7e-9397-43f9-ad58-547ad02d8269 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:34.731956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a63a7e-9397-43f9-ad58-547ad02d8269 None admin] PATH_INFO: `/v3/users/a8e6b55243954f48a7ee4302124debb2` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:34.734157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 117/239] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:34.742644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f60677-ec43-4039-9bfd-7b41ab0fb0fc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:34.743093 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f60677-ec43-4039-9bfd-7b41ab0fb0fc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:34.743569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f60677-ec43-4039-9bfd-7b41ab0fb0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:34.757132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a63a7e-9397-43f9-ad58-547ad02d8269 None admin] RBAC: Authorizing `identity:get_user(user_id=a8e6b55243954f48a7ee4302124debb2)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:34.758647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a63a7e-9397-43f9-ad58-547ad02d8269 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:34.760713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 123/240] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:34 2022] GET /identity/v3/users/a8e6b55243954f48a7ee4302124debb2 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:34.771359 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a63a7e-9397-43f9-ad58-547ad02d8269 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:34.786781 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-64f60677-ec43-4039-9bfd-7b41ab0fb0fc None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:34.788002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-64f60677-ec43-4039-9bfd-7b41ab0fb0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:34.856323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:34.892336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 118/241] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:34.893845 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49805fdc-8bab-4da3-a6c9-8a19042ff4c1 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:34.894124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49805fdc-8bab-4da3-a6c9-8a19042ff4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:34.894397 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49805fdc-8bab-4da3-a6c9-8a19042ff4c1 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:34.900099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 119/242] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:34.901577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af858ddc-81bf-464e-b418-df6ade4469a0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:34.901870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af858ddc-81bf-464e-b418-df6ade4469a0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:34.902153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af858ddc-81bf-464e-b418-df6ade4469a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:34.919597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a63a7e-9397-43f9-ad58-547ad02d8269 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:34.930083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-af858ddc-81bf-464e-b418-df6ade4469a0 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:34.931305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-af858ddc-81bf-464e-b418-df6ade4469a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:34.962291 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9cd10-97a1-4e60-897b-7363b4a8661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:34.963181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9cd10-97a1-4e60-897b-7363b4a8661c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:34.963476 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9cd10-97a1-4e60-897b-7363b4a8661c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:34.964172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9cd10-97a1-4e60-897b-7363b4a8661c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:35.013319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 120/243] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:35.014143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af858ddc-81bf-464e-b418-df6ade4469a0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:35.063996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:35.072480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9cd10-97a1-4e60-897b-7363b4a8661c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:35.074151 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9cd10-97a1-4e60-897b-7363b4a8661c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:35.130516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:35.149600 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af858ddc-81bf-464e-b418-df6ade4469a0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:35.194592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 124/244] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 07:00:35.194592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9cd10-97a1-4e60-897b-7363b4a8661c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:35.206897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422a025-1a14-49eb-b8d7-2d7ae949eb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:35.208402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422a025-1a14-49eb-b8d7-2d7ae949eb65 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:35.209334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422a025-1a14-49eb-b8d7-2d7ae949eb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:35.209792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422a025-1a14-49eb-b8d7-2d7ae949eb65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:35.211419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422a025-1a14-49eb-b8d7-2d7ae949eb65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:35.213741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422a025-1a14-49eb-b8d7-2d7ae949eb65 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:35.215531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 121/245] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:35.216456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422a025-1a14-49eb-b8d7-2d7ae949eb65 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:35.329150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9cd10-97a1-4e60-897b-7363b4a8661c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:35.334740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422a025-1a14-49eb-b8d7-2d7ae949eb65 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:35.343202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:35.372541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342f115-b529-42b6-a0c2-21e6be7cf116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:35.373477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342f115-b529-42b6-a0c2-21e6be7cf116 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:35.373857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342f115-b529-42b6-a0c2-21e6be7cf116 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:35.374229 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342f115-b529-42b6-a0c2-21e6be7cf116 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:35.375622 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342f115-b529-42b6-a0c2-21e6be7cf116 None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:35.376638 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca752ed-adc1-4be1-bf97-319aae57cae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:35.377480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342f115-b529-42b6-a0c2-21e6be7cf116 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:35.377707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca752ed-adc1-4be1-bf97-319aae57cae7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:35.378126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca752ed-adc1-4be1-bf97-319aae57cae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:35.378538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca752ed-adc1-4be1-bf97-319aae57cae7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:35.384594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 122/246] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:35 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:35.384594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342f115-b529-42b6-a0c2-21e6be7cf116 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:35.396922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca752ed-adc1-4be1-bf97-319aae57cae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-6ca752ed-adc1-4be1-bf97-319aae57cae7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:35.403985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:35.405174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:35.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:35.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:35.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:35.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:35.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:35.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:35.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:35.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:35.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:35.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:35.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:35.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:35.408616 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 125/247] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:35.409610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca752ed-adc1-4be1-bf97-319aae57cae7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:35.424012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:35.520708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342f115-b529-42b6-a0c2-21e6be7cf116 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:35.549044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca752ed-adc1-4be1-bf97-319aae57cae7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:35.564627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2046b15-2026-467f-8e44-726b99d4a7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:35.565669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2046b15-2026-467f-8e44-726b99d4a7d1 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:35.566046 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2046b15-2026-467f-8e44-726b99d4a7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:35.566415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2046b15-2026-467f-8e44-726b99d4a7d1 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:35.567465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2046b15-2026-467f-8e44-726b99d4a7d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:35.569754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2046b15-2026-467f-8e44-726b99d4a7d1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:35.594212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2b99f-5a59-45cf-aa0d-1dc61cc960bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:35.595229 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2b99f-5a59-45cf-aa0d-1dc61cc960bb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:35.595812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2b99f-5a59-45cf-aa0d-1dc61cc960bb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:35.596339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2b99f-5a59-45cf-aa0d-1dc61cc960bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:35.597405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2b99f-5a59-45cf-aa0d-1dc61cc960bb None admin] RBAC: Adding query filter params (role.id=c179515102c542798ce49a1bf0e8b98a, scope.project.id=4931005296114563946c84a7e790464a, user.id=a8e6b55243954f48a7ee4302124debb2) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:35.597966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2b99f-5a59-45cf-aa0d-1dc61cc960bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:35.598542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 123/248] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:00:35 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:00:35.599392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2046b15-2026-467f-8e44-726b99d4a7d1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:35.600250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2b99f-5a59-45cf-aa0d-1dc61cc960bb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:35.621028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 126/249] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:35 2022] GET /identity/v3/role_assignments?user.id=a8e6b55243954f48a7ee4302124debb2&scope.project.id=4931005296114563946c84a7e790464a&role.id=c179515102c542798ce49a1bf0e8b98a => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:35.652352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:35.767184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2046b15-2026-467f-8e44-726b99d4a7d1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:35.824222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77233e4d-f06a-4e17-a1bd-51c64c95f7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:35.825335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233e4d-f06a-4e17-a1bd-51c64c95f7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:35.825839 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233e4d-f06a-4e17-a1bd-51c64c95f7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:35.826316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233e4d-f06a-4e17-a1bd-51c64c95f7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:35.827375 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77233e4d-f06a-4e17-a1bd-51c64c95f7b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:35.828020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77233e4d-f06a-4e17-a1bd-51c64c95f7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:35.829782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77233e4d-f06a-4e17-a1bd-51c64c95f7b3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:35.847124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 124/250] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:35.853228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2b99f-5a59-45cf-aa0d-1dc61cc960bb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:35.953380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:35.989686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2b99f-5a59-45cf-aa0d-1dc61cc960bb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:36.030796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773e87-e26b-4c21-9bff-2fc74a10b10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:36.031460 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773e87-e26b-4c21-9bff-2fc74a10b10e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:36.031748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773e87-e26b-4c21-9bff-2fc74a10b10e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:36.032025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773e87-e26b-4c21-9bff-2fc74a10b10e None admin] PATH_INFO: `/v3/users/2ac17340548c458494b293fac4c485ad` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:36.033322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad773e87-e26b-4c21-9bff-2fc74a10b10e None admin] RBAC: Authorizing `identity:get_user(user_id=2ac17340548c458494b293fac4c485ad)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:36.034784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad773e87-e26b-4c21-9bff-2fc74a10b10e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:36.036579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 127/251] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:35 2022] GET /identity/v3/users/2ac17340548c458494b293fac4c485ad => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:36.043292 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77233e4d-f06a-4e17-a1bd-51c64c95f7b3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:36.157327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:36.166540 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77233e4d-f06a-4e17-a1bd-51c64c95f7b3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:36.204539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c76d1-0715-46b4-9b5e-7a9d46110378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:36.205290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c76d1-0715-46b4-9b5e-7a9d46110378 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:36.205572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c76d1-0715-46b4-9b5e-7a9d46110378 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:36.205847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c76d1-0715-46b4-9b5e-7a9d46110378 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:36.207032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c76d1-0715-46b4-9b5e-7a9d46110378 None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:36.208494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c76d1-0715-46b4-9b5e-7a9d46110378 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:36.210549 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 125/252] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:36 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:36.217264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773e87-e26b-4c21-9bff-2fc74a10b10e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:36.269107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6341-f397-4fc5-acc5-e120b6a0f979 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:36.269406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6341-f397-4fc5-acc5-e120b6a0f979 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:36.269659 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6341-f397-4fc5-acc5-e120b6a0f979 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:36.271050 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 126/253] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:00:36.277276 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce643-2dd5-4a63-9422-6ff5133cad2d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:36.277567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce643-2dd5-4a63-9422-6ff5133cad2d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:36.277831 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce643-2dd5-4a63-9422-6ff5133cad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:36.300602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-44bce643-2dd5-4a63-9422-6ff5133cad2d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:36.301862 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-44bce643-2dd5-4a63-9422-6ff5133cad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:36.346670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773e87-e26b-4c21-9bff-2fc74a10b10e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:36.382742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 127/254] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:36.392022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb18346-e765-41df-84c9-226b9eb93420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:36.392815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18346-e765-41df-84c9-226b9eb93420 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:36.393142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18346-e765-41df-84c9-226b9eb93420 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:36.393424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18346-e765-41df-84c9-226b9eb93420 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a/users/2ac17340548c458494b293fac4c485ad/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:36.397555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb18346-e765-41df-84c9-226b9eb93420 None admin] RBAC: Authorizing `identity:create_grant(project_id=4931005296114563946c84a7e790464a, user_id=2ac17340548c458494b293fac4c485ad, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:36.399933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb18346-e765-41df-84c9-226b9eb93420 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:36.411530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce643-2dd5-4a63-9422-6ff5133cad2d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:36.426288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:36.437015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 128/255] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:00:36 2022] PUT /identity/v3/projects/4931005296114563946c84a7e790464a/users/2ac17340548c458494b293fac4c485ad/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:36.573616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:36.584665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce643-2dd5-4a63-9422-6ff5133cad2d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:36.623477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3197db-0109-48dd-b66c-93eaeb9db72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:36.624150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3197db-0109-48dd-b66c-93eaeb9db72e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:36.624431 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3197db-0109-48dd-b66c-93eaeb9db72e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:36.624704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3197db-0109-48dd-b66c-93eaeb9db72e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:36.636731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3197db-0109-48dd-b66c-93eaeb9db72e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9e3197db-0109-48dd-b66c-93eaeb9db72e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:36.642014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:36.643116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:36.643887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:36.643887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:36.643887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:36.643887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:36.643887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:36.643887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:36.643887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:36.643887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:36.643887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:36.643887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:36.643887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:36.643887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:36.646651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 128/256] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:36.650331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb18346-e765-41df-84c9-226b9eb93420 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:36.806933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb18346-e765-41df-84c9-226b9eb93420 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:36.845546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267df81-236c-46f1-8cd1-04df39865e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:36.846375 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267df81-236c-46f1-8cd1-04df39865e27 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:36.846697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267df81-236c-46f1-8cd1-04df39865e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:36.847023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267df81-236c-46f1-8cd1-04df39865e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:36.847764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267df81-236c-46f1-8cd1-04df39865e27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:36.848077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267df81-236c-46f1-8cd1-04df39865e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:36.849653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267df81-236c-46f1-8cd1-04df39865e27 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:36.863768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 129/257] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:36.869976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3197db-0109-48dd-b66c-93eaeb9db72e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:37.023688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3197db-0109-48dd-b66c-93eaeb9db72e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:37.068651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fb440-4a38-4605-8279-9a0bb179e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:37.069265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fb440-4a38-4605-8279-9a0bb179e290 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:37.069549 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fb440-4a38-4605-8279-9a0bb179e290 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:37.069826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fb440-4a38-4605-8279-9a0bb179e290 None admin] PATH_INFO: `/v3/users/66e781813546438298e27d5b328540cb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:37.071058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fb440-4a38-4605-8279-9a0bb179e290 None admin] RBAC: Authorizing `identity:get_user(user_id=66e781813546438298e27d5b328540cb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:37.072522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fb440-4a38-4605-8279-9a0bb179e290 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:37.074288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 129/258] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:36 2022] GET /identity/v3/users/66e781813546438298e27d5b328540cb => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:37.080305 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267df81-236c-46f1-8cd1-04df39865e27 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:37.158432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:37.210827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267df81-236c-46f1-8cd1-04df39865e27 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:37.264509 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04760d8f-3c90-4ff1-aa92-79299fe7bb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:37.265216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04760d8f-3c90-4ff1-aa92-79299fe7bb2f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:37.265502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04760d8f-3c90-4ff1-aa92-79299fe7bb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:37.265790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04760d8f-3c90-4ff1-aa92-79299fe7bb2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:37.317072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af5005-3f62-440d-a2cf-0768dfd48c9f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:37.317596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af5005-3f62-440d-a2cf-0768dfd48c9f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:37.317669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af5005-3f62-440d-a2cf-0768dfd48c9f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:37.319119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 130/259] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:00:37.324205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e693c-036d-4c93-a3e8-75d0e424f303 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:37.324488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e693c-036d-4c93-a3e8-75d0e424f303 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:37.324765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e693c-036d-4c93-a3e8-75d0e424f303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:37.350324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-990e693c-036d-4c93-a3e8-75d0e424f303 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:37.352637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-990e693c-036d-4c93-a3e8-75d0e424f303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:37.381247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:37.393483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04760d8f-3c90-4ff1-aa92-79299fe7bb2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:37.394977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04760d8f-3c90-4ff1-aa92-79299fe7bb2f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:37.489295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:37.507226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 131/260] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:37.522040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 130/261] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:37.527936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e693c-036d-4c93-a3e8-75d0e424f303 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:37.563474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04760d8f-3c90-4ff1-aa92-79299fe7bb2f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:37.756875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04760d8f-3c90-4ff1-aa92-79299fe7bb2f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:37.769130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e693c-036d-4c93-a3e8-75d0e424f303 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:37.829731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c9fc7-d2e0-4f98-bb68-05c3c49f2b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:37.830433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c9fc7-d2e0-4f98-bb68-05c3c49f2b42 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:37.830715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c9fc7-d2e0-4f98-bb68-05c3c49f2b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:37.830993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c9fc7-d2e0-4f98-bb68-05c3c49f2b42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:37.850797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da37a82-a126-4c82-a6ee-593849610a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:37.851377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c9fc7-d2e0-4f98-bb68-05c3c49f2b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:37.851556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da37a82-a126-4c82-a6ee-593849610a4d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:37.851797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da37a82-a126-4c82-a6ee-593849610a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:37.852017 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da37a82-a126-4c82-a6ee-593849610a4d None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:37.853269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da37a82-a126-4c82-a6ee-593849610a4d None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:37.854722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da37a82-a126-4c82-a6ee-593849610a4d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:37.856419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 132/262] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:37 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-ca5c9fc7-d2e0-4f98-bb68-05c3c49f2b42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:37.857154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:37.858053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:37.858841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 131/263] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:00:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:00:37.866128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da37a82-a126-4c82-a6ee-593849610a4d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:37.866424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c9fc7-d2e0-4f98-bb68-05c3c49f2b42 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:37.902962 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:37.905278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:37.983816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c9fc7-d2e0-4f98-bb68-05c3c49f2b42 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:38.019333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2213483-26e4-4a91-987e-42e72afe17ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:38.019977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2213483-26e4-4a91-987e-42e72afe17ed None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:38.020326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2213483-26e4-4a91-987e-42e72afe17ed None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:38.020667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2213483-26e4-4a91-987e-42e72afe17ed None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:38.021508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2213483-26e4-4a91-987e-42e72afe17ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:38.021881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2213483-26e4-4a91-987e-42e72afe17ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:38.023384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2213483-26e4-4a91-987e-42e72afe17ed None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:38.032715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 132/264] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:00:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:38.040921 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2213483-26e4-4a91-987e-42e72afe17ed None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:38.093612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da37a82-a126-4c82-a6ee-593849610a4d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:38.134852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9af4cf-c503-4930-9619-65ca26df4f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:38.135484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af4cf-c503-4930-9619-65ca26df4f38 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:38.135764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af4cf-c503-4930-9619-65ca26df4f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:38.136041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af4cf-c503-4930-9619-65ca26df4f38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:38.137176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9af4cf-c503-4930-9619-65ca26df4f38 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=4931005296114563946c84a7e790464a, user.id=66e781813546438298e27d5b328540cb) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:38.137494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9af4cf-c503-4930-9619-65ca26df4f38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:38.138957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9af4cf-c503-4930-9619-65ca26df4f38 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:38.146048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 133/265] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:37 2022] GET /identity/v3/role_assignments?user.id=66e781813546438298e27d5b328540cb&scope.project.id=4931005296114563946c84a7e790464a&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:38.203615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:38.227604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2213483-26e4-4a91-987e-42e72afe17ed None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:38.282308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ef385-af9e-45a7-9af5-9b5d4bd4fb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:38.283020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ef385-af9e-45a7-9af5-9b5d4bd4fb7c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:38.283374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ef385-af9e-45a7-9af5-9b5d4bd4fb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:38.283648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ef385-af9e-45a7-9af5-9b5d4bd4fb7c None admin] PATH_INFO: `/v3/users/66e781813546438298e27d5b328540cb` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:38.284969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ef385-af9e-45a7-9af5-9b5d4bd4fb7c None admin] RBAC: Authorizing `identity:get_user(user_id=66e781813546438298e27d5b328540cb)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:38.286473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ef385-af9e-45a7-9af5-9b5d4bd4fb7c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:38.288527 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 133/266] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:38 2022] GET /identity/v3/users/66e781813546438298e27d5b328540cb => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:38.294474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9af4cf-c503-4930-9619-65ca26df4f38 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:38.392299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:38.413589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9af4cf-c503-4930-9619-65ca26df4f38 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:38.455693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b139ee4-da37-48d3-bf13-207461380211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:38.456358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b139ee4-da37-48d3-bf13-207461380211 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:38.456631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b139ee4-da37-48d3-bf13-207461380211 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:38.456932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b139ee4-da37-48d3-bf13-207461380211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:38.548004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b139ee4-da37-48d3-bf13-207461380211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:38.549517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b139ee4-da37-48d3-bf13-207461380211 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:38.642995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:38.665112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 134/267] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:38.670661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ef385-af9e-45a7-9af5-9b5d4bd4fb7c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:38.708524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7279bd1-0b00-431a-94b3-0defccf45894 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:38.708852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7279bd1-0b00-431a-94b3-0defccf45894 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:38.709100 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7279bd1-0b00-431a-94b3-0defccf45894 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:38.710753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 135/268] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:00:38.720158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4e1d7-5a25-4cad-8e31-c241f564e492 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:38.720158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4e1d7-5a25-4cad-8e31-c241f564e492 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:38.720476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4e1d7-5a25-4cad-8e31-c241f564e492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:38.740725 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-68e4e1d7-5a25-4cad-8e31-c241f564e492 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:38.742148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-68e4e1d7-5a25-4cad-8e31-c241f564e492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:38.793544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ef385-af9e-45a7-9af5-9b5d4bd4fb7c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:38.828435 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 136/269] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:38.840601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce836a4f-1deb-4657-9e59-e60ecc8dba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:38.841286 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce836a4f-1deb-4657-9e59-e60ecc8dba5b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:38.841562 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce836a4f-1deb-4657-9e59-e60ecc8dba5b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:38.841831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce836a4f-1deb-4657-9e59-e60ecc8dba5b None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:38.843184 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce836a4f-1deb-4657-9e59-e60ecc8dba5b None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:38.844632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce836a4f-1deb-4657-9e59-e60ecc8dba5b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:38.848932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 134/270] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:38 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:38.852706 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4e1d7-5a25-4cad-8e31-c241f564e492 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:38.855304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce836a4f-1deb-4657-9e59-e60ecc8dba5b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:38.884221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:38.980455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce836a4f-1deb-4657-9e59-e60ecc8dba5b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:38.985814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4e1d7-5a25-4cad-8e31-c241f564e492 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:38.996971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:39.021913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7f67a-e070-4c5a-bf5d-63261dbfc1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:39.022698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320f3d-c6a1-46a3-b0e8-6a9b2509322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:39.023207 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7f67a-e070-4c5a-bf5d-63261dbfc1ec None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.023400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320f3d-c6a1-46a3-b0e8-6a9b2509322c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.023618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320f3d-c6a1-46a3-b0e8-6a9b2509322c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.023889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd320f3d-c6a1-46a3-b0e8-6a9b2509322c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.024267 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7f67a-e070-4c5a-bf5d-63261dbfc1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.024757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7f67a-e070-4c5a-bf5d-63261dbfc1ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.025778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7f67a-e070-4c5a-bf5d-63261dbfc1ec None admin] RBAC: Adding query filter params (role.id=04a9c139ed6d44d4bcd37b614aeb009e, scope.project.id=4931005296114563946c84a7e790464a, user.id=66e781813546438298e27d5b328540cb) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:39.026306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7f67a-e070-4c5a-bf5d-63261dbfc1ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:39.027975 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7f67a-e070-4c5a-bf5d-63261dbfc1ec None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:39.034739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 135/271] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:38 2022] GET /identity/v3/role_assignments?user.id=66e781813546438298e27d5b328540cb&scope.project.id=4931005296114563946c84a7e790464a&role.id=04a9c139ed6d44d4bcd37b614aeb009e => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:39.036345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2403-cc3f-4aa8-b6ab-7c75a210b416 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.036856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2403-cc3f-4aa8-b6ab-7c75a210b416 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.037389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2403-cc3f-4aa8-b6ab-7c75a210b416 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.039511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 136/272] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:39.044046 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd320f3d-c6a1-46a3-b0e8-6a9b2509322c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:39.045807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275ff81-5b2e-4046-a940-735964cdf681 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.046295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275ff81-5b2e-4046-a940-735964cdf681 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.046765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275ff81-5b2e-4046-a940-735964cdf681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-cd320f3d-c6a1-46a3-b0e8-6a9b2509322c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:39.047061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:39.047906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:39.048717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 137/273] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:39.054510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320f3d-c6a1-46a3-b0e8-6a9b2509322c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:39.082117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3275ff81-5b2e-4046-a940-735964cdf681 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:39.083727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3275ff81-5b2e-4046-a940-735964cdf681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:39.182551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd320f3d-c6a1-46a3-b0e8-6a9b2509322c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:39.198277 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 137/274] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:39.199860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83500d32-393e-43ec-9251-f6d5427f034f None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.200320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83500d32-393e-43ec-9251-f6d5427f034f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.200603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83500d32-393e-43ec-9251-f6d5427f034f None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.204988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 138/275] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:39.208799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa651b-53a3-4747-b4a5-b897d600c928 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.209109 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa651b-53a3-4747-b4a5-b897d600c928 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.209379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa651b-53a3-4747-b4a5-b897d600c928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.237217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbde8a8-c11b-427c-80c1-10fc7a8cb2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:39.238350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbde8a8-c11b-427c-80c1-10fc7a8cb2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.238833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbde8a8-c11b-427c-80c1-10fc7a8cb2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.239090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-45aa651b-53a3-4747-b4a5-b897d600c928 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:39.239515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbde8a8-c11b-427c-80c1-10fc7a8cb2f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.240380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-45aa651b-53a3-4747-b4a5-b897d600c928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:39.240730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbde8a8-c11b-427c-80c1-10fc7a8cb2f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:39.241253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbde8a8-c11b-427c-80c1-10fc7a8cb2f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:39.243014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbde8a8-c11b-427c-80c1-10fc7a8cb2f7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:39.252243 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:39.253898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 138/276] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:39.257222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbde8a8-c11b-427c-80c1-10fc7a8cb2f7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:39.295680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:39.331095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 139/277] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:39.332001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa651b-53a3-4747-b4a5-b897d600c928 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:39.390261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbde8a8-c11b-427c-80c1-10fc7a8cb2f7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:39.426154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf747d41-9946-4845-8e03-5d60f9310230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:39.427632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf747d41-9946-4845-8e03-5d60f9310230 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.428098 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf747d41-9946-4845-8e03-5d60f9310230 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.428566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf747d41-9946-4845-8e03-5d60f9310230 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.430072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf747d41-9946-4845-8e03-5d60f9310230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:39.431830 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf747d41-9946-4845-8e03-5d60f9310230 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:39.433668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 139/278] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:39.434439 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf747d41-9946-4845-8e03-5d60f9310230 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:39.447905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa651b-53a3-4747-b4a5-b897d600c928 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:39.486237 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c03f0-082c-46a3-816b-df829b571bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:39.486915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c03f0-082c-46a3-816b-df829b571bea None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.487187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c03f0-082c-46a3-816b-df829b571bea None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.487456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c03f0-082c-46a3-816b-df829b571bea None admin] PATH_INFO: `/v3/users/a8e6b55243954f48a7ee4302124debb2` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.489239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c03f0-082c-46a3-816b-df829b571bea None admin] RBAC: Authorizing `identity:get_user(user_id=a8e6b55243954f48a7ee4302124debb2)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:39.491483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c03f0-082c-46a3-816b-df829b571bea None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:39.493816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 140/279] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:39 2022] GET /identity/v3/users/a8e6b55243954f48a7ee4302124debb2 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:39.494800 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c03f0-082c-46a3-816b-df829b571bea None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:39.512888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:39.542587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:39.545499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf747d41-9946-4845-8e03-5d60f9310230 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:39.583381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4144e29-9cb9-4a39-ae73-82422a2d51d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:39.584170 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4144e29-9cb9-4a39-ae73-82422a2d51d4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.584450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4144e29-9cb9-4a39-ae73-82422a2d51d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.584726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4144e29-9cb9-4a39-ae73-82422a2d51d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.596394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4144e29-9cb9-4a39-ae73-82422a2d51d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f4144e29-9cb9-4a39-ae73-82422a2d51d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:39.601963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:39.602836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:39.603625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 140/280] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:39.604264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4144e29-9cb9-4a39-ae73-82422a2d51d4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:39.612264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c03f0-082c-46a3-816b-df829b571bea None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:39.647999 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aa1d4-945f-4ac0-bb51-79952bd40099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:39.648543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa1d4-945f-4ac0-bb51-79952bd40099 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.648826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa1d4-945f-4ac0-bb51-79952bd40099 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.649128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa1d4-945f-4ac0-bb51-79952bd40099 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.649810 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8aa1d4-945f-4ac0-bb51-79952bd40099 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:39.651329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8aa1d4-945f-4ac0-bb51-79952bd40099 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:39.676045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 141/281] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:00:39 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:00:39.676879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aa1d4-945f-4ac0-bb51-79952bd40099 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:39.722090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4144e29-9cb9-4a39-ae73-82422a2d51d4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:39.763563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:39.765351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9744f5-ebef-4603-a02b-809f9760969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:39.766031 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9744f5-ebef-4603-a02b-809f9760969e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.766318 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9744f5-ebef-4603-a02b-809f9760969e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.766622 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9744f5-ebef-4603-a02b-809f9760969e None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.767903 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9744f5-ebef-4603-a02b-809f9760969e None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:39.769443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9744f5-ebef-4603-a02b-809f9760969e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:39.771205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 141/282] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:39 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:39.772457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bacf5-2aa5-4b28-aad8-89c54195b5e0 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.772744 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bacf5-2aa5-4b28-aad8-89c54195b5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.773053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bacf5-2aa5-4b28-aad8-89c54195b5e0 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.774504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 142/283] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:39.779448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bacf5-2aa5-4b28-aad8-89c54195b5e0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:39.806965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aa1d4-945f-4ac0-bb51-79952bd40099 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:39.812230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:39.848231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a087e-7b60-4152-b84b-54033a98aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:39.849240 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a087e-7b60-4152-b84b-54033a98aa3a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.849584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a087e-7b60-4152-b84b-54033a98aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.850473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a087e-7b60-4152-b84b-54033a98aa3a None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.851220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a087e-7b60-4152-b84b-54033a98aa3a None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:39.851530 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a087e-7b60-4152-b84b-54033a98aa3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:39.853757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a087e-7b60-4152-b84b-54033a98aa3a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:39.863780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 142/284] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:39.865081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563378d-c473-4e05-93fc-1eb0889f232f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.865370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563378d-c473-4e05-93fc-1eb0889f232f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.865650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563378d-c473-4e05-93fc-1eb0889f232f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.884772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7563378d-c473-4e05-93fc-1eb0889f232f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:39.885998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7563378d-c473-4e05-93fc-1eb0889f232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:39.897843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bacf5-2aa5-4b28-aad8-89c54195b5e0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:39.943773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600652c-21f1-435a-ae7b-9945a83d71d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:39.943954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600652c-21f1-435a-ae7b-9945a83d71d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:39.944657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600652c-21f1-435a-ae7b-9945a83d71d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:39.945524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600652c-21f1-435a-ae7b-9945a83d71d0 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a/users/a8e6b55243954f48a7ee4302124debb2/roles/c179515102c542798ce49a1bf0e8b98a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:39.947471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600652c-21f1-435a-ae7b-9945a83d71d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4931005296114563946c84a7e790464a, user_id=a8e6b55243954f48a7ee4302124debb2, role_id=c179515102c542798ce49a1bf0e8b98a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:39.949681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600652c-21f1-435a-ae7b-9945a83d71d0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:39.968221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 143/285] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:00:39 2022] PUT /identity/v3/projects/4931005296114563946c84a7e790464a/users/a8e6b55243954f48a7ee4302124debb2/roles/c179515102c542798ce49a1bf0e8b98a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:00:39.969803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600652c-21f1-435a-ae7b-9945a83d71d0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:39.974900 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 143/286] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:40.013360 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563378d-c473-4e05-93fc-1eb0889f232f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:40.093882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:40.101067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:40.118405 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600652c-21f1-435a-ae7b-9945a83d71d0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:40.181370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f81f98-d5b7-4e53-b20d-8f2876cf7acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:40.182042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f81f98-d5b7-4e53-b20d-8f2876cf7acd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:40.182323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f81f98-d5b7-4e53-b20d-8f2876cf7acd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:40.182573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563378d-c473-4e05-93fc-1eb0889f232f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:40.182676 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f81f98-d5b7-4e53-b20d-8f2876cf7acd None admin] PATH_INFO: `/v3/users/b053419672944d329f8648528608a1c2` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:40.204499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f81f98-d5b7-4e53-b20d-8f2876cf7acd None admin] RBAC: Authorizing `identity:get_user(user_id=b053419672944d329f8648528608a1c2)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:40.207942 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f81f98-d5b7-4e53-b20d-8f2876cf7acd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:40.210559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 144/287] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:39 2022] GET /identity/v3/users/b053419672944d329f8648528608a1c2 => generated 293 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:40.216421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f81f98-d5b7-4e53-b20d-8f2876cf7acd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:40.230637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c042476-2a10-421b-9cc9-43881498ed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:40.231310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042476-2a10-421b-9cc9-43881498ed03 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:40.231983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042476-2a10-421b-9cc9-43881498ed03 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:40.232283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042476-2a10-421b-9cc9-43881498ed03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:40.246545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c042476-2a10-421b-9cc9-43881498ed03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-4c042476-2a10-421b-9cc9-43881498ed03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:40.254063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:40.254970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:40.255768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:40.255768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:40.255768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:40.255768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:40.255768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:40.255768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:40.255768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:40.255768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:40.255768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:40.255768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:40.255768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:40.255768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:40.256376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 144/288] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:00:40.264181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c042476-2a10-421b-9cc9-43881498ed03 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:40.350320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f81f98-d5b7-4e53-b20d-8f2876cf7acd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:40.386243 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c042476-2a10-421b-9cc9-43881498ed03 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:40.389853 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8def0-e0c6-45bd-83a5-c3cd8523023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:40.389999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8def0-e0c6-45bd-83a5-c3cd8523023b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:40.390185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8def0-e0c6-45bd-83a5-c3cd8523023b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:40.390438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8def0-e0c6-45bd-83a5-c3cd8523023b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:40.391247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8def0-e0c6-45bd-83a5-c3cd8523023b None admin] RBAC: Adding query filter params (role.id=2d65d41d83b24e36b4a751ac3f7fb178, user.id=b053419672944d329f8648528608a1c2, scope.system=all) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:40.391551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8def0-e0c6-45bd-83a5-c3cd8523023b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:40.393186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8def0-e0c6-45bd-83a5-c3cd8523023b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:40.398977 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 145/289] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Aug 5 07:00:40 2022] GET /identity/v3/role_assignments?user.id=b053419672944d329f8648528608a1c2&scope.system=all&role.id=2d65d41d83b24e36b4a751ac3f7fb178 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:40.412148 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:40.431976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3f607-56d8-41fa-a522-2964eaf372f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:40.432617 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f607-56d8-41fa-a522-2964eaf372f7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:40.432914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f607-56d8-41fa-a522-2964eaf372f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:40.433200 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f607-56d8-41fa-a522-2964eaf372f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:40.433940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3f607-56d8-41fa-a522-2964eaf372f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:40.434245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3f607-56d8-41fa-a522-2964eaf372f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:40.435677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3f607-56d8-41fa-a522-2964eaf372f7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:40.445936 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 145/290] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:40.451538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8def0-e0c6-45bd-83a5-c3cd8523023b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:40.468889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:40.591684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8def0-e0c6-45bd-83a5-c3cd8523023b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:40.637854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d883-c3ef-4685-aada-c9524242fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:40.638515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d883-c3ef-4685-aada-c9524242fc0c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:40.638795 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d883-c3ef-4685-aada-c9524242fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:40.639068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d883-c3ef-4685-aada-c9524242fc0c None admin] PATH_INFO: `/v3/users/2ac17340548c458494b293fac4c485ad` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:40.640254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d883-c3ef-4685-aada-c9524242fc0c None admin] RBAC: Authorizing `identity:get_user(user_id=2ac17340548c458494b293fac4c485ad)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:40.641798 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244d883-c3ef-4685-aada-c9524242fc0c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:40.643791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 146/291] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:40 2022] GET /identity/v3/users/2ac17340548c458494b293fac4c485ad => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:40.649420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3f607-56d8-41fa-a522-2964eaf372f7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:40.758073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3f607-56d8-41fa-a522-2964eaf372f7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:40.804970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9771c1-076d-4ddb-8afc-3e53b7df2994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:40.805610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9771c1-076d-4ddb-8afc-3e53b7df2994 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:40.805889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9771c1-076d-4ddb-8afc-3e53b7df2994 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:40.806161 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9771c1-076d-4ddb-8afc-3e53b7df2994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:40.867068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:40.889456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9771c1-076d-4ddb-8afc-3e53b7df2994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:40.890922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9771c1-076d-4ddb-8afc-3e53b7df2994 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:41.021115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 146/292] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:41.030059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d883-c3ef-4685-aada-c9524242fc0c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:41.134422 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:41.160885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d883-c3ef-4685-aada-c9524242fc0c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:41.208787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8e84-c142-4283-b257-2d6231247df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:41.209564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8e84-c142-4283-b257-2d6231247df0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:41.209887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8e84-c142-4283-b257-2d6231247df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:41.210195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8e84-c142-4283-b257-2d6231247df0 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:41.211496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c8e84-c142-4283-b257-2d6231247df0 None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:41.213124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c8e84-c142-4283-b257-2d6231247df0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:41.214981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 147/293] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:41 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:41.221137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9771c1-076d-4ddb-8afc-3e53b7df2994 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:41.331948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:41.358796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9771c1-076d-4ddb-8afc-3e53b7df2994 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:41.423487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91321d2-0f81-4a5b-b3d8-829c277c430e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:41.424188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91321d2-0f81-4a5b-b3d8-829c277c430e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:41.424470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91321d2-0f81-4a5b-b3d8-829c277c430e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:41.424746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91321d2-0f81-4a5b-b3d8-829c277c430e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:41.425587 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91321d2-0f81-4a5b-b3d8-829c277c430e None admin] RBAC: Adding query filter params (role.id=2d65d41d83b24e36b4a751ac3f7fb178, scope.project.id=4931005296114563946c84a7e790464a, user.id=2ac17340548c458494b293fac4c485ad) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:41.425895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91321d2-0f81-4a5b-b3d8-829c277c430e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:41.427347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91321d2-0f81-4a5b-b3d8-829c277c430e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:41.434076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 147/294] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:41 2022] GET /identity/v3/role_assignments?user.id=2ac17340548c458494b293fac4c485ad&scope.project.id=4931005296114563946c84a7e790464a&role.id=2d65d41d83b24e36b4a751ac3f7fb178 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:42.063441 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2eb897-1cee-469e-b0e7-e88c070edce0 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:42.063963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2eb897-1cee-469e-b0e7-e88c070edce0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:42.064070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2eb897-1cee-469e-b0e7-e88c070edce0 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:42.065697 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 148/295] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:42.071196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3640-6f3d-4a5e-bb73-529f34d9f94f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:42.071468 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3640-6f3d-4a5e-bb73-529f34d9f94f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:42.071744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3640-6f3d-4a5e-bb73-529f34d9f94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:42.091515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b31c3640-6f3d-4a5e-bb73-529f34d9f94f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:42.092740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b31c3640-6f3d-4a5e-bb73-529f34d9f94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:42.164524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 148/296] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:42.189142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2eb897-1cee-469e-b0e7-e88c070edce0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:42.303634 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2eb897-1cee-469e-b0e7-e88c070edce0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:42.314882 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed455a-af02-4190-ab6b-82b6e9ad9b9e None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:42.315467 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed455a-af02-4190-ab6b-82b6e9ad9b9e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:42.315938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed455a-af02-4190-ab6b-82b6e9ad9b9e None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:42.317540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 149/297] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:42.322772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651443a-323b-4239-a4d8-5193ec6b5037 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:42.323321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651443a-323b-4239-a4d8-5193ec6b5037 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:42.323792 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651443a-323b-4239-a4d8-5193ec6b5037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:42.339063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bb598-172f-480c-9076-6fe6ee9749f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:42.339724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bb598-172f-480c-9076-6fe6ee9749f9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:42.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bb598-172f-480c-9076-6fe6ee9749f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:42.340272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bb598-172f-480c-9076-6fe6ee9749f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:42.346980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-4651443a-323b-4239-a4d8-5193ec6b5037 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:42.349214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4651443a-323b-4239-a4d8-5193ec6b5037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:42.351229 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bb598-172f-480c-9076-6fe6ee9749f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-fd1bb598-172f-480c-9076-6fe6ee9749f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:42.356488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:42.357414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:42.358193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 149/298] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:42.364098 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bb598-172f-480c-9076-6fe6ee9749f9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:42.376114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:42.456944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 150/299] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:42.479828 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651443a-323b-4239-a4d8-5193ec6b5037 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:42.486380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bb598-172f-480c-9076-6fe6ee9749f9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:42.494829 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:42.525969 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da73346-6301-4d47-a679-9e191da47f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:42.526953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da73346-6301-4d47-a679-9e191da47f23 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:42.527402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da73346-6301-4d47-a679-9e191da47f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:42.527880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da73346-6301-4d47-a679-9e191da47f23 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:42.528783 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da73346-6301-4d47-a679-9e191da47f23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:42.529278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da73346-6301-4d47-a679-9e191da47f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:42.530818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da73346-6301-4d47-a679-9e191da47f23 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:42.540936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 150/300] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:42.542596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd98ca7-117a-4aa4-8379-a99cbce04f82 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:42.542878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd98ca7-117a-4aa4-8379-a99cbce04f82 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:42.543149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd98ca7-117a-4aa4-8379-a99cbce04f82 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:42.544355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 151/301] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:42.546344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd98ca7-117a-4aa4-8379-a99cbce04f82 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:42.599074 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651443a-323b-4239-a4d8-5193ec6b5037 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:42.623554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:42.637029 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce32fd-2517-4dbb-9006-e7cf3636e2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:42.637679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce32fd-2517-4dbb-9006-e7cf3636e2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:42.637973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce32fd-2517-4dbb-9006-e7cf3636e2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:42.638237 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce32fd-2517-4dbb-9006-e7cf3636e2f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:42.639363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce32fd-2517-4dbb-9006-e7cf3636e2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:42.640800 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce32fd-2517-4dbb-9006-e7cf3636e2f6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:42.642425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 151/302] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:42.642425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf83d70-03d4-47d5-8700-155b2aac2f01 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:42.642425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf83d70-03d4-47d5-8700-155b2aac2f01 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:42.642425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf83d70-03d4-47d5-8700-155b2aac2f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:42.663057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-4cf83d70-03d4-47d5-8700-155b2aac2f01 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:42.664622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4cf83d70-03d4-47d5-8700-155b2aac2f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:42.667533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd98ca7-117a-4aa4-8379-a99cbce04f82 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:42.702970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cd219-44e6-4236-abc4-d4d5ba9bf7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:42.703638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cd219-44e6-4236-abc4-d4d5ba9bf7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:42.703927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cd219-44e6-4236-abc4-d4d5ba9bf7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:42.704201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cd219-44e6-4236-abc4-d4d5ba9bf7b4 None admin] PATH_INFO: `/v3/users/c7f66fe53c364c8aab857ad42a3c1c79` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:42.719478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cd219-44e6-4236-abc4-d4d5ba9bf7b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c7f66fe53c364c8aab857ad42a3c1c79)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:42.721317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cd219-44e6-4236-abc4-d4d5ba9bf7b4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:42.728041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 152/303] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:42 2022] GET /identity/v3/users/c7f66fe53c364c8aab857ad42a3c1c79 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:42.728041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cd219-44e6-4236-abc4-d4d5ba9bf7b4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:42.739981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 152/304] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:42.740653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf83d70-03d4-47d5-8700-155b2aac2f01 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:42.744497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:42.838463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cd219-44e6-4236-abc4-d4d5ba9bf7b4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:42.848650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf83d70-03d4-47d5-8700-155b2aac2f01 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:42.865721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:42.874842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfc3af-daa4-48c3-abf6-b033a9ec6236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:42.875476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfc3af-daa4-48c3-abf6-b033a9ec6236 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:42.875750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfc3af-daa4-48c3-abf6-b033a9ec6236 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:42.876025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfc3af-daa4-48c3-abf6-b033a9ec6236 None admin] PATH_INFO: `/v3/groups` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:42.876685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfc3af-daa4-48c3-abf6-b033a9ec6236 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:42.878173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfc3af-daa4-48c3-abf6-b033a9ec6236 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:42.891539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaafa6c-2690-435c-bb5e-fa01e3a9c3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:42.892653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaafa6c-2690-435c-bb5e-fa01e3a9c3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:42.893184 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaafa6c-2690-435c-bb5e-fa01e3a9c3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:42.893654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaafa6c-2690-435c-bb5e-fa01e3a9c3c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:42.894671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaafa6c-2690-435c-bb5e-fa01e3a9c3c9 None admin] RBAC: Adding query filter params (role.id=c179515102c542798ce49a1bf0e8b98a, user.id=c7f66fe53c364c8aab857ad42a3c1c79, scope.system=all) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:42.895158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaafa6c-2690-435c-bb5e-fa01e3a9c3c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:42.896246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 153/305] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Aug 5 07:00:42 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:00:42.897137 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfc3af-daa4-48c3-abf6-b033a9ec6236 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:42.897290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaafa6c-2690-435c-bb5e-fa01e3a9c3c9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:42.917400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 153/306] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Aug 5 07:00:42 2022] GET /identity/v3/role_assignments?user.id=c7f66fe53c364c8aab857ad42a3c1c79&scope.system=all&role.id=c179515102c542798ce49a1bf0e8b98a => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:43.030725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0b9ce-87f9-47bb-b502-869792c8d506 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:43.031098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0b9ce-87f9-47bb-b502-869792c8d506 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:43.031291 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0b9ce-87f9-47bb-b502-869792c8d506 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:43.033003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 154/307] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:00:43.037246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfc3af-daa4-48c3-abf6-b033a9ec6236 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:43.038625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff732c-9ea6-475a-bd28-5577e2e62233 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:43.039260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff732c-9ea6-475a-bd28-5577e2e62233 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:43.039540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff732c-9ea6-475a-bd28-5577e2e62233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:43.066458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c9ff732c-9ea6-475a-bd28-5577e2e62233 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:43.068111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c9ff732c-9ea6-475a-bd28-5577e2e62233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:43.089685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b23c9-4e5d-4d85-97e7-a9cf792b96cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:43.091411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b23c9-4e5d-4d85-97e7-a9cf792b96cd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:43.091893 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b23c9-4e5d-4d85-97e7-a9cf792b96cd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:43.092526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b23c9-4e5d-4d85-97e7-a9cf792b96cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:43.107962 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b23c9-4e5d-4d85-97e7-a9cf792b96cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4d0b23c9-4e5d-4d85-97e7-a9cf792b96cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:43.113901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:43.114821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:43.115590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:43.115590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:43.115590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:43.115590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:43.115590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:43.115590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:43.115590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:43.115590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:43.115590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:43.115590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:43.115590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:43.115590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:43.117799 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 154/308] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:43.123883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b23c9-4e5d-4d85-97e7-a9cf792b96cd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:43.159682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:43.167064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 155/309] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:43.184010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:43.190438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff732c-9ea6-475a-bd28-5577e2e62233 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:43.260129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b23c9-4e5d-4d85-97e7-a9cf792b96cd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:43.306203 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1809-6724-4b1c-ba88-9e66a053ce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:43.306802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff732c-9ea6-475a-bd28-5577e2e62233 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:43.306933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1809-6724-4b1c-ba88-9e66a053ce4e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:43.307164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1809-6724-4b1c-ba88-9e66a053ce4e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:43.307443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1809-6724-4b1c-ba88-9e66a053ce4e None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:43.308275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb1809-6724-4b1c-ba88-9e66a053ce4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:43.308584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb1809-6724-4b1c-ba88-9e66a053ce4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:43.311267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb1809-6724-4b1c-ba88-9e66a053ce4e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:43.324995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 155/310] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:43.329179 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1809-6724-4b1c-ba88-9e66a053ce4e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:43.350753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47286d-fdae-44ce-9963-29d1b8110569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:43.352171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47286d-fdae-44ce-9963-29d1b8110569 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:43.352675 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47286d-fdae-44ce-9963-29d1b8110569 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:43.353190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47286d-fdae-44ce-9963-29d1b8110569 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:43.365522 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47286d-fdae-44ce-9963-29d1b8110569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-1a47286d-fdae-44ce-9963-29d1b8110569 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:43.371539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:43.372421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:43.373264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:43.373264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:43.373264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:43.373264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:43.373264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:43.373264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:43.373264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:43.373264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:43.373264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:43.373264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:43.373264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:43.373264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:43.380819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 156/311] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:43.382222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47286d-fdae-44ce-9963-29d1b8110569 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:43.452556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:43.464997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1809-6724-4b1c-ba88-9e66a053ce4e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:43.478044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:43.502603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47286d-fdae-44ce-9963-29d1b8110569 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:43.509048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8095a8-8097-4d19-b376-2b9442913c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:43.509715 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8095a8-8097-4d19-b376-2b9442913c5c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:43.510056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8095a8-8097-4d19-b376-2b9442913c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:43.510332 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8095a8-8097-4d19-b376-2b9442913c5c None admin] PATH_INFO: `/v3/users/a8e6b55243954f48a7ee4302124debb2` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:43.511529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8095a8-8097-4d19-b376-2b9442913c5c None admin] RBAC: Authorizing `identity:get_user(user_id=a8e6b55243954f48a7ee4302124debb2)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:43.513003 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8095a8-8097-4d19-b376-2b9442913c5c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:43.519478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 156/312] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:43 2022] GET /identity/v3/users/a8e6b55243954f48a7ee4302124debb2 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:43.520933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8095a8-8097-4d19-b376-2b9442913c5c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:43.548155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3322-ceb0-411b-bf5c-eefb2a2f4b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:43.549543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3322-ceb0-411b-bf5c-eefb2a2f4b0b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:43.550495 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3322-ceb0-411b-bf5c-eefb2a2f4b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:43.550977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3322-ceb0-411b-bf5c-eefb2a2f4b0b None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:43.552181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c3322-ceb0-411b-bf5c-eefb2a2f4b0b None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:43.552925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c3322-ceb0-411b-bf5c-eefb2a2f4b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:43.555246 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c3322-ceb0-411b-bf5c-eefb2a2f4b0b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:43.569689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 157/313] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:43.577947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3322-ceb0-411b-bf5c-eefb2a2f4b0b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:43.639091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8095a8-8097-4d19-b376-2b9442913c5c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:43.681001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11326c2a-0776-4d88-bd26-f21275d92ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:43.682034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11326c2a-0776-4d88-bd26-f21275d92ccc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:43.682938 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11326c2a-0776-4d88-bd26-f21275d92ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:43.683402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11326c2a-0776-4d88-bd26-f21275d92ccc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:43.707177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3322-ceb0-411b-bf5c-eefb2a2f4b0b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:43.728985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:43.744662 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3556d-b211-44a5-8ba8-aab6a9724dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:43.745354 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3556d-b211-44a5-8ba8-aab6a9724dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:43.745680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3556d-b211-44a5-8ba8-aab6a9724dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:43.745863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:43.745960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3556d-b211-44a5-8ba8-aab6a9724dd4 None admin] PATH_INFO: `/v3/users/b053419672944d329f8648528608a1c2` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:43.747641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3556d-b211-44a5-8ba8-aab6a9724dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=b053419672944d329f8648528608a1c2)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:43.749024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3556d-b211-44a5-8ba8-aab6a9724dd4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:43.750795 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 158/314] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:43 2022] GET /identity/v3/users/b053419672944d329f8648528608a1c2 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:43.756969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3556d-b211-44a5-8ba8-aab6a9724dd4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:43.777993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11326c2a-0776-4d88-bd26-f21275d92ccc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:43.779809 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11326c2a-0776-4d88-bd26-f21275d92ccc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:43.863317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3556d-b211-44a5-8ba8-aab6a9724dd4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:43.889679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 157/315] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:43.895926 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11326c2a-0776-4d88-bd26-f21275d92ccc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:43.905061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806f230-a554-46be-af53-18f0e95c9144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:43.905994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806f230-a554-46be-af53-18f0e95c9144 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:43.905994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806f230-a554-46be-af53-18f0e95c9144 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:43.906320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806f230-a554-46be-af53-18f0e95c9144 None admin] PATH_INFO: `/v3/system/users/b053419672944d329f8648528608a1c2/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:43.907777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806f230-a554-46be-af53-18f0e95c9144 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b053419672944d329f8648528608a1c2, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:43.909314 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806f230-a554-46be-af53-18f0e95c9144 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:43.924950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 159/316] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Aug 5 07:00:43 2022] PUT /identity/v3/system/users/b053419672944d329f8648528608a1c2/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:43.993774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:44.021660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11326c2a-0776-4d88-bd26-f21275d92ccc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:44.063367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f1580-d8e4-4c6f-90e6-66cf03618953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:44.064053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f1580-d8e4-4c6f-90e6-66cf03618953 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:44.064358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f1580-d8e4-4c6f-90e6-66cf03618953 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:44.064755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f1580-d8e4-4c6f-90e6-66cf03618953 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:44.066246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f1580-d8e4-4c6f-90e6-66cf03618953 None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:44.067710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f1580-d8e4-4c6f-90e6-66cf03618953 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:44.070042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 158/317] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:43 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:44.076653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806f230-a554-46be-af53-18f0e95c9144 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:44.137997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:44.192832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806f230-a554-46be-af53-18f0e95c9144 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:44.228351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffee294-df27-4fc3-8ee9-77e6492796be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:44.229066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffee294-df27-4fc3-8ee9-77e6492796be None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:44.229347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffee294-df27-4fc3-8ee9-77e6492796be None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:44.229670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffee294-df27-4fc3-8ee9-77e6492796be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:44.230470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffee294-df27-4fc3-8ee9-77e6492796be None admin] RBAC: Adding query filter params (role.id=c179515102c542798ce49a1bf0e8b98a, scope.project.id=4931005296114563946c84a7e790464a, user.id=a8e6b55243954f48a7ee4302124debb2) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:44.230778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffee294-df27-4fc3-8ee9-77e6492796be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:44.232226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffee294-df27-4fc3-8ee9-77e6492796be None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:44.245059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 160/318] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:00:44 2022] GET /identity/v3/role_assignments?user.id=a8e6b55243954f48a7ee4302124debb2&scope.project.id=4931005296114563946c84a7e790464a&role.id=c179515102c542798ce49a1bf0e8b98a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:44.972495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bbbe0-ef61-4a7b-a403-d2d532faeddb None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:44.973088 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bbbe0-ef61-4a7b-a403-d2d532faeddb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:44.973088 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bbbe0-ef61-4a7b-a403-d2d532faeddb None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:44.974602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 159/319] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:44.979921 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175cc5e-ecd9-45fb-94b8-d63e4ee449a2 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:44.980352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175cc5e-ecd9-45fb-94b8-d63e4ee449a2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:44.980530 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175cc5e-ecd9-45fb-94b8-d63e4ee449a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:44.999225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9175cc5e-ecd9-45fb-94b8-d63e4ee449a2 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:45.000444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9175cc5e-ecd9-45fb-94b8-d63e4ee449a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:45.071113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 161/320] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:45.074370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8dc5-b0bd-4f93-b7d6-01ceb2ee645a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:45.074657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8dc5-b0bd-4f93-b7d6-01ceb2ee645a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:45.074925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f8dc5-b0bd-4f93-b7d6-01ceb2ee645a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:45.076370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 160/321] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:45.081441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7ed29-9a23-4a9c-8f93-ccf0aff276d2 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:45.081723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7ed29-9a23-4a9c-8f93-ccf0aff276d2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:45.081998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7ed29-9a23-4a9c-8f93-ccf0aff276d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:45.092453 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8dc5-b0bd-4f93-b7d6-01ceb2ee645a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:45.101176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-14c7ed29-9a23-4a9c-8f93-ccf0aff276d2 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:45.102850 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-14c7ed29-9a23-4a9c-8f93-ccf0aff276d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:45.149357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:45.175744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 162/322] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:45.197711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7ed29-9a23-4a9c-8f93-ccf0aff276d2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:45.201635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f8dc5-b0bd-4f93-b7d6-01ceb2ee645a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:45.239777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad71dd-ea10-4f7d-ab2a-9e163e06c741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:45.240751 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad71dd-ea10-4f7d-ab2a-9e163e06c741 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:45.241217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad71dd-ea10-4f7d-ab2a-9e163e06c741 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:45.241620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad71dd-ea10-4f7d-ab2a-9e163e06c741 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:45.254293 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad71dd-ea10-4f7d-ab2a-9e163e06c741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6dad71dd-ea10-4f7d-ab2a-9e163e06c741 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:45.259806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:45.260722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:45.261543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 161/323] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:00:45.266141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad71dd-ea10-4f7d-ab2a-9e163e06c741 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:45.271499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:45.312057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7ed29-9a23-4a9c-8f93-ccf0aff276d2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:45.347576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fd502-a75b-4d5b-8fdd-914b8c771d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:45.348236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fd502-a75b-4d5b-8fdd-914b8c771d95 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:45.348525 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fd502-a75b-4d5b-8fdd-914b8c771d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:45.348796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fd502-a75b-4d5b-8fdd-914b8c771d95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:45.350031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fd502-a75b-4d5b-8fdd-914b8c771d95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:45.351552 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fd502-a75b-4d5b-8fdd-914b8c771d95 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:45.353432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 163/324] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:00:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:45.358838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fd502-a75b-4d5b-8fdd-914b8c771d95 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:45.375766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad71dd-ea10-4f7d-ab2a-9e163e06c741 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:45.404719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:45.415238 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412677fd-0001-471c-bcea-8aff484b6d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:45.415874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412677fd-0001-471c-bcea-8aff484b6d6c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:45.416160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412677fd-0001-471c-bcea-8aff484b6d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:45.416434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412677fd-0001-471c-bcea-8aff484b6d6c None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:45.417194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412677fd-0001-471c-bcea-8aff484b6d6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:45.417497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412677fd-0001-471c-bcea-8aff484b6d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:45.418876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412677fd-0001-471c-bcea-8aff484b6d6c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:45.433138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 162/325] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:45.434195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412677fd-0001-471c-bcea-8aff484b6d6c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:45.469974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fd502-a75b-4d5b-8fdd-914b8c771d95 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:45.506898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:45.509966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0de8f-e444-4772-b2af-716e88fad3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:45.510729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0de8f-e444-4772-b2af-716e88fad3e9 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:45.511017 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0de8f-e444-4772-b2af-716e88fad3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:45.511285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0de8f-e444-4772-b2af-716e88fad3e9 None admin] PATH_INFO: `/v3/groups` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:45.512003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0de8f-e444-4772-b2af-716e88fad3e9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:45.513510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0de8f-e444-4772-b2af-716e88fad3e9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:45.544925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 164/326] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Aug 5 07:00:45 2022] POST /identity/v3/groups => generated 226 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:00:45.560592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412677fd-0001-471c-bcea-8aff484b6d6c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:45.601412 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e094e2-a4a2-4bac-aceb-8429ae584d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:45.602082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e094e2-a4a2-4bac-aceb-8429ae584d36 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:45.602360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e094e2-a4a2-4bac-aceb-8429ae584d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:45.602633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e094e2-a4a2-4bac-aceb-8429ae584d36 None admin] PATH_INFO: `/v3/users/c7f66fe53c364c8aab857ad42a3c1c79` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:45.603888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e094e2-a4a2-4bac-aceb-8429ae584d36 None admin] RBAC: Authorizing `identity:get_user(user_id=c7f66fe53c364c8aab857ad42a3c1c79)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:45.605415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e094e2-a4a2-4bac-aceb-8429ae584d36 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:45.607360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 163/327] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:45 2022] GET /identity/v3/users/c7f66fe53c364c8aab857ad42a3c1c79 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:45.613261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0de8f-e444-4772-b2af-716e88fad3e9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:45.729790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0de8f-e444-4772-b2af-716e88fad3e9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:45.732595 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:45.770086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6d280-3cde-4d0b-a9c1-16a2490706b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:45.770695 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6d280-3cde-4d0b-a9c1-16a2490706b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:45.770968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6d280-3cde-4d0b-a9c1-16a2490706b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:45.771240 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6d280-3cde-4d0b-a9c1-16a2490706b3 None admin] PATH_INFO: `/v3/system/users/c7f66fe53c364c8aab857ad42a3c1c79/roles/c179515102c542798ce49a1bf0e8b98a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:45.772728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6d280-3cde-4d0b-a9c1-16a2490706b3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c7f66fe53c364c8aab857ad42a3c1c79, role_id=c179515102c542798ce49a1bf0e8b98a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:45.774168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6d280-3cde-4d0b-a9c1-16a2490706b3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:45.782183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 165/328] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Aug 5 07:00:45 2022] PUT /identity/v3/system/users/c7f66fe53c364c8aab857ad42a3c1c79/roles/c179515102c542798ce49a1bf0e8b98a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:46.017285 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974af8a9-030f-4791-9fef-5c655bd9678f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:46.017888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974af8a9-030f-4791-9fef-5c655bd9678f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:46.017888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974af8a9-030f-4791-9fef-5c655bd9678f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:46.019252 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 164/329] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:46.025415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bed52-df91-405f-8c82-bb5e93290940 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:46.026140 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bed52-df91-405f-8c82-bb5e93290940 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:46.026140 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bed52-df91-405f-8c82-bb5e93290940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:46.047442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-cb5bed52-df91-405f-8c82-bb5e93290940 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:46.048656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cb5bed52-df91-405f-8c82-bb5e93290940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:46.129013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 166/330] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:46.147625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974af8a9-030f-4791-9fef-5c655bd9678f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:46.273725 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974af8a9-030f-4791-9fef-5c655bd9678f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:46.318335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232f907-990d-449f-9260-353f862ae600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:46.319021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232f907-990d-449f-9260-353f862ae600 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:46.319354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232f907-990d-449f-9260-353f862ae600 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:46.319633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232f907-990d-449f-9260-353f862ae600 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:46.322056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:46.333033 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232f907-990d-449f-9260-353f862ae600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7232f907-990d-449f-9260-353f862ae600 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:46.338854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:46.339759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:46.340521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:46.340521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:46.340521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:46.340521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:46.340521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:46.340521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:46.340521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:46.340521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:46.340521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:46.340521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:46.340521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:46.340521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:46.345045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 165/331] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:46.346929 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bed52-df91-405f-8c82-bb5e93290940 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:46.456628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:46.460862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bed52-df91-405f-8c82-bb5e93290940 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:46.497627 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a9249-33db-4a63-b2ba-eae73d1c2c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:46.498280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a9249-33db-4a63-b2ba-eae73d1c2c8f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:46.498557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a9249-33db-4a63-b2ba-eae73d1c2c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:46.498828 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a9249-33db-4a63-b2ba-eae73d1c2c8f None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:46.499560 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a9249-33db-4a63-b2ba-eae73d1c2c8f None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:46.499866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a9249-33db-4a63-b2ba-eae73d1c2c8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:46.501309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a9249-33db-4a63-b2ba-eae73d1c2c8f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:46.511067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 167/332] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:46.516993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232f907-990d-449f-9260-353f862ae600 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:46.630045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232f907-990d-449f-9260-353f862ae600 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:46.671506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e80b3-dd6e-48bf-9025-c9f87d58b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:46.672178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e80b3-dd6e-48bf-9025-c9f87d58b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:46.672459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e80b3-dd6e-48bf-9025-c9f87d58b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:46.672736 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e80b3-dd6e-48bf-9025-c9f87d58b6c0 None admin] PATH_INFO: `/v3/users/b053419672944d329f8648528608a1c2` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:46.674074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e80b3-dd6e-48bf-9025-c9f87d58b6c0 None admin] RBAC: Authorizing `identity:get_user(user_id=b053419672944d329f8648528608a1c2)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:46.675538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e80b3-dd6e-48bf-9025-c9f87d58b6c0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:46.677195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 166/333] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:46 2022] GET /identity/v3/users/b053419672944d329f8648528608a1c2 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:46.685689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a9249-33db-4a63-b2ba-eae73d1c2c8f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:46.805567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a9249-33db-4a63-b2ba-eae73d1c2c8f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:46.842459 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d4b51-052c-4e45-a0ff-a17eaefffa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:46.843155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4b51-052c-4e45-a0ff-a17eaefffa98 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:46.843434 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4b51-052c-4e45-a0ff-a17eaefffa98 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:46.843917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d4b51-052c-4e45-a0ff-a17eaefffa98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:46.844676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d4b51-052c-4e45-a0ff-a17eaefffa98 None admin] RBAC: Adding query filter params (role.id=2d65d41d83b24e36b4a751ac3f7fb178, user.id=b053419672944d329f8648528608a1c2, scope.system=all) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:46.845029 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d4b51-052c-4e45-a0ff-a17eaefffa98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:46.846530 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d4b51-052c-4e45-a0ff-a17eaefffa98 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:46.859628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 168/334] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Aug 5 07:00:46 2022] GET /identity/v3/role_assignments?user.id=b053419672944d329f8648528608a1c2&scope.system=all&role.id=2d65d41d83b24e36b4a751ac3f7fb178 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:48.221074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b926c84-7af2-43f8-9d7a-36a66e6dffb4 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:48.221598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b926c84-7af2-43f8-9d7a-36a66e6dffb4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:48.221598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b926c84-7af2-43f8-9d7a-36a66e6dffb4 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:48.223301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 167/335] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:48.229036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23d9a8-7c23-4291-8664-f46773f00c5e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:48.229434 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23d9a8-7c23-4291-8664-f46773f00c5e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:48.229601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23d9a8-7c23-4291-8664-f46773f00c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:48.251251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-1a23d9a8-7c23-4291-8664-f46773f00c5e None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:48.252528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1a23d9a8-7c23-4291-8664-f46773f00c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:48.267530 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:48.333082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 169/336] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:48.352025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b926c84-7af2-43f8-9d7a-36a66e6dffb4 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:48.424539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:48.473613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b926c84-7af2-43f8-9d7a-36a66e6dffb4 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:48.517730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9ea17-e604-4c82-945d-d9758536bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:48.518392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9ea17-e604-4c82-945d-d9758536bf8e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:48.518673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9ea17-e604-4c82-945d-d9758536bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:48.518948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9ea17-e604-4c82-945d-d9758536bf8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:48.526274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a0609-737e-4108-953c-590b13f00236 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:48.526569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a0609-737e-4108-953c-590b13f00236 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:48.526827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a0609-737e-4108-953c-590b13f00236 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:48.528212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 170/337] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:00:48.533446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66834ba3-76ea-4d45-abbe-1404f06a7a4e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:48.533729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66834ba3-76ea-4d45-abbe-1404f06a7a4e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:48.534003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66834ba3-76ea-4d45-abbe-1404f06a7a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:48.540689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9ea17-e604-4c82-945d-d9758536bf8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-72a9ea17-e604-4c82-945d-d9758536bf8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:48.546322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:48.547214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:48.547997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:48.547997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:48.547997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:48.547997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:48.547997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:48.547997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:48.547997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:48.547997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:48.547997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:48.547997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:48.547997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:48.547997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:48.552524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 168/338] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:00:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:48.553799 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9ea17-e604-4c82-945d-d9758536bf8e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:48.570009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-66834ba3-76ea-4d45-abbe-1404f06a7a4e None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:48.571231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-66834ba3-76ea-4d45-abbe-1404f06a7a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:48.697737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 171/339] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:48.711405 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9ea17-e604-4c82-945d-d9758536bf8e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:48.744801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:48.746859 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66834ba3-76ea-4d45-abbe-1404f06a7a4e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:48.767688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7e803-affb-4766-a3a7-43533e6788f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:48.768814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7e803-affb-4766-a3a7-43533e6788f8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:48.769319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7e803-affb-4766-a3a7-43533e6788f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:48.769968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7e803-affb-4766-a3a7-43533e6788f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:48.772243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7e803-affb-4766-a3a7-43533e6788f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:48.772746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7e803-affb-4766-a3a7-43533e6788f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:48.774500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7e803-affb-4766-a3a7-43533e6788f8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:48.787694 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 169/340] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:00:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:48.791246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7e803-affb-4766-a3a7-43533e6788f8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:48.875483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:48.907890 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66834ba3-76ea-4d45-abbe-1404f06a7a4e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:48.963221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7e803-affb-4766-a3a7-43533e6788f8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:48.966813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71209a-b029-499f-92d2-9e32e28041c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:48.966813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71209a-b029-499f-92d2-9e32e28041c0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:48.966813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71209a-b029-499f-92d2-9e32e28041c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:48.966813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71209a-b029-499f-92d2-9e32e28041c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:48.990734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71209a-b029-499f-92d2-9e32e28041c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9b71209a-b029-499f-92d2-9e32e28041c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:48.995869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:48.996731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:48.997556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:48.997556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:48.997556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:48.997556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:48.997556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:48.997556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:48.997556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:48.997556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:48.997556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:48.997556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:48.997556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:48.997556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:49.005441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 172/341] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:49.010102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dc81a-5275-418c-bf32-64794b665c5b None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:49.010355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dc81a-5275-418c-bf32-64794b665c5b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:49.010624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dc81a-5275-418c-bf32-64794b665c5b None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:49.012191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 173/342] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:49.012954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dc81a-5275-418c-bf32-64794b665c5b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:49.038496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdb8c0-cf38-40ec-890a-08a7a9639ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:49.039916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb8c0-cf38-40ec-890a-08a7a9639ecf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:49.040435 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb8c0-cf38-40ec-890a-08a7a9639ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:49.040981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb8c0-cf38-40ec-890a-08a7a9639ecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:49.141302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:49.153221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdb8c0-cf38-40ec-890a-08a7a9639ecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:49.155531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdb8c0-cf38-40ec-890a-08a7a9639ecf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:49.236446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dc81a-5275-418c-bf32-64794b665c5b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:49.285056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1f939-c810-4d9a-931b-8ee6c1ab5179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:49.287856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1f939-c810-4d9a-931b-8ee6c1ab5179 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:49.287856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1f939-c810-4d9a-931b-8ee6c1ab5179 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:49.287856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1f939-c810-4d9a-931b-8ee6c1ab5179 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:49.287856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1f939-c810-4d9a-931b-8ee6c1ab5179 None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:49.287856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1f939-c810-4d9a-931b-8ee6c1ab5179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:49.290180 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1f939-c810-4d9a-931b-8ee6c1ab5179 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:49.295712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:49.305519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 174/343] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:49.306896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f395b9-0475-4aae-8501-a85dbb54efb0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:49.307178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f395b9-0475-4aae-8501-a85dbb54efb0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:49.307450 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f395b9-0475-4aae-8501-a85dbb54efb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:49.329582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-51f395b9-0475-4aae-8501-a85dbb54efb0 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:49.330944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-51f395b9-0475-4aae-8501-a85dbb54efb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:49.333060 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 170/344] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:49.335026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256280f-15f9-401a-bd37-978e0e9ed838 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:49.335521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256280f-15f9-401a-bd37-978e0e9ed838 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:49.336017 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256280f-15f9-401a-bd37-978e0e9ed838 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:49.337775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 171/345] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:49.339023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256280f-15f9-401a-bd37-978e0e9ed838 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:49.433948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 175/346] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:49.437938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f395b9-0475-4aae-8501-a85dbb54efb0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:49.454664 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:49.474608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256280f-15f9-401a-bd37-978e0e9ed838 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:49.515882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832702d0-d7de-4ed3-a3d2-6736c42da384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:49.516874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832702d0-d7de-4ed3-a3d2-6736c42da384 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:49.517538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832702d0-d7de-4ed3-a3d2-6736c42da384 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:49.518032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832702d0-d7de-4ed3-a3d2-6736c42da384 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:49.556443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f395b9-0475-4aae-8501-a85dbb54efb0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:49.588776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:49.596108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c22edf-fd11-4001-84f1-957628cac641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:49.597429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c22edf-fd11-4001-84f1-957628cac641 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:49.598205 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c22edf-fd11-4001-84f1-957628cac641 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:49.598711 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832702d0-d7de-4ed3-a3d2-6736c42da384 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:49.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c22edf-fd11-4001-84f1-957628cac641 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:49.599984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c22edf-fd11-4001-84f1-957628cac641 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:49.601198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832702d0-d7de-4ed3-a3d2-6736c42da384 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:49.601861 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c22edf-fd11-4001-84f1-957628cac641 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:49.604080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 176/347] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:49 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:49.606040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be327b8-ff40-4d79-92cd-18329b14f8d5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:49.606040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be327b8-ff40-4d79-92cd-18329b14f8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:49.606242 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be327b8-ff40-4d79-92cd-18329b14f8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:49.627291 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5be327b8-ff40-4d79-92cd-18329b14f8d5 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:49.627641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5be327b8-ff40-4d79-92cd-18329b14f8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:49.704778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 177/348] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:49.705025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:49.705804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be327b8-ff40-4d79-92cd-18329b14f8d5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:49.741581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 172/349] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:49.742840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832702d0-d7de-4ed3-a3d2-6736c42da384 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:49.836440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be327b8-ff40-4d79-92cd-18329b14f8d5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:49.868451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832702d0-d7de-4ed3-a3d2-6736c42da384 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:49.875201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:49.889202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c581a-bb8d-4e17-a1d4-350aa3d27d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:49.890177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c581a-bb8d-4e17-a1d4-350aa3d27d7a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:49.890465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c581a-bb8d-4e17-a1d4-350aa3d27d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:49.890739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c581a-bb8d-4e17-a1d4-350aa3d27d7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:49.902767 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c581a-bb8d-4e17-a1d4-350aa3d27d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-534c581a-bb8d-4e17-a1d4-350aa3d27d7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:49.907880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:49.908952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:49.909776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 178/350] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:49.910807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74539e79-f8fb-426d-b67b-b8d1604b7e43 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:49.910947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74539e79-f8fb-426d-b67b-b8d1604b7e43 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:49.911536 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74539e79-f8fb-426d-b67b-b8d1604b7e43 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:49.911644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478451e8-68ad-4be6-8a2b-e410429dbaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:49.912351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478451e8-68ad-4be6-8a2b-e410429dbaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:49.912687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478451e8-68ad-4be6-8a2b-e410429dbaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:49.914027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478451e8-68ad-4be6-8a2b-e410429dbaf3 None admin] PATH_INFO: `/v3/groups/628fcd5514ef426e94e58250b16c246f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:49.918363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 179/351] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:49.919343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74539e79-f8fb-426d-b67b-b8d1604b7e43 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:49.920681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478451e8-68ad-4be6-8a2b-e410429dbaf3 None admin] RBAC: Authorizing `identity:get_group(group_id=628fcd5514ef426e94e58250b16c246f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:49.922387 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478451e8-68ad-4be6-8a2b-e410429dbaf3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:49.924541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 173/352] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:00:49 2022] GET /identity/v3/groups/628fcd5514ef426e94e58250b16c246f => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:49.925401 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478451e8-68ad-4be6-8a2b-e410429dbaf3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:49.986033 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:50.048546 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478451e8-68ad-4be6-8a2b-e410429dbaf3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:50.060639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74539e79-f8fb-426d-b67b-b8d1604b7e43 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:50.097567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5172e-63e1-4794-a730-d3611cb65edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:50.098603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5172e-63e1-4794-a730-d3611cb65edc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:50.098874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5172e-63e1-4794-a730-d3611cb65edc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:50.099152 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5172e-63e1-4794-a730-d3611cb65edc None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:50.101284 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5172e-63e1-4794-a730-d3611cb65edc None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:50.102758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5172e-63e1-4794-a730-d3611cb65edc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:50.104459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 174/353] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:49 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:50.105367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae1b8f-8298-4222-ad16-aa0719f7bb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:50.106224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae1b8f-8298-4222-ad16-aa0719f7bb05 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:50.106503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae1b8f-8298-4222-ad16-aa0719f7bb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:50.106775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae1b8f-8298-4222-ad16-aa0719f7bb05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:50.109731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5172e-63e1-4794-a730-d3611cb65edc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:50.121003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae1b8f-8298-4222-ad16-aa0719f7bb05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-09ae1b8f-8298-4222-ad16-aa0719f7bb05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:50.125968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:50.126924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:50.127698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 180/354] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:50.129316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31702802-5ee5-4f1d-8668-cd7d83bafd34 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:50.129316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31702802-5ee5-4f1d-8668-cd7d83bafd34 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:50.129316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31702802-5ee5-4f1d-8668-cd7d83bafd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:50.150966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-31702802-5ee5-4f1d-8668-cd7d83bafd34 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:50.152951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-31702802-5ee5-4f1d-8668-cd7d83bafd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:50.213107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:50.242861 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 181/355] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:50.244440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31702802-5ee5-4f1d-8668-cd7d83bafd34 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:50.250362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5172e-63e1-4794-a730-d3611cb65edc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:50.272527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:50.305879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b58463-bc2a-464a-a4b7-cedaa62ee629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:50.306535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58463-bc2a-464a-a4b7-cedaa62ee629 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:50.306820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58463-bc2a-464a-a4b7-cedaa62ee629 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:50.307095 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58463-bc2a-464a-a4b7-cedaa62ee629 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:50.308137 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b58463-bc2a-464a-a4b7-cedaa62ee629 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:50.308502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b58463-bc2a-464a-a4b7-cedaa62ee629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:50.310739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b58463-bc2a-464a-a4b7-cedaa62ee629 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:50.324397 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 175/356] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:50.324397 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b58463-bc2a-464a-a4b7-cedaa62ee629 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:50.384825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31702802-5ee5-4f1d-8668-cd7d83bafd34 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:50.437383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2a5ab-0645-47c8-85c3-06f9f2fc1ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:50.438387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2a5ab-0645-47c8-85c3-06f9f2fc1ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:50.438879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2a5ab-0645-47c8-85c3-06f9f2fc1ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:50.439154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2a5ab-0645-47c8-85c3-06f9f2fc1ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:50.440145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2a5ab-0645-47c8-85c3-06f9f2fc1ee4 None admin] RBAC: Adding query filter params (group.id=628fcd5514ef426e94e58250b16c246f, role.id=04a9c139ed6d44d4bcd37b614aeb009e, scope.project.id=e917870b5e964ef4a1fecad71d41d379) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:50.440469 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2a5ab-0645-47c8-85c3-06f9f2fc1ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:50.443530 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2a5ab-0645-47c8-85c3-06f9f2fc1ee4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:50.448796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 182/357] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 07:00:50 2022] GET /identity/v3/role_assignments?group.id=628fcd5514ef426e94e58250b16c246f&scope.project.id=e917870b5e964ef4a1fecad71d41d379&role.id=04a9c139ed6d44d4bcd37b614aeb009e => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:50.449889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2a5ab-0645-47c8-85c3-06f9f2fc1ee4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:50.462034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b58463-bc2a-464a-a4b7-cedaa62ee629 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:50.503202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ccacc-f160-4adb-b8c5-4b267b9ef9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:50.504120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ccacc-f160-4adb-b8c5-4b267b9ef9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:50.504522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ccacc-f160-4adb-b8c5-4b267b9ef9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:50.504961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ccacc-f160-4adb-b8c5-4b267b9ef9f4 None admin] PATH_INFO: `/v3/groups/628fcd5514ef426e94e58250b16c246f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:50.507590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ccacc-f160-4adb-b8c5-4b267b9ef9f4 None admin] RBAC: Authorizing `identity:get_group(group_id=628fcd5514ef426e94e58250b16c246f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:50.509378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ccacc-f160-4adb-b8c5-4b267b9ef9f4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:50.511323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 176/358] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:00:50 2022] GET /identity/v3/groups/628fcd5514ef426e94e58250b16c246f => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:50.512133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ccacc-f160-4adb-b8c5-4b267b9ef9f4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:50.517408 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:50.590326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:50.599288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2a5ab-0645-47c8-85c3-06f9f2fc1ee4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:50.649819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52044c-f961-4d71-9ed1-48d806b7e564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:50.650384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52044c-f961-4d71-9ed1-48d806b7e564 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:50.650664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52044c-f961-4d71-9ed1-48d806b7e564 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:50.650939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52044c-f961-4d71-9ed1-48d806b7e564 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:50.651664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52044c-f961-4d71-9ed1-48d806b7e564 None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:50.651973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52044c-f961-4d71-9ed1-48d806b7e564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:50.652346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ccacc-f160-4adb-b8c5-4b267b9ef9f4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:50.653439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52044c-f961-4d71-9ed1-48d806b7e564 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:50.663382 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 183/359] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:50.664853 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52044c-f961-4d71-9ed1-48d806b7e564 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:50.698491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9db96-3fae-4e86-be14-189418728ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:50.699673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9db96-3fae-4e86-be14-189418728ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:50.699673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9db96-3fae-4e86-be14-189418728ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:50.699961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9db96-3fae-4e86-be14-189418728ea1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:50.716657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9db96-3fae-4e86-be14-189418728ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-05d9db96-3fae-4e86-be14-189418728ea1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:50.722251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:50.723150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:50.723971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 177/360] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:00:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:50.725339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ae97b-d6bc-4f42-80fa-1fff0de8154a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:50.725339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ae97b-d6bc-4f42-80fa-1fff0de8154a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:50.725339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ae97b-d6bc-4f42-80fa-1fff0de8154a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:50.726735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 178/361] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:50.732928 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ae97b-d6bc-4f42-80fa-1fff0de8154a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:50.793137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52044c-f961-4d71-9ed1-48d806b7e564 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:50.797339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:50.839525 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9efc2-3e22-4651-b3bf-1392077ead91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:50.840243 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9efc2-3e22-4651-b3bf-1392077ead91 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:50.840548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9efc2-3e22-4651-b3bf-1392077ead91 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:50.840824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9efc2-3e22-4651-b3bf-1392077ead91 None admin] PATH_INFO: `/v3/users/c7f66fe53c364c8aab857ad42a3c1c79` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:50.842064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9efc2-3e22-4651-b3bf-1392077ead91 None admin] RBAC: Authorizing `identity:get_user(user_id=c7f66fe53c364c8aab857ad42a3c1c79)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:50.843646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9efc2-3e22-4651-b3bf-1392077ead91 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:50.845651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 184/362] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:00:50 2022] GET /identity/v3/users/c7f66fe53c364c8aab857ad42a3c1c79 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:50.846484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9efc2-3e22-4651-b3bf-1392077ead91 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:50.864646 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ae97b-d6bc-4f42-80fa-1fff0de8154a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:50.873963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:50.919212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74353c-1601-40d4-bc2b-e060ef12db6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:50.920694 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74353c-1601-40d4-bc2b-e060ef12db6b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:50.920694 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74353c-1601-40d4-bc2b-e060ef12db6b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:50.920694 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74353c-1601-40d4-bc2b-e060ef12db6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:50.921560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74353c-1601-40d4-bc2b-e060ef12db6b None admin] RBAC: Adding query filter params (group.id=628fcd5514ef426e94e58250b16c246f, role.id=2d65d41d83b24e36b4a751ac3f7fb178, scope.project.id=e917870b5e964ef4a1fecad71d41d379) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:50.921874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74353c-1601-40d4-bc2b-e060ef12db6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:50.923783 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74353c-1601-40d4-bc2b-e060ef12db6b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:50.930507 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 179/363] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 07:00:50 2022] GET /identity/v3/role_assignments?group.id=628fcd5514ef426e94e58250b16c246f&scope.project.id=e917870b5e964ef4a1fecad71d41d379&role.id=2d65d41d83b24e36b4a751ac3f7fb178 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:50.931171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74353c-1601-40d4-bc2b-e060ef12db6b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:50.983261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9efc2-3e22-4651-b3bf-1392077ead91 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:51.036578 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641c037-c999-4650-ad7d-a8b0d8fbe9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:51.037944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641c037-c999-4650-ad7d-a8b0d8fbe9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:51.039819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641c037-c999-4650-ad7d-a8b0d8fbe9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:51.040340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641c037-c999-4650-ad7d-a8b0d8fbe9d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:51.088147 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74353c-1601-40d4-bc2b-e060ef12db6b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:51.114552 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:51.138974 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90ad1a-4155-4137-a87d-70aa990ab884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:51.139653 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90ad1a-4155-4137-a87d-70aa990ab884 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:51.139937 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90ad1a-4155-4137-a87d-70aa990ab884 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:51.140216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90ad1a-4155-4137-a87d-70aa990ab884 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:51.141041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90ad1a-4155-4137-a87d-70aa990ab884 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:51.141352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90ad1a-4155-4137-a87d-70aa990ab884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:51.143241 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90ad1a-4155-4137-a87d-70aa990ab884 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:51.147187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641c037-c999-4650-ad7d-a8b0d8fbe9d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:51.149174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641c037-c999-4650-ad7d-a8b0d8fbe9d8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:51.155819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 180/364] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:00:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:51.156418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2664772-0cae-43de-9150-98b4247fea4f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:51.156707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2664772-0cae-43de-9150-98b4247fea4f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:51.161175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2664772-0cae-43de-9150-98b4247fea4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:51.189031 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c2664772-0cae-43de-9150-98b4247fea4f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:51.190205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c2664772-0cae-43de-9150-98b4247fea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:51.226282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:51.284287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 185/365] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:51.285264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641c037-c999-4650-ad7d-a8b0d8fbe9d8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:51.293593 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 181/366] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:51.294900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2664772-0cae-43de-9150-98b4247fea4f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:51.361883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:51.397222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641c037-c999-4650-ad7d-a8b0d8fbe9d8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:51.425431 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2664772-0cae-43de-9150-98b4247fea4f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:51.435814 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f0f3c-eacb-4b73-818f-a9a73975d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:51.436788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f0f3c-eacb-4b73-818f-a9a73975d64a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:51.437304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f0f3c-eacb-4b73-818f-a9a73975d64a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:51.437747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f0f3c-eacb-4b73-818f-a9a73975d64a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:51.438715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f0f3c-eacb-4b73-818f-a9a73975d64a None admin] RBAC: Adding query filter params (role.id=c179515102c542798ce49a1bf0e8b98a, user.id=c7f66fe53c364c8aab857ad42a3c1c79, scope.system=all) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:51.439320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f0f3c-eacb-4b73-818f-a9a73975d64a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:51.441060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f0f3c-eacb-4b73-818f-a9a73975d64a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:51.454613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 186/367] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Aug 5 07:00:51 2022] GET /identity/v3/role_assignments?user.id=c7f66fe53c364c8aab857ad42a3c1c79&scope.system=all&role.id=c179515102c542798ce49a1bf0e8b98a => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:51.455818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f0f3c-eacb-4b73-818f-a9a73975d64a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:51.479342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ee696-3183-4b93-9485-5e9d072c5b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:51.482708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ee696-3183-4b93-9485-5e9d072c5b46 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:51.483352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ee696-3183-4b93-9485-5e9d072c5b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:51.483987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ee696-3183-4b93-9485-5e9d072c5b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:51.567245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:51.598899 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f0f3c-eacb-4b73-818f-a9a73975d64a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:51.633744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:51.640323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ad13b-db55-4000-a7a4-9a55ae29df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:51.641260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ad13b-db55-4000-a7a4-9a55ae29df35 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:51.641961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ad13b-db55-4000-a7a4-9a55ae29df35 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:51.645362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ad13b-db55-4000-a7a4-9a55ae29df35 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:51.646760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ad13b-db55-4000-a7a4-9a55ae29df35 None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:51.647964 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ee696-3183-4b93-9485-5e9d072c5b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:51.648234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ad13b-db55-4000-a7a4-9a55ae29df35 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:51.650066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ee696-3183-4b93-9485-5e9d072c5b46 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:51.654777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 187/368] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:51 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:51.655616 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ad13b-db55-4000-a7a4-9a55ae29df35 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:51.785960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 182/369] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:51.787402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ee696-3183-4b93-9485-5e9d072c5b46 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:51.792637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ad13b-db55-4000-a7a4-9a55ae29df35 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:51.834212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023d817-1848-4cf5-9c68-467a10309885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:51.834883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023d817-1848-4cf5-9c68-467a10309885 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:51.835160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023d817-1848-4cf5-9c68-467a10309885 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:51.835479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023d817-1848-4cf5-9c68-467a10309885 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:51.854968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023d817-1848-4cf5-9c68-467a10309885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e023d817-1848-4cf5-9c68-467a10309885 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:51.862379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:51.863309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:51.864068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 188/370] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:00:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:51.865239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023d817-1848-4cf5-9c68-467a10309885 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:51.883378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:51.930474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ee696-3183-4b93-9485-5e9d072c5b46 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:51.939321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:51.968035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65258264-4853-4e82-a544-63204d6d6dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:51.969111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65258264-4853-4e82-a544-63204d6d6dbc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:51.969593 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65258264-4853-4e82-a544-63204d6d6dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:51.970064 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65258264-4853-4e82-a544-63204d6d6dbc None admin] PATH_INFO: `/v3/groups/628fcd5514ef426e94e58250b16c246f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:51.971557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65258264-4853-4e82-a544-63204d6d6dbc None admin] RBAC: Authorizing `identity:get_group(group_id=628fcd5514ef426e94e58250b16c246f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:51.973289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65258264-4853-4e82-a544-63204d6d6dbc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:51.975426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 183/371] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:00:51 2022] GET /identity/v3/groups/628fcd5514ef426e94e58250b16c246f => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:51.976386 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65258264-4853-4e82-a544-63204d6d6dbc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:51.987332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023d817-1848-4cf5-9c68-467a10309885 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:52.025534 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddd9f3-2ef3-470b-8bcd-881b83c19b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:52.026343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddd9f3-2ef3-470b-8bcd-881b83c19b9d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:52.026723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddd9f3-2ef3-470b-8bcd-881b83c19b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:52.027008 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddd9f3-2ef3-470b-8bcd-881b83c19b9d None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:52.028453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddd9f3-2ef3-470b-8bcd-881b83c19b9d None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:52.030342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddd9f3-2ef3-470b-8bcd-881b83c19b9d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:52.032523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 189/372] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:51 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:52.037048 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddd9f3-2ef3-470b-8bcd-881b83c19b9d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:52.093109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65258264-4853-4e82-a544-63204d6d6dbc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:52.130721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:52.137985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7751f-0317-4d08-b569-06f771fc3723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:52.138892 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7751f-0317-4d08-b569-06f771fc3723 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:52.139289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7751f-0317-4d08-b569-06f771fc3723 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:52.139766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7751f-0317-4d08-b569-06f771fc3723 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:52.140590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7751f-0317-4d08-b569-06f771fc3723 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:52.141055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7751f-0317-4d08-b569-06f771fc3723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:52.142787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7751f-0317-4d08-b569-06f771fc3723 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:52.155183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 184/373] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:52.156287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7751f-0317-4d08-b569-06f771fc3723 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:52.163023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddd9f3-2ef3-470b-8bcd-881b83c19b9d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:52.198763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:52.208973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64694d-932f-4294-a861-7f81e1794d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:52.209612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64694d-932f-4294-a861-7f81e1794d52 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:52.209894 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64694d-932f-4294-a861-7f81e1794d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:52.210173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64694d-932f-4294-a861-7f81e1794d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:52.210971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64694d-932f-4294-a861-7f81e1794d52 None admin] RBAC: Adding query filter params (group.id=628fcd5514ef426e94e58250b16c246f, role.id=2d65d41d83b24e36b4a751ac3f7fb178, scope.project.id=4931005296114563946c84a7e790464a) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:52.211283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64694d-932f-4294-a861-7f81e1794d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:52.212743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64694d-932f-4294-a861-7f81e1794d52 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:52.218916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 190/374] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 07:00:52 2022] GET /identity/v3/role_assignments?group.id=628fcd5514ef426e94e58250b16c246f&scope.project.id=4931005296114563946c84a7e790464a&role.id=2d65d41d83b24e36b4a751ac3f7fb178 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:52.219746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64694d-932f-4294-a861-7f81e1794d52 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:52.297614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7751f-0317-4d08-b569-06f771fc3723 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:52.377669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c0c46-81f2-41ac-bb5c-e9f6da1362da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:52.378349 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c0c46-81f2-41ac-bb5c-e9f6da1362da None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:52.378625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c0c46-81f2-41ac-bb5c-e9f6da1362da None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:52.378895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c0c46-81f2-41ac-bb5c-e9f6da1362da None admin] PATH_INFO: `/v3/groups/628fcd5514ef426e94e58250b16c246f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:52.380692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c0c46-81f2-41ac-bb5c-e9f6da1362da None admin] RBAC: Authorizing `identity:get_group(group_id=628fcd5514ef426e94e58250b16c246f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:52.382276 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c0c46-81f2-41ac-bb5c-e9f6da1362da None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:52.384099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 185/375] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:00:52 2022] GET /identity/v3/groups/628fcd5514ef426e94e58250b16c246f => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:52.392815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c0c46-81f2-41ac-bb5c-e9f6da1362da None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:52.407901 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64694d-932f-4294-a861-7f81e1794d52 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:52.477980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23683179-0134-4c07-86e9-382236c4743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:52.478625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23683179-0134-4c07-86e9-382236c4743b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:52.478904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23683179-0134-4c07-86e9-382236c4743b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:52.479185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23683179-0134-4c07-86e9-382236c4743b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:52.518504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:52.595886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c0c46-81f2-41ac-bb5c-e9f6da1362da None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:52.600926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:52.619010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23683179-0134-4c07-86e9-382236c4743b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:52.620505 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23683179-0134-4c07-86e9-382236c4743b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:52.664197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24e624-3bdf-406c-8612-6920655a7438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:52.664834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24e624-3bdf-406c-8612-6920655a7438 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:52.665136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24e624-3bdf-406c-8612-6920655a7438 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:52.665406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24e624-3bdf-406c-8612-6920655a7438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:52.666211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24e624-3bdf-406c-8612-6920655a7438 None admin] RBAC: Adding query filter params (group.id=628fcd5514ef426e94e58250b16c246f, role.id=04a9c139ed6d44d4bcd37b614aeb009e, scope.project.id=4931005296114563946c84a7e790464a) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:52.666522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24e624-3bdf-406c-8612-6920655a7438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:52.667982 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24e624-3bdf-406c-8612-6920655a7438 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:52.680655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 186/376] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 07:00:52 2022] GET /identity/v3/role_assignments?group.id=628fcd5514ef426e94e58250b16c246f&scope.project.id=4931005296114563946c84a7e790464a&role.id=04a9c139ed6d44d4bcd37b614aeb009e => generated 260 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:52.765010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 191/377] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:52.773605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24e624-3bdf-406c-8612-6920655a7438 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:52.793959 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a29d08-a5d7-4b12-baad-81b1ad124b57 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:52.794386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a29d08-a5d7-4b12-baad-81b1ad124b57 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:52.794832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a29d08-a5d7-4b12-baad-81b1ad124b57 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:52.796501 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 192/378] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:00:52.802891 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f8e6-20d0-4462-abd0-88a2ccd212e0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:52.803158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f8e6-20d0-4462-abd0-88a2ccd212e0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:52.803432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f8e6-20d0-4462-abd0-88a2ccd212e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:52.827413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-08b0f8e6-20d0-4462-abd0-88a2ccd212e0 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:52.828513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-08b0f8e6-20d0-4462-abd0-88a2ccd212e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:52.955368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24e624-3bdf-406c-8612-6920655a7438 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:52.972337 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 193/379] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:52.980383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:52.994559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f8e6-20d0-4462-abd0-88a2ccd212e0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:53.010385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517efc93-9564-49a6-9627-791e91511499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:53.011465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517efc93-9564-49a6-9627-791e91511499 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:53.012020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517efc93-9564-49a6-9627-791e91511499 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:53.012498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517efc93-9564-49a6-9627-791e91511499 None admin] PATH_INFO: `/v3/projects/c0ce80734b754922ab08055a8061587e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:53.014476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517efc93-9564-49a6-9627-791e91511499 None admin] RBAC: Authorizing `identity:get_project(project_id=c0ce80734b754922ab08055a8061587e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:53.016523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517efc93-9564-49a6-9627-791e91511499 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:53.021066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 187/380] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:52 2022] GET /identity/v3/projects/c0ce80734b754922ab08055a8061587e => generated 344 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:53.030028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517efc93-9564-49a6-9627-791e91511499 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:53.049922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:53.145653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f8e6-20d0-4462-abd0-88a2ccd212e0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:53.163110 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517efc93-9564-49a6-9627-791e91511499 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:53.190806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b5b5c-20d7-4218-8907-05b0d9a06026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:53.191344 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b5b5c-20d7-4218-8907-05b0d9a06026 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:53.191624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b5b5c-20d7-4218-8907-05b0d9a06026 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:53.191892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b5b5c-20d7-4218-8907-05b0d9a06026 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:53.210805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b5b5c-20d7-4218-8907-05b0d9a06026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-6d0b5b5c-20d7-4218-8907-05b0d9a06026 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:53.215838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:53.216768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:53.217630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 194/381] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:00:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:00:53.219523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0109fe2-f8d2-4899-9bb2-7dbea5295654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:53.220528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0109fe2-f8d2-4899-9bb2-7dbea5295654 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:53.221067 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0109fe2-f8d2-4899-9bb2-7dbea5295654 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:53.221618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0109fe2-f8d2-4899-9bb2-7dbea5295654 None admin] PATH_INFO: `/v3/groups/7b1705aaba634218afb35ab7ce47d5a9` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:53.223094 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b5b5c-20d7-4218-8907-05b0d9a06026 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:53.232289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0109fe2-f8d2-4899-9bb2-7dbea5295654 None admin] RBAC: Authorizing `identity:get_group(group_id=7b1705aaba634218afb35ab7ce47d5a9)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:53.234253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0109fe2-f8d2-4899-9bb2-7dbea5295654 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:53.236672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 188/382] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:00:53 2022] GET /identity/v3/groups/7b1705aaba634218afb35ab7ce47d5a9 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:53.248257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0109fe2-f8d2-4899-9bb2-7dbea5295654 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:53.349472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:53.370995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:53.408361 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b5b5c-20d7-4218-8907-05b0d9a06026 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:53.431103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0109fe2-f8d2-4899-9bb2-7dbea5295654 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:53.472668 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7c40a-bfee-4400-a5d3-df0c66d4eeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:53.473284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7c40a-bfee-4400-a5d3-df0c66d4eeec None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:53.473564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7c40a-bfee-4400-a5d3-df0c66d4eeec None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:53.473832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7c40a-bfee-4400-a5d3-df0c66d4eeec None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:53.474553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7c40a-bfee-4400-a5d3-df0c66d4eeec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:53.474851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7c40a-bfee-4400-a5d3-df0c66d4eeec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:53.476309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7c40a-bfee-4400-a5d3-df0c66d4eeec None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:53.501394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b927a-4e42-48e6-8f92-29a41b009950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:53.502130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b927a-4e42-48e6-8f92-29a41b009950 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:53.502408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b927a-4e42-48e6-8f92-29a41b009950 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:53.502679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b927a-4e42-48e6-8f92-29a41b009950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:53.503466 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b927a-4e42-48e6-8f92-29a41b009950 None admin] RBAC: Adding query filter params (group.id=7b1705aaba634218afb35ab7ce47d5a9, role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=c0ce80734b754922ab08055a8061587e) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:53.503779 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b927a-4e42-48e6-8f92-29a41b009950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:53.505320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b927a-4e42-48e6-8f92-29a41b009950 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:53.517548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 195/383] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:00:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:53.520609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7c40a-bfee-4400-a5d3-df0c66d4eeec None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:53.525925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 189/384] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 07:00:53 2022] GET /identity/v3/role_assignments?group.id=7b1705aaba634218afb35ab7ce47d5a9&scope.project.id=c0ce80734b754922ab08055a8061587e&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 260 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:53.535309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85cc5f-cfb5-4d1c-b5ca-021f4352e8a9 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:53.535647 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85cc5f-cfb5-4d1c-b5ca-021f4352e8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:53.535857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85cc5f-cfb5-4d1c-b5ca-021f4352e8a9 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:53.537625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 190/385] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:53.543987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc27c72-5768-4cc5-9339-287622401a61 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:53.544292 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc27c72-5768-4cc5-9339-287622401a61 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:53.544529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc27c72-5768-4cc5-9339-287622401a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:53.578041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fbc27c72-5768-4cc5-9339-287622401a61 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:53.579285 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fbc27c72-5768-4cc5-9339-287622401a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:53.726412 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 191/386] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:53.735739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7c40a-bfee-4400-a5d3-df0c66d4eeec None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:53.753245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc27c72-5768-4cc5-9339-287622401a61 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:53.775967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80df54c-1b9e-4d75-9dde-485e946ca2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:53.776642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80df54c-1b9e-4d75-9dde-485e946ca2df None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:53.776939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80df54c-1b9e-4d75-9dde-485e946ca2df None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:53.777209 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80df54c-1b9e-4d75-9dde-485e946ca2df None admin] PATH_INFO: `/v3/groups/628fcd5514ef426e94e58250b16c246f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:53.778442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80df54c-1b9e-4d75-9dde-485e946ca2df None admin] RBAC: Authorizing `identity:get_group(group_id=628fcd5514ef426e94e58250b16c246f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:53.780227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80df54c-1b9e-4d75-9dde-485e946ca2df None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:53.783114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 196/387] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:00:53 2022] GET /identity/v3/groups/628fcd5514ef426e94e58250b16c246f => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:53.789250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80df54c-1b9e-4d75-9dde-485e946ca2df None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:53.805496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:53.850955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:53.927474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc27c72-5768-4cc5-9339-287622401a61 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:53.953406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80df54c-1b9e-4d75-9dde-485e946ca2df None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:53.997146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e566a-4f6e-4635-bd0f-f98033ea5476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:53.997731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e566a-4f6e-4635-bd0f-f98033ea5476 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:53.998011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e566a-4f6e-4635-bd0f-f98033ea5476 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:53.998284 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e566a-4f6e-4635-bd0f-f98033ea5476 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:54.009088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf421d-142d-4960-94c6-989bb5331434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:54.010076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf421d-142d-4960-94c6-989bb5331434 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:54.010799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf421d-142d-4960-94c6-989bb5331434 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:54.011242 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf421d-142d-4960-94c6-989bb5331434 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:54.012618 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf421d-142d-4960-94c6-989bb5331434 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:54.014654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf421d-142d-4960-94c6-989bb5331434 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:54.019690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 197/388] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:53 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:54.024506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e566a-4f6e-4635-bd0f-f98033ea5476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:54.025578 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf421d-142d-4960-94c6-989bb5331434 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-577e566a-4f6e-4635-bd0f-f98033ea5476 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:54.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:54.028120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:54.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 192/389] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:00:54.034541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e566a-4f6e-4635-bd0f-f98033ea5476 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:54.164961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:54.188222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e566a-4f6e-4635-bd0f-f98033ea5476 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:54.200511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:54.229760 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff00fd-6d0f-4118-bbf2-4c606e7c94b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:54.229966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf421d-142d-4960-94c6-989bb5331434 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:54.230400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff00fd-6d0f-4118-bbf2-4c606e7c94b3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:54.230672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff00fd-6d0f-4118-bbf2-4c606e7c94b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:54.230941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff00fd-6d0f-4118-bbf2-4c606e7c94b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:54.231723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff00fd-6d0f-4118-bbf2-4c606e7c94b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:54.232029 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff00fd-6d0f-4118-bbf2-4c606e7c94b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:54.233456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff00fd-6d0f-4118-bbf2-4c606e7c94b3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:54.242608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 193/390] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:54.251832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff00fd-6d0f-4118-bbf2-4c606e7c94b3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:54.279576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f600b0d-ae7b-4da1-af29-75a5c480e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:54.280710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f600b0d-ae7b-4da1-af29-75a5c480e124 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:54.281203 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f600b0d-ae7b-4da1-af29-75a5c480e124 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:54.281636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f600b0d-ae7b-4da1-af29-75a5c480e124 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379/groups/628fcd5514ef426e94e58250b16c246f/roles/04a9c139ed6d44d4bcd37b614aeb009e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:54.284253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f600b0d-ae7b-4da1-af29-75a5c480e124 None admin] RBAC: Authorizing `identity:create_grant(project_id=e917870b5e964ef4a1fecad71d41d379, group_id=628fcd5514ef426e94e58250b16c246f, role_id=04a9c139ed6d44d4bcd37b614aeb009e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:54.287473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f600b0d-ae7b-4da1-af29-75a5c480e124 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:54.307623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 198/391] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 5 07:00:54 2022] PUT /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379/groups/628fcd5514ef426e94e58250b16c246f/roles/04a9c139ed6d44d4bcd37b614aeb009e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:54.401409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff00fd-6d0f-4118-bbf2-4c606e7c94b3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:54.438388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759a499-477d-426a-8c93-afdeeac1f694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:54.439210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759a499-477d-426a-8c93-afdeeac1f694 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:54.439864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759a499-477d-426a-8c93-afdeeac1f694 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:54.440426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759a499-477d-426a-8c93-afdeeac1f694 None admin] PATH_INFO: `/v3/groups/628fcd5514ef426e94e58250b16c246f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:54.441711 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759a499-477d-426a-8c93-afdeeac1f694 None admin] RBAC: Authorizing `identity:get_group(group_id=628fcd5514ef426e94e58250b16c246f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:54.443158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759a499-477d-426a-8c93-afdeeac1f694 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:54.445174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 194/392] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:00:54 2022] GET /identity/v3/groups/628fcd5514ef426e94e58250b16c246f => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:54.450959 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f600b0d-ae7b-4da1-af29-75a5c480e124 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:54.607696 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f600b0d-ae7b-4da1-af29-75a5c480e124 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:54.651538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7c597-3df7-4e73-b8a1-d67466c4815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:54.652209 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7c597-3df7-4e73-b8a1-d67466c4815b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:54.652489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7c597-3df7-4e73-b8a1-d67466c4815b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:54.652766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7c597-3df7-4e73-b8a1-d67466c4815b None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:54.653991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7c597-3df7-4e73-b8a1-d67466c4815b None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:54.655460 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7c597-3df7-4e73-b8a1-d67466c4815b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:54.657558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 199/393] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:54 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:54.663836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759a499-477d-426a-8c93-afdeeac1f694 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:54.728014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:54.804376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759a499-477d-426a-8c93-afdeeac1f694 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:54.836926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b826b3d-a59d-4d0c-8a1d-e69a4a7fcf5e None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:54.837201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b826b3d-a59d-4d0c-8a1d-e69a4a7fcf5e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:54.837478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b826b3d-a59d-4d0c-8a1d-e69a4a7fcf5e None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:54.838844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 200/394] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:54.845156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfe776-83a2-4e15-8b65-ab764485c1ee None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:54.845470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfe776-83a2-4e15-8b65-ab764485c1ee None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:54.845753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfe776-83a2-4e15-8b65-ab764485c1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:54.849283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba56245-b5ff-4bd2-a3c8-88a860fe9959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:54.850226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba56245-b5ff-4bd2-a3c8-88a860fe9959 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:54.850705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba56245-b5ff-4bd2-a3c8-88a860fe9959 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:54.851188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba56245-b5ff-4bd2-a3c8-88a860fe9959 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379/groups/628fcd5514ef426e94e58250b16c246f/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:54.853478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba56245-b5ff-4bd2-a3c8-88a860fe9959 None admin] RBAC: Authorizing `identity:create_grant(project_id=e917870b5e964ef4a1fecad71d41d379, group_id=628fcd5514ef426e94e58250b16c246f, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:54.855142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba56245-b5ff-4bd2-a3c8-88a860fe9959 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:54.873714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:54.875704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 195/395] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 5 07:00:54 2022] PUT /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379/groups/628fcd5514ef426e94e58250b16c246f/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:54.881586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0bdfe776-83a2-4e15-8b65-ab764485c1ee None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:54.882842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0bdfe776-83a2-4e15-8b65-ab764485c1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:54.969007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 201/396] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:55.004056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba56245-b5ff-4bd2-a3c8-88a860fe9959 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:55.138250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:55.141683 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba56245-b5ff-4bd2-a3c8-88a860fe9959 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:55.181882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59413e84-cba0-42b5-b189-8981583b4c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:55.182549 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59413e84-cba0-42b5-b189-8981583b4c5d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:55.182830 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59413e84-cba0-42b5-b189-8981583b4c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:55.183103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59413e84-cba0-42b5-b189-8981583b4c5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:55.194423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59413e84-cba0-42b5-b189-8981583b4c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-59413e84-cba0-42b5-b189-8981583b4c5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:55.199476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:55.200380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:55.201187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:55.201187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:55.201187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:55.201187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:55.201187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:55.201187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:55.201187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:55.201187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:55.201187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:55.201187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:55.201187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:55.201187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:55.203888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 196/397] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:55.207136 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfe776-83a2-4e15-8b65-ab764485c1ee None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:55.351237 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfe776-83a2-4e15-8b65-ab764485c1ee None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:55.400194 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755c0fb-0c7a-4c9a-b118-9b3562761640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:55.400748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755c0fb-0c7a-4c9a-b118-9b3562761640 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:55.401062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755c0fb-0c7a-4c9a-b118-9b3562761640 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:55.401338 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755c0fb-0c7a-4c9a-b118-9b3562761640 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:55.401633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79abc9-7447-465b-ab03-10b9b3ba4fac None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:55.401913 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79abc9-7447-465b-ab03-10b9b3ba4fac None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:55.402079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755c0fb-0c7a-4c9a-b118-9b3562761640 None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:55.402180 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79abc9-7447-465b-ab03-10b9b3ba4fac None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:55.402364 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755c0fb-0c7a-4c9a-b118-9b3562761640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:55.403730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 197/398] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:55.403863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755c0fb-0c7a-4c9a-b118-9b3562761640 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:55.408688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309f2db-6e12-47fa-9218-f9cee059e995 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:55.408993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309f2db-6e12-47fa-9218-f9cee059e995 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:55.409168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:55.409259 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309f2db-6e12-47fa-9218-f9cee059e995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:55.417470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 202/399] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:55.423484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755c0fb-0c7a-4c9a-b118-9b3562761640 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:55.453949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6309f2db-6e12-47fa-9218-f9cee059e995 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:55.455225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6309f2db-6e12-47fa-9218-f9cee059e995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:55.537725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755c0fb-0c7a-4c9a-b118-9b3562761640 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:55.576201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168b962-cdad-4371-81b6-49911ef4717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:55.577340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168b962-cdad-4371-81b6-49911ef4717d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:55.577881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168b962-cdad-4371-81b6-49911ef4717d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:55.578399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168b962-cdad-4371-81b6-49911ef4717d None admin] PATH_INFO: `/v3/groups/628fcd5514ef426e94e58250b16c246f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:55.580154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168b962-cdad-4371-81b6-49911ef4717d None admin] RBAC: Authorizing `identity:get_group(group_id=628fcd5514ef426e94e58250b16c246f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:55.581868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168b962-cdad-4371-81b6-49911ef4717d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:55.583746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 203/400] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:00:55 2022] GET /identity/v3/groups/628fcd5514ef426e94e58250b16c246f => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:55.589732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168b962-cdad-4371-81b6-49911ef4717d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:55.661158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:55.672872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 198/401] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:55.710584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168b962-cdad-4371-81b6-49911ef4717d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:55.728763 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309f2db-6e12-47fa-9218-f9cee059e995 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:55.781673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06996a46-a315-422f-88fc-0a9b14f96f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:55.782844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06996a46-a315-422f-88fc-0a9b14f96f05 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:55.783411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06996a46-a315-422f-88fc-0a9b14f96f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:55.784051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06996a46-a315-422f-88fc-0a9b14f96f05 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:55.785332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06996a46-a315-422f-88fc-0a9b14f96f05 None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:55.787078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06996a46-a315-422f-88fc-0a9b14f96f05 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:55.789427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 204/402] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:55 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:55.795512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06996a46-a315-422f-88fc-0a9b14f96f05 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:55.849277 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:55.869887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309f2db-6e12-47fa-9218-f9cee059e995 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:55.932032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d7264-d0c6-4f84-9031-d998c0a39629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:55.932605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d7264-d0c6-4f84-9031-d998c0a39629 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:55.933142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d7264-d0c6-4f84-9031-d998c0a39629 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:55.933486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d7264-d0c6-4f84-9031-d998c0a39629 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:55.953599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d7264-d0c6-4f84-9031-d998c0a39629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-3f1d7264-d0c6-4f84-9031-d998c0a39629 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:55.960037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:55.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:55.961818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:55.961818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:55.961818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:55.961818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:55.961818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:55.961818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:55.961818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:55.961818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:55.961818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:55.961818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:55.961818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:55.961818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:55.962949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 199/403] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:00:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:55.973533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d7264-d0c6-4f84-9031-d998c0a39629 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:55.995940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06996a46-a315-422f-88fc-0a9b14f96f05 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:56.059805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c4134-5185-476b-a92a-3872556aadec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:56.060495 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c4134-5185-476b-a92a-3872556aadec None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:56.060768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c4134-5185-476b-a92a-3872556aadec None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:56.061108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c4134-5185-476b-a92a-3872556aadec None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a/groups/628fcd5514ef426e94e58250b16c246f/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:56.064447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c4134-5185-476b-a92a-3872556aadec None admin] RBAC: Authorizing `identity:create_grant(project_id=4931005296114563946c84a7e790464a, group_id=628fcd5514ef426e94e58250b16c246f, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:56.065924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c4134-5185-476b-a92a-3872556aadec None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:56.069856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:56.090896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 205/404] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 5 07:00:55 2022] PUT /identity/v3/projects/4931005296114563946c84a7e790464a/groups/628fcd5514ef426e94e58250b16c246f/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:56.127574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265549e-f4a6-4e96-80ac-49a7c75dd752 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:56.127891 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265549e-f4a6-4e96-80ac-49a7c75dd752 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:56.128132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265549e-f4a6-4e96-80ac-49a7c75dd752 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:56.129951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 206/405] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:00:56.135761 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a9776-83aa-4c62-befe-f810eabf06b3 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:56.136085 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a9776-83aa-4c62-befe-f810eabf06b3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:56.136329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a9776-83aa-4c62-befe-f810eabf06b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:56.149036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d7264-d0c6-4f84-9031-d998c0a39629 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:56.168326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7b0a9776-83aa-4c62-befe-f810eabf06b3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:56.169603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7b0a9776-83aa-4c62-befe-f810eabf06b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:56.211927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55b87-59dc-456b-a71f-30c91b7e4d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:56.212487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55b87-59dc-456b-a71f-30c91b7e4d9f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:56.212812 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55b87-59dc-456b-a71f-30c91b7e4d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:56.213201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55b87-59dc-456b-a71f-30c91b7e4d9f None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:56.213992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d55b87-59dc-456b-a71f-30c91b7e4d9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:56.214350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d55b87-59dc-456b-a71f-30c91b7e4d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:56.215805 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d55b87-59dc-456b-a71f-30c91b7e4d9f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:56.226920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 200/406] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:00:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:56.233626 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55b87-59dc-456b-a71f-30c91b7e4d9f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:56.255305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:56.329414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 207/407] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:00:56.358086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a9776-83aa-4c62-befe-f810eabf06b3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:56.363468 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55b87-59dc-456b-a71f-30c91b7e4d9f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:56.404479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4b8cf-9d22-415c-8998-9c331576dc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:56.405247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4b8cf-9d22-415c-8998-9c331576dc24 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:56.405583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4b8cf-9d22-415c-8998-9c331576dc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:56.406362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4b8cf-9d22-415c-8998-9c331576dc24 None admin] PATH_INFO: `/v3/groups/628fcd5514ef426e94e58250b16c246f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:56.407746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4b8cf-9d22-415c-8998-9c331576dc24 None admin] RBAC: Authorizing `identity:get_group(group_id=628fcd5514ef426e94e58250b16c246f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:56.409458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4b8cf-9d22-415c-8998-9c331576dc24 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:56.412072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 201/408] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:00:56 2022] GET /identity/v3/groups/628fcd5514ef426e94e58250b16c246f => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:56.418108 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4b8cf-9d22-415c-8998-9c331576dc24 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:56.511385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:56.535240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4b8cf-9d22-415c-8998-9c331576dc24 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:56.575427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb21c1-4710-41ae-b3da-4335c11357e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:56.576548 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb21c1-4710-41ae-b3da-4335c11357e9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:56.577164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb21c1-4710-41ae-b3da-4335c11357e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:56.577605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb21c1-4710-41ae-b3da-4335c11357e9 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:56.579227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb21c1-4710-41ae-b3da-4335c11357e9 None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:56.581322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb21c1-4710-41ae-b3da-4335c11357e9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:56.583959 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 202/409] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:56 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:56.590510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb21c1-4710-41ae-b3da-4335c11357e9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:56.592871 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a9776-83aa-4c62-befe-f810eabf06b3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:56.641792 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:56.673688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a91e06-4b94-4860-92fb-f2c047a8b4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:56.674368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a91e06-4b94-4860-92fb-f2c047a8b4cd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:56.674650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a91e06-4b94-4860-92fb-f2c047a8b4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:56.675608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a91e06-4b94-4860-92fb-f2c047a8b4cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:56.706861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb21c1-4710-41ae-b3da-4335c11357e9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:56.715898 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a91e06-4b94-4860-92fb-f2c047a8b4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-63a91e06-4b94-4860-92fb-f2c047a8b4cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:56.721099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:56.721984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:56.722768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 208/410] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:00:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:56.732950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a91e06-4b94-4860-92fb-f2c047a8b4cd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:56.776682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd477b0f-bf7f-4e3e-b660-b773e1880317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:56.777330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd477b0f-bf7f-4e3e-b660-b773e1880317 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:56.777615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd477b0f-bf7f-4e3e-b660-b773e1880317 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:56.777899 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd477b0f-bf7f-4e3e-b660-b773e1880317 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a/groups/628fcd5514ef426e94e58250b16c246f/roles/04a9c139ed6d44d4bcd37b614aeb009e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:56.782508 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd477b0f-bf7f-4e3e-b660-b773e1880317 None admin] RBAC: Authorizing `identity:create_grant(project_id=4931005296114563946c84a7e790464a, group_id=628fcd5514ef426e94e58250b16c246f, role_id=04a9c139ed6d44d4bcd37b614aeb009e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:56.784049 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd477b0f-bf7f-4e3e-b660-b773e1880317 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:56.811553 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 203/411] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 5 07:00:56 2022] PUT /identity/v3/projects/4931005296114563946c84a7e790464a/groups/628fcd5514ef426e94e58250b16c246f/roles/04a9c139ed6d44d4bcd37b614aeb009e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:00:56.888480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a91e06-4b94-4860-92fb-f2c047a8b4cd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:56.934354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddade59f-309f-42e8-816c-210faad72995 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:56.934710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddade59f-309f-42e8-816c-210faad72995 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:56.934898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddade59f-309f-42e8-816c-210faad72995 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:56.936508 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 204/412] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:56.942128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283b5cd-3b6c-4cd1-9c54-cdd6dcbecb8b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:56.942442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283b5cd-3b6c-4cd1-9c54-cdd6dcbecb8b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:56.942691 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283b5cd-3b6c-4cd1-9c54-cdd6dcbecb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:56.948586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906afb26-baf0-47ea-a0da-3632fa356897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:56.949518 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afb26-baf0-47ea-a0da-3632fa356897 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:56.949799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afb26-baf0-47ea-a0da-3632fa356897 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:56.951031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afb26-baf0-47ea-a0da-3632fa356897 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:56.951806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afb26-baf0-47ea-a0da-3632fa356897 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:56.952120 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afb26-baf0-47ea-a0da-3632fa356897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:56.953605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afb26-baf0-47ea-a0da-3632fa356897 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:56.969692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0283b5cd-3b6c-4cd1-9c54-cdd6dcbecb8b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:56.971060 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0283b5cd-3b6c-4cd1-9c54-cdd6dcbecb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:56.973679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:56.976647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 209/413] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:56.982383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906afb26-baf0-47ea-a0da-3632fa356897 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:57.057292 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:57.083313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 205/414] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:57.114759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283b5cd-3b6c-4cd1-9c54-cdd6dcbecb8b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:57.120173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906afb26-baf0-47ea-a0da-3632fa356897 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:57.165588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e13711-891e-4e00-97f1-19eacb51d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:57.167510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e13711-891e-4e00-97f1-19eacb51d09b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:57.169001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e13711-891e-4e00-97f1-19eacb51d09b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:57.169694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e13711-891e-4e00-97f1-19eacb51d09b None admin] PATH_INFO: `/v3/groups/7b1705aaba634218afb35ab7ce47d5a9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:57.171824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e13711-891e-4e00-97f1-19eacb51d09b None admin] RBAC: Authorizing `identity:get_group(group_id=7b1705aaba634218afb35ab7ce47d5a9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:57.174178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e13711-891e-4e00-97f1-19eacb51d09b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:57.179613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 210/415] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:00:56 2022] GET /identity/v3/groups/7b1705aaba634218afb35ab7ce47d5a9 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:57.183992 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e13711-891e-4e00-97f1-19eacb51d09b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:57.303946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283b5cd-3b6c-4cd1-9c54-cdd6dcbecb8b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:57.336393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e13711-891e-4e00-97f1-19eacb51d09b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:57.348749 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae86225-d92c-4960-becb-dde289749b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:57.350184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae86225-d92c-4960-becb-dde289749b45 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:57.350943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae86225-d92c-4960-becb-dde289749b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:57.351414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae86225-d92c-4960-becb-dde289749b45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:57.353953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:57.363135 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:57.369837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae86225-d92c-4960-becb-dde289749b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8ae86225-d92c-4960-becb-dde289749b45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:57.377197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:57.378080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:57.378878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:57.378878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:57.378878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:57.378878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:57.378878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:57.378878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:57.378878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:57.378878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:57.378878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:57.378878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:57.378878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:57.378878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:57.379481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471d2b-b408-4754-a4cd-eadc2c2cb59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:57.380038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471d2b-b408-4754-a4cd-eadc2c2cb59f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:57.380038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471d2b-b408-4754-a4cd-eadc2c2cb59f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:57.380297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471d2b-b408-4754-a4cd-eadc2c2cb59f None admin] PATH_INFO: `/v3/projects/c0ce80734b754922ab08055a8061587e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:57.381482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471d2b-b408-4754-a4cd-eadc2c2cb59f None admin] RBAC: Authorizing `identity:get_project(project_id=c0ce80734b754922ab08055a8061587e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:57.382239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 206/416] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:00:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:00:57.382937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471d2b-b408-4754-a4cd-eadc2c2cb59f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:57.383973 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa44c9d-1ac1-4e69-b964-36a4d5c1f30f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:57.384462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa44c9d-1ac1-4e69-b964-36a4d5c1f30f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:57.384877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 211/417] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:57 2022] GET /identity/v3/projects/c0ce80734b754922ab08055a8061587e => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:57.385160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa44c9d-1ac1-4e69-b964-36a4d5c1f30f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:57.391034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 207/418] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:57.391395 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471d2b-b408-4754-a4cd-eadc2c2cb59f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:57.392344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa44c9d-1ac1-4e69-b964-36a4d5c1f30f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:57.525302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471d2b-b408-4754-a4cd-eadc2c2cb59f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:57.530539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa44c9d-1ac1-4e69-b964-36a4d5c1f30f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:57.561554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965299b5-e2a1-45e9-99ad-c5170453b983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:57.562161 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965299b5-e2a1-45e9-99ad-c5170453b983 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:57.562438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965299b5-e2a1-45e9-99ad-c5170453b983 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:57.562758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965299b5-e2a1-45e9-99ad-c5170453b983 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:57.563423 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965299b5-e2a1-45e9-99ad-c5170453b983 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:57.563728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965299b5-e2a1-45e9-99ad-c5170453b983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:57.565204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965299b5-e2a1-45e9-99ad-c5170453b983 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:57.574321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 212/419] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:00:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:57.575806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79f911-3714-4667-8cf8-2a3d80e3c7f9 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:57.576095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79f911-3714-4667-8cf8-2a3d80e3c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:57.576376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79f911-3714-4667-8cf8-2a3d80e3c7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:57.579672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18603c9-5527-444c-9911-fd36c4182a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:57.580771 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18603c9-5527-444c-9911-fd36c4182a6f None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:57.581348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18603c9-5527-444c-9911-fd36c4182a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:57.581866 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18603c9-5527-444c-9911-fd36c4182a6f None admin] PATH_INFO: `/v3/projects/c0ce80734b754922ab08055a8061587e/groups/7b1705aaba634218afb35ab7ce47d5a9/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:57.589075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18603c9-5527-444c-9911-fd36c4182a6f None admin] RBAC: Authorizing `identity:create_grant(project_id=c0ce80734b754922ab08055a8061587e, group_id=7b1705aaba634218afb35ab7ce47d5a9, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:57.591912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18603c9-5527-444c-9911-fd36c4182a6f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:57.597278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-be79f911-3714-4667-8cf8-2a3d80e3c7f9 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:57.598387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-be79f911-3714-4667-8cf8-2a3d80e3c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:57.610766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 208/420] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Aug 5 07:00:57 2022] PUT /identity/v3/projects/c0ce80734b754922ab08055a8061587e/groups/7b1705aaba634218afb35ab7ce47d5a9/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:00:57.612474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18603c9-5527-444c-9911-fd36c4182a6f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:57.648526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:57.683073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 213/421] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:57.713376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:57.729738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79f911-3714-4667-8cf8-2a3d80e3c7f9 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:57.799788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18603c9-5527-444c-9911-fd36c4182a6f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:57.859841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75f8c9-0b9d-4ee7-bfa0-df5853aa4c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:57.860961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75f8c9-0b9d-4ee7-bfa0-df5853aa4c95 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:57.861502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75f8c9-0b9d-4ee7-bfa0-df5853aa4c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:57.862002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75f8c9-0b9d-4ee7-bfa0-df5853aa4c95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:57.891336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79f911-3714-4667-8cf8-2a3d80e3c7f9 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:57.928537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b48bd7-96a7-44c9-85fe-8322b09f562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:57.929230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b48bd7-96a7-44c9-85fe-8322b09f562c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:57.929507 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b48bd7-96a7-44c9-85fe-8322b09f562c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:57.929776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b48bd7-96a7-44c9-85fe-8322b09f562c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:57.940567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75f8c9-0b9d-4ee7-bfa0-df5853aa4c95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:57.940736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b48bd7-96a7-44c9-85fe-8322b09f562c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:57.942580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75f8c9-0b9d-4ee7-bfa0-df5853aa4c95 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-c8b48bd7-96a7-44c9-85fe-8322b09f562c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:57.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:57.946988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:57.947807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:57.947807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:57.947807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:57.947807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:57.947807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:57.947807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:57.947807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:57.947807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:57.947807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:57.947807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:57.947807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:57.947807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:00:57.952759 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 214/422] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:00:57.954083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b48bd7-96a7-44c9-85fe-8322b09f562c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:57.989981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:58.014489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:58.062334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b48bd7-96a7-44c9-85fe-8322b09f562c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:58.063221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 209/423] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:58.068438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75f8c9-0b9d-4ee7-bfa0-df5853aa4c95 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:58.142318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d87b3f-9550-414f-bee4-a53cc86c9131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:58.142874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d87b3f-9550-414f-bee4-a53cc86c9131 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:58.143150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d87b3f-9550-414f-bee4-a53cc86c9131 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:58.143418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d87b3f-9550-414f-bee4-a53cc86c9131 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:58.144144 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d87b3f-9550-414f-bee4-a53cc86c9131 None admin] RBAC: Adding query filter params (name=member) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:58.144442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d87b3f-9550-414f-bee4-a53cc86c9131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:58.145886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d87b3f-9550-414f-bee4-a53cc86c9131 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:58.167393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 215/424] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:58.172847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d87b3f-9550-414f-bee4-a53cc86c9131 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:58.178350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75f8c9-0b9d-4ee7-bfa0-df5853aa4c95 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:58.215184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea6239-b545-4a04-9cd5-cbbfe8346ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:58.216304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6239-b545-4a04-9cd5-cbbfe8346ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:58.216783 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6239-b545-4a04-9cd5-cbbfe8346ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:58.217287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6239-b545-4a04-9cd5-cbbfe8346ac8 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:58.218846 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea6239-b545-4a04-9cd5-cbbfe8346ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:58.220768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea6239-b545-4a04-9cd5-cbbfe8346ac8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:58.223042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 210/425] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:58 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:58.228955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea6239-b545-4a04-9cd5-cbbfe8346ac8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:58.296369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:58.369211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea6239-b545-4a04-9cd5-cbbfe8346ac8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:58.405094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffa456-9992-4a49-bb8f-edb0e6f3ac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:58.405922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffa456-9992-4a49-bb8f-edb0e6f3ac6e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:58.406307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffa456-9992-4a49-bb8f-edb0e6f3ac6e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:58.406680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffa456-9992-4a49-bb8f-edb0e6f3ac6e None admin] PATH_INFO: `/v3/groups/628fcd5514ef426e94e58250b16c246f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:58.408006 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffa456-9992-4a49-bb8f-edb0e6f3ac6e None admin] RBAC: Authorizing `identity:get_group(group_id=628fcd5514ef426e94e58250b16c246f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:58.409666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffa456-9992-4a49-bb8f-edb0e6f3ac6e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:58.411702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 211/426] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:00:58 2022] GET /identity/v3/groups/628fcd5514ef426e94e58250b16c246f => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:58.421962 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffa456-9992-4a49-bb8f-edb0e6f3ac6e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:58.424740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:58.438311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d87b3f-9550-414f-bee4-a53cc86c9131 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:58.486046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224931d5-243b-429a-9dc3-8ab031649078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:58.486721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224931d5-243b-429a-9dc3-8ab031649078 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:58.487000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224931d5-243b-429a-9dc3-8ab031649078 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:58.487274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224931d5-243b-429a-9dc3-8ab031649078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:58.586875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:58.593894 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffa456-9992-4a49-bb8f-edb0e6f3ac6e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:58.610986 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224931d5-243b-429a-9dc3-8ab031649078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:58.612698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224931d5-243b-429a-9dc3-8ab031649078 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:58.641652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6922b-232a-4c73-8572-c31f305dd623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:58.642428 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6922b-232a-4c73-8572-c31f305dd623 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:58.642708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6922b-232a-4c73-8572-c31f305dd623 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:58.642979 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6922b-232a-4c73-8572-c31f305dd623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:58.643777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6922b-232a-4c73-8572-c31f305dd623 None admin] RBAC: Adding query filter params (group.id=628fcd5514ef426e94e58250b16c246f, role.id=04a9c139ed6d44d4bcd37b614aeb009e, scope.project.id=e917870b5e964ef4a1fecad71d41d379) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:58.644079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6922b-232a-4c73-8572-c31f305dd623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:58.645554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6922b-232a-4c73-8572-c31f305dd623 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:58.659534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 212/427] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 07:00:58 2022] GET /identity/v3/role_assignments?group.id=628fcd5514ef426e94e58250b16c246f&scope.project.id=e917870b5e964ef4a1fecad71d41d379&role.id=04a9c139ed6d44d4bcd37b614aeb009e => generated 611 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:58.708750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6b4f1-e33d-4538-b0b4-d3d139b1afe3 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:58.709092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6b4f1-e33d-4538-b0b4-d3d139b1afe3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:58.709369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6b4f1-e33d-4538-b0b4-d3d139b1afe3 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:58.711180 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 213/428] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:00:58.717016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6ea2-7d72-4c19-b438-2f439b753b85 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:58.717682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6ea2-7d72-4c19-b438-2f439b753b85 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:58.717682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6ea2-7d72-4c19-b438-2f439b753b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:58.750444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bfea6ea2-7d72-4c19-b438-2f439b753b85 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:58.751775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bfea6ea2-7d72-4c19-b438-2f439b753b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:58.791058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:58.804503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 216/429] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 07:00:58.810895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224931d5-243b-429a-9dc3-8ab031649078 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:58.893905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 214/430] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:58.922786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea6ea2-7d72-4c19-b438-2f439b753b85 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:58.940061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224931d5-243b-429a-9dc3-8ab031649078 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:58.986915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c20766-44d5-4d47-8b0b-56f57b2e5215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:58.987574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20766-44d5-4d47-8b0b-56f57b2e5215 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:58.987847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20766-44d5-4d47-8b0b-56f57b2e5215 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:58.988112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20766-44d5-4d47-8b0b-56f57b2e5215 None admin] PATH_INFO: `/v3/projects/e917870b5e964ef4a1fecad71d41d379` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:58.989527 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c20766-44d5-4d47-8b0b-56f57b2e5215 None admin] RBAC: Authorizing `identity:get_project(project_id=e917870b5e964ef4a1fecad71d41d379)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:58.990973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c20766-44d5-4d47-8b0b-56f57b2e5215 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:58.993118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 217/431] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:58 2022] GET /identity/v3/projects/e917870b5e964ef4a1fecad71d41d379 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:59.000259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c20766-44d5-4d47-8b0b-56f57b2e5215 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:59.048923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:59.064443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea6ea2-7d72-4c19-b438-2f439b753b85 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:59.083478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:59.109191 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18f4d2-9c7e-4c63-a890-165422678730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:59.110436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18f4d2-9c7e-4c63-a890-165422678730 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:59.110841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18f4d2-9c7e-4c63-a890-165422678730 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:59.111206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18f4d2-9c7e-4c63-a890-165422678730 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:59.125445 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18f4d2-9c7e-4c63-a890-165422678730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6a18f4d2-9c7e-4c63-a890-165422678730 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:59.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:59.131533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:59.132338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:59.132338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:59.132338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:59.132338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:59.132338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:59.132338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:59.132338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:59.132338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:59.132338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:59.132338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:59.132338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 07:00:59.132338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:59.136922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 215/432] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:00:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:59.138009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18f4d2-9c7e-4c63-a890-165422678730 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:59.145388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c20766-44d5-4d47-8b0b-56f57b2e5215 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:59.186164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8618d75-6285-4cee-9956-f53ad5953621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:59.186844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8618d75-6285-4cee-9956-f53ad5953621 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:59.187124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8618d75-6285-4cee-9956-f53ad5953621 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:59.187392 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8618d75-6285-4cee-9956-f53ad5953621 None admin] PATH_INFO: `/v3/groups/628fcd5514ef426e94e58250b16c246f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:59.188661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8618d75-6285-4cee-9956-f53ad5953621 None admin] RBAC: Authorizing `identity:get_group(group_id=628fcd5514ef426e94e58250b16c246f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:59.190259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8618d75-6285-4cee-9956-f53ad5953621 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:59.196558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 218/433] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:00:58 2022] GET /identity/v3/groups/628fcd5514ef426e94e58250b16c246f => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:59.196558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbe98a-3acc-432d-b19d-1a4702256c7c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:59.196558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbe98a-3acc-432d-b19d-1a4702256c7c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:59.196558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbe98a-3acc-432d-b19d-1a4702256c7c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:59.196558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 219/434] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:00:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:00:59.199987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbe98a-3acc-432d-b19d-1a4702256c7c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:59.253531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18f4d2-9c7e-4c63-a890-165422678730 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:59.294948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebadd95-df58-42cb-adbf-3bf07720ad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:59.295679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebadd95-df58-42cb-adbf-3bf07720ad70 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:59.295955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebadd95-df58-42cb-adbf-3bf07720ad70 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:59.296339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebadd95-df58-42cb-adbf-3bf07720ad70 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:59.297136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebadd95-df58-42cb-adbf-3bf07720ad70 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:59.297439 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebadd95-df58-42cb-adbf-3bf07720ad70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:59.298990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebadd95-df58-42cb-adbf-3bf07720ad70 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:59.312863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 216/435] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:00:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:59.312863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09ac12-9173-4d70-885c-60cf67e782ca None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:59.312863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09ac12-9173-4d70-885c-60cf67e782ca None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:59.312863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09ac12-9173-4d70-885c-60cf67e782ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:59.317791 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbe98a-3acc-432d-b19d-1a4702256c7c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:59.330344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7f09ac12-9173-4d70-885c-60cf67e782ca None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:00:59.331742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7f09ac12-9173-4d70-885c-60cf67e782ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:00:59.334767 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:59.351663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:59.357844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d25115-3c03-483b-88a5-358e9562fb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:59.358493 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25115-3c03-483b-88a5-358e9562fb6f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:59.359148 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25115-3c03-483b-88a5-358e9562fb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:59.359869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d25115-3c03-483b-88a5-358e9562fb6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:59.360681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d25115-3c03-483b-88a5-358e9562fb6f None admin] RBAC: Adding query filter params (group.id=628fcd5514ef426e94e58250b16c246f, role.id=2d65d41d83b24e36b4a751ac3f7fb178, scope.project.id=e917870b5e964ef4a1fecad71d41d379) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:59.361112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d25115-3c03-483b-88a5-358e9562fb6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:59.362620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d25115-3c03-483b-88a5-358e9562fb6f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:59.377116 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 220/436] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 07:00:59 2022] GET /identity/v3/role_assignments?group.id=628fcd5514ef426e94e58250b16c246f&scope.project.id=e917870b5e964ef4a1fecad71d41d379&role.id=2d65d41d83b24e36b4a751ac3f7fb178 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:00:59.378404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d25115-3c03-483b-88a5-358e9562fb6f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:59.445045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 217/437] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:00:59.482377 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09ac12-9173-4d70-885c-60cf67e782ca None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:59.532061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d25115-3c03-483b-88a5-358e9562fb6f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:59.576487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af4008-fd55-4861-b9a2-c6bd7112665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:59.576487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af4008-fd55-4861-b9a2-c6bd7112665c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:59.576487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af4008-fd55-4861-b9a2-c6bd7112665c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:59.576487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af4008-fd55-4861-b9a2-c6bd7112665c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:59.627848 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09ac12-9173-4d70-885c-60cf67e782ca None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:59.654920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:59.668909 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af4008-fd55-4861-b9a2-c6bd7112665c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:59.670445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af4008-fd55-4861-b9a2-c6bd7112665c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:59.686173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579a397-3a19-4960-9918-9fec748989f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:59.687441 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579a397-3a19-4960-9918-9fec748989f2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:59.687799 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579a397-3a19-4960-9918-9fec748989f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:59.688293 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579a397-3a19-4960-9918-9fec748989f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:59.704295 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:59.709849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579a397-3a19-4960-9918-9fec748989f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a579a397-3a19-4960-9918-9fec748989f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:00:59.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:00:59.723004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:00:59.723807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 218/438] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:00:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:00:59.733964 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579a397-3a19-4960-9918-9fec748989f2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:59.815555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 221/439] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:00:59.821601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af4008-fd55-4861-b9a2-c6bd7112665c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:59.859675 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579a397-3a19-4960-9918-9fec748989f2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:00:59.903289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32275289-fbab-47f8-af01-d6194f8cdbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:00:59.903289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32275289-fbab-47f8-af01-d6194f8cdbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:00:59.903289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32275289-fbab-47f8-af01-d6194f8cdbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:00:59.903655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32275289-fbab-47f8-af01-d6194f8cdbe9 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:00:59.904109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32275289-fbab-47f8-af01-d6194f8cdbe9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:00:59.904417 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32275289-fbab-47f8-af01-d6194f8cdbe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:00:59.905882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32275289-fbab-47f8-af01-d6194f8cdbe9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:00:59.917158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 219/440] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:00:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:00:59.922949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32275289-fbab-47f8-af01-d6194f8cdbe9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:00:59.957365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:00:59.964937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af4008-fd55-4861-b9a2-c6bd7112665c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:00.011949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:00.012880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfe033-72e4-4024-a6a1-288c93d17afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:00.013576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfe033-72e4-4024-a6a1-288c93d17afd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:00.013895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfe033-72e4-4024-a6a1-288c93d17afd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:00.014157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfe033-72e4-4024-a6a1-288c93d17afd None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:00.016137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfe033-72e4-4024-a6a1-288c93d17afd None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:00.017739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfe033-72e4-4024-a6a1-288c93d17afd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:00.019616 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 222/441] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:00:59 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:00.020601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a6348-185c-4b7d-91ed-7b14a31c8580 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:00.020884 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a6348-185c-4b7d-91ed-7b14a31c8580 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:00.021219 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a6348-185c-4b7d-91ed-7b14a31c8580 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:00.022558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 223/442] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:00.028879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a6348-185c-4b7d-91ed-7b14a31c8580 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:00.057672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32275289-fbab-47f8-af01-d6194f8cdbe9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:00.097380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36acf87-25a8-4b69-9637-555a5f340051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:00.098019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36acf87-25a8-4b69-9637-555a5f340051 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:00.098300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36acf87-25a8-4b69-9637-555a5f340051 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:00.098576 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36acf87-25a8-4b69-9637-555a5f340051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:00.149161 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a6348-185c-4b7d-91ed-7b14a31c8580 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:00.169189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36acf87-25a8-4b69-9637-555a5f340051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:00.170658 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36acf87-25a8-4b69-9637-555a5f340051 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:00.183357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43740a-2344-4a51-b617-41dc579a7bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:00.184006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43740a-2344-4a51-b617-41dc579a7bff None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:00.184292 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43740a-2344-4a51-b617-41dc579a7bff None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:00.184558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43740a-2344-4a51-b617-41dc579a7bff None admin] PATH_INFO: `/v3/groups/628fcd5514ef426e94e58250b16c246f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:00.185749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43740a-2344-4a51-b617-41dc579a7bff None admin] RBAC: Authorizing `identity:get_group(group_id=628fcd5514ef426e94e58250b16c246f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:00.187201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43740a-2344-4a51-b617-41dc579a7bff None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:00.188774 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 224/443] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:01:00 2022] GET /identity/v3/groups/628fcd5514ef426e94e58250b16c246f => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:00.190128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce55fa1-27bf-44fc-9207-055946224423 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:00.190437 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce55fa1-27bf-44fc-9207-055946224423 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:00.190686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce55fa1-27bf-44fc-9207-055946224423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:00.208875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-fce55fa1-27bf-44fc-9207-055946224423 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:00.210045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fce55fa1-27bf-44fc-9207-055946224423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:00.234198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:00.236298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:00.274909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 220/444] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:00:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 07:01:00.280028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36acf87-25a8-4b69-9637-555a5f340051 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:00.282030 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 225/445] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:00.282939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce55fa1-27bf-44fc-9207-055946224423 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:00.382428 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36acf87-25a8-4b69-9637-555a5f340051 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:00.382697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce55fa1-27bf-44fc-9207-055946224423 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:00.417573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d48387-81df-46f0-8a78-70719ac1505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:00.417818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb00b6-4b0e-482d-bcd9-5707a6c1cdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:00.418190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d48387-81df-46f0-8a78-70719ac1505f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:00.418419 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb00b6-4b0e-482d-bcd9-5707a6c1cdb0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:00.418525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d48387-81df-46f0-8a78-70719ac1505f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:00.418702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb00b6-4b0e-482d-bcd9-5707a6c1cdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:00.418794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d48387-81df-46f0-8a78-70719ac1505f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:00.418977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb00b6-4b0e-482d-bcd9-5707a6c1cdb0 None admin] PATH_INFO: `/v3/projects/4931005296114563946c84a7e790464a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:00.419509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d48387-81df-46f0-8a78-70719ac1505f None admin] RBAC: Adding query filter params (group.id=628fcd5514ef426e94e58250b16c246f, role.id=2d65d41d83b24e36b4a751ac3f7fb178, scope.project.id=4931005296114563946c84a7e790464a) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:00.419819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d48387-81df-46f0-8a78-70719ac1505f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:00.420280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb00b6-4b0e-482d-bcd9-5707a6c1cdb0 None admin] RBAC: Authorizing `identity:get_project(project_id=4931005296114563946c84a7e790464a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:00.421301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d48387-81df-46f0-8a78-70719ac1505f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:00.421806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb00b6-4b0e-482d-bcd9-5707a6c1cdb0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:00.423534 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 226/446] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:01:00 2022] GET /identity/v3/projects/4931005296114563946c84a7e790464a => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:00.424390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb00b6-4b0e-482d-bcd9-5707a6c1cdb0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:00.444927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 221/447] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 07:01:00 2022] GET /identity/v3/role_assignments?group.id=628fcd5514ef426e94e58250b16c246f&scope.project.id=4931005296114563946c84a7e790464a&role.id=2d65d41d83b24e36b4a751ac3f7fb178 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:00.444927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d48387-81df-46f0-8a78-70719ac1505f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:00.463549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:00.474947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:00.549321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb00b6-4b0e-482d-bcd9-5707a6c1cdb0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:00.565492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d48387-81df-46f0-8a78-70719ac1505f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:00.588862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6e72d-6093-41b9-b9ca-7bc2d6170560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:00.589550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6e72d-6093-41b9-b9ca-7bc2d6170560 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:00.589827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6e72d-6093-41b9-b9ca-7bc2d6170560 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:00.590097 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6e72d-6093-41b9-b9ca-7bc2d6170560 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:00.603832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6e72d-6093-41b9-b9ca-7bc2d6170560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:00.606731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5f309-b7fc-45a9-a327-e03718d65784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:00.607613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5f309-b7fc-45a9-a327-e03718d65784 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:00.608091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5f309-b7fc-45a9-a327-e03718d65784 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:00.608364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5f309-b7fc-45a9-a327-e03718d65784 None admin] PATH_INFO: `/v3/groups/628fcd5514ef426e94e58250b16c246f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e6e6e72d-6093-41b9-b9ca-7bc2d6170560 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:00.609340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:00.610195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:00.610954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:00.610954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:00.610954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:00.610954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:00.610954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:00.610954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:00.610954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:00.610954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:00.610954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:00.610954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:00.610954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:00.610954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:00.611606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5f309-b7fc-45a9-a327-e03718d65784 None admin] RBAC: Authorizing `identity:get_group(group_id=628fcd5514ef426e94e58250b16c246f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:00.611676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 227/448] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:00.611747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5f309-b7fc-45a9-a327-e03718d65784 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:00.613056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 222/449] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:01:00 2022] GET /identity/v3/groups/628fcd5514ef426e94e58250b16c246f => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:00.616919 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6e72d-6093-41b9-b9ca-7bc2d6170560 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:00.622016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5f309-b7fc-45a9-a327-e03718d65784 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:00.719450 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:00.730850 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6e72d-6093-41b9-b9ca-7bc2d6170560 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:00.733066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:00.741608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5f309-b7fc-45a9-a327-e03718d65784 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:00.771332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab6342-286b-425d-8c42-2a873a5dda41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:00.771637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab6342-286b-425d-8c42-2a873a5dda41 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:00.771902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab6342-286b-425d-8c42-2a873a5dda41 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:00.772457 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab6342-286b-425d-8c42-2a873a5dda41 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:00.772978 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab6342-286b-425d-8c42-2a873a5dda41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:00.773254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab6342-286b-425d-8c42-2a873a5dda41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:00.774634 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab6342-286b-425d-8c42-2a873a5dda41 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:00.779510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a07bbb-18b1-40c9-a2bf-08faf4022cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:00.780140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a07bbb-18b1-40c9-a2bf-08faf4022cce None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:00.780418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a07bbb-18b1-40c9-a2bf-08faf4022cce None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:00.780689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a07bbb-18b1-40c9-a2bf-08faf4022cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:00.781517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a07bbb-18b1-40c9-a2bf-08faf4022cce None admin] RBAC: Adding query filter params (group.id=628fcd5514ef426e94e58250b16c246f, role.id=04a9c139ed6d44d4bcd37b614aeb009e, scope.project.id=4931005296114563946c84a7e790464a) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:00.781826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a07bbb-18b1-40c9-a2bf-08faf4022cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:00.783303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a07bbb-18b1-40c9-a2bf-08faf4022cce None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:00.785039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 228/450] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:00.791528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab6342-286b-425d-8c42-2a873a5dda41 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:00.797143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 223/451] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 07:01:00 2022] GET /identity/v3/role_assignments?group.id=628fcd5514ef426e94e58250b16c246f&scope.project.id=4931005296114563946c84a7e790464a&role.id=04a9c139ed6d44d4bcd37b614aeb009e => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:00.900159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab6342-286b-425d-8c42-2a873a5dda41 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:00.938186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee409e-7aa9-4052-891d-17145afea74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:00.938925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee409e-7aa9-4052-891d-17145afea74a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:00.939280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee409e-7aa9-4052-891d-17145afea74a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:00.939581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee409e-7aa9-4052-891d-17145afea74a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:00.963645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:01.014964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee409e-7aa9-4052-891d-17145afea74a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:01.016439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee409e-7aa9-4052-891d-17145afea74a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:01.118668 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 229/452] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 07:01:01.124646 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a07bbb-18b1-40c9-a2bf-08faf4022cce None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:01.226630 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a07bbb-18b1-40c9-a2bf-08faf4022cce None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:01.264401 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e666b65-b086-49d3-aeb7-9eab92a1ce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:01.265144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e666b65-b086-49d3-aeb7-9eab92a1ce49 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:01.265367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e666b65-b086-49d3-aeb7-9eab92a1ce49 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:01.265647 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e666b65-b086-49d3-aeb7-9eab92a1ce49 None admin] PATH_INFO: `/v3/projects/c0ce80734b754922ab08055a8061587e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:01.266913 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e666b65-b086-49d3-aeb7-9eab92a1ce49 None admin] RBAC: Authorizing `identity:get_project(project_id=c0ce80734b754922ab08055a8061587e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:01.268358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e666b65-b086-49d3-aeb7-9eab92a1ce49 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:01.270073 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 224/453] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:01:01 2022] GET /identity/v3/projects/c0ce80734b754922ab08055a8061587e => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:01.275849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee409e-7aa9-4052-891d-17145afea74a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:01.331405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:01.387166 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee409e-7aa9-4052-891d-17145afea74a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:01.423133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c1efa-e539-4914-8e6e-61fe96e31921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:01.423864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1efa-e539-4914-8e6e-61fe96e31921 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:01.424143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1efa-e539-4914-8e6e-61fe96e31921 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:01.424413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1efa-e539-4914-8e6e-61fe96e31921 None admin] PATH_INFO: `/v3/groups/7b1705aaba634218afb35ab7ce47d5a9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:01.425633 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c1efa-e539-4914-8e6e-61fe96e31921 None admin] RBAC: Authorizing `identity:get_group(group_id=7b1705aaba634218afb35ab7ce47d5a9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:01.427085 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c1efa-e539-4914-8e6e-61fe96e31921 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:01.428672 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 230/454] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Aug 5 07:01:01 2022] GET /identity/v3/groups/7b1705aaba634218afb35ab7ce47d5a9 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:01.434852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e666b65-b086-49d3-aeb7-9eab92a1ce49 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:01.463736 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:01.543444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e666b65-b086-49d3-aeb7-9eab92a1ce49 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:01.578739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900ca1f-3fa3-4db6-a85c-6a3a27a9a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:01.579350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ca1f-3fa3-4db6-a85c-6a3a27a9a783 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:01.579631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ca1f-3fa3-4db6-a85c-6a3a27a9a783 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:01.580041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ca1f-3fa3-4db6-a85c-6a3a27a9a783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:01.580832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900ca1f-3fa3-4db6-a85c-6a3a27a9a783 None admin] RBAC: Adding query filter params (group.id=7b1705aaba634218afb35ab7ce47d5a9, role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=c0ce80734b754922ab08055a8061587e) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:01.581168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900ca1f-3fa3-4db6-a85c-6a3a27a9a783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:01.582607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900ca1f-3fa3-4db6-a85c-6a3a27a9a783 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:01.588831 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 225/455] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Aug 5 07:01:01 2022] GET /identity/v3/role_assignments?group.id=7b1705aaba634218afb35ab7ce47d5a9&scope.project.id=c0ce80734b754922ab08055a8061587e&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:04.370347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daded793-63eb-4bd1-9f37-ae8208948d5d None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:04.371107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daded793-63eb-4bd1-9f37-ae8208948d5d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:04.371107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daded793-63eb-4bd1-9f37-ae8208948d5d None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:04.372455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 231/456] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:04.382456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc08a0a-4522-4838-8fb8-e461aa541bef None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:04.383166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc08a0a-4522-4838-8fb8-e461aa541bef None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:04.383166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc08a0a-4522-4838-8fb8-e461aa541bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:04.405884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cbc08a0a-4522-4838-8fb8-e461aa541bef None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:04.407056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cbc08a0a-4522-4838-8fb8-e461aa541bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:04.504216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 226/457] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:04.540388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daded793-63eb-4bd1-9f37-ae8208948d5d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:04.650641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daded793-63eb-4bd1-9f37-ae8208948d5d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:04.672075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:04.686940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb6d15-9cd4-43f8-9db1-9bc011bb9769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:04.687593 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb6d15-9cd4-43f8-9db1-9bc011bb9769 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:04.687865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb6d15-9cd4-43f8-9db1-9bc011bb9769 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:04.688122 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb6d15-9cd4-43f8-9db1-9bc011bb9769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:04.699351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb6d15-9cd4-43f8-9db1-9bc011bb9769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:04.700805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb6d15-9cd4-43f8-9db1-9bc011bb9769 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:04.705072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed109bce-e3c4-4fa7-a4de-c5a54751d4d2 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:04.705925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed109bce-e3c4-4fa7-a4de-c5a54751d4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:04.706683 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed109bce-e3c4-4fa7-a4de-c5a54751d4d2 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-58bb6d15-9cd4-43f8-9db1-9bc011bb9769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:04.715946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:04.717902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:04.719580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:04.719580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:04.719580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:04.719580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:04.719580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 232/458] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:04.720112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 227/459] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:04 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:04.723619 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb6d15-9cd4-43f8-9db1-9bc011bb9769 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:04.730229 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45739b-aad9-4dfd-89cf-8cf723a14555 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:04.731059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45739b-aad9-4dfd-89cf-8cf723a14555 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:04.731783 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45739b-aad9-4dfd-89cf-8cf723a14555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:04.775141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ae45739b-aad9-4dfd-89cf-8cf723a14555 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:04.776738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ae45739b-aad9-4dfd-89cf-8cf723a14555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:04.805365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:04.899116 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb6d15-9cd4-43f8-9db1-9bc011bb9769 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:04.939138 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5219cb-d91b-4fe5-b0a6-8b0e55b87149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:04.939791 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5219cb-d91b-4fe5-b0a6-8b0e55b87149 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:04.940073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5219cb-d91b-4fe5-b0a6-8b0e55b87149 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:04.940347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5219cb-d91b-4fe5-b0a6-8b0e55b87149 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:04.941076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5219cb-d91b-4fe5-b0a6-8b0e55b87149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:04.941390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5219cb-d91b-4fe5-b0a6-8b0e55b87149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:04.943807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 228/460] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:01:04.944214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5219cb-d91b-4fe5-b0a6-8b0e55b87149 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:04.962245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 233/461] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:04.970032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45739b-aad9-4dfd-89cf-8cf723a14555 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:04.984469 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5219cb-d91b-4fe5-b0a6-8b0e55b87149 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:05.024611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:05.099960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45739b-aad9-4dfd-89cf-8cf723a14555 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:05.103915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5219cb-d91b-4fe5-b0a6-8b0e55b87149 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:05.134594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5bbc4-6157-4df6-98eb-186a09272f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:05.135223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5bbc4-6157-4df6-98eb-186a09272f0e None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.135502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5bbc4-6157-4df6-98eb-186a09272f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.135777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5bbc4-6157-4df6-98eb-186a09272f0e None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.136464 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5bbc4-6157-4df6-98eb-186a09272f0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:05.137931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5bbc4-6157-4df6-98eb-186a09272f0e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:05.139779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4cfc6-4551-43f8-b6c8-4b20970f596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:05.140435 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4cfc6-4551-43f8-b6c8-4b20970f596a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.140718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4cfc6-4551-43f8-b6c8-4b20970f596a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.141025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4cfc6-4551-43f8-b6c8-4b20970f596a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.154179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4cfc6-4551-43f8-b6c8-4b20970f596a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:05.156524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4cfc6-4551-43f8-b6c8-4b20970f596a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:05.164145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 229/462] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:01:04 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:01:05.165932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd130b-7a47-4449-9d9e-327c93c509f2 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.166399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd130b-7a47-4449-9d9e-327c93c509f2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.166892 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd130b-7a47-4449-9d9e-327c93c509f2 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.171067 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 230/463] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:05.176461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1236f9-5568-4f20-99c1-eca1cfe8c2f5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-30e4cfc6-4551-43f8-b6c8-4b20970f596a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:05.176803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:05.177648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:05.178688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:05.178688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:05.178688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:05.178688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:05.178688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 234/464] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:05.179461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1236f9-5568-4f20-99c1-eca1cfe8c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.179880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1236f9-5568-4f20-99c1-eca1cfe8c2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.184240 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4cfc6-4551-43f8-b6c8-4b20970f596a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:05.196166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:05.204027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8a1236f9-5568-4f20-99c1-eca1cfe8c2f5 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:05.207523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8a1236f9-5568-4f20-99c1-eca1cfe8c2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:05.307735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 231/465] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:01:05.320921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21293e23-680b-45ad-ad47-f9a727efbfb8 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.320921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21293e23-680b-45ad-ad47-f9a727efbfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.320921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21293e23-680b-45ad-ad47-f9a727efbfb8 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.320921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 232/466] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:01:05.324099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983b7e1-bf8f-4209-a5c5-f9383401470b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.324474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983b7e1-bf8f-4209-a5c5-f9383401470b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.324795 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983b7e1-bf8f-4209-a5c5-f9383401470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.333465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:05.350772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6983b7e1-bf8f-4209-a5c5-f9383401470b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:05.351981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6983b7e1-bf8f-4209-a5c5-f9383401470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:05.358888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4cfc6-4551-43f8-b6c8-4b20970f596a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:05.406174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cdee3-7d26-4e37-801c-bb43fe154fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:05.407939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cdee3-7d26-4e37-801c-bb43fe154fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.408391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cdee3-7d26-4e37-801c-bb43fe154fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.408818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cdee3-7d26-4e37-801c-bb43fe154fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.409922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cdee3-7d26-4e37-801c-bb43fe154fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:05.410410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cdee3-7d26-4e37-801c-bb43fe154fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:05.411980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cdee3-7d26-4e37-801c-bb43fe154fb6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:05.427814 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 235/467] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:05.433160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cdee3-7d26-4e37-801c-bb43fe154fb6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:05.446439 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 233/468] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:05.447309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983b7e1-bf8f-4209-a5c5-f9383401470b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:05.535509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:05.555679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cdee3-7d26-4e37-801c-bb43fe154fb6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:05.586603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983b7e1-bf8f-4209-a5c5-f9383401470b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:05.597028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9675e27-c784-4428-9f86-3f5530e21e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:05.597695 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9675e27-c784-4428-9f86-3f5530e21e38 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.598356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9675e27-c784-4428-9f86-3f5530e21e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.598356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9675e27-c784-4428-9f86-3f5530e21e38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.610051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9675e27-c784-4428-9f86-3f5530e21e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:05.611622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9675e27-c784-4428-9f86-3f5530e21e38 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:05.626015 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ecfb1-063a-4dbb-84a4-c75d261f6a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:05.627101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ecfb1-063a-4dbb-84a4-c75d261f6a71 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.627639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ecfb1-063a-4dbb-84a4-c75d261f6a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.628108 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ecfb1-063a-4dbb-84a4-c75d261f6a71 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-b9675e27-c784-4428-9f86-3f5530e21e38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:05.628340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:05.629474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:05.630320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:05.630320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:05.630320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:05.630320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:05.631606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ecfb1-063a-4dbb-84a4-c75d261f6a71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:05.633343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:05.633693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ecfb1-063a-4dbb-84a4-c75d261f6a71 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:05.634177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 236/469] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:05.635110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9675e27-c784-4428-9f86-3f5530e21e38 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:05.665530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 234/470] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:01:05 2022] POST /identity/v3/users => generated 246 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:01:05.667148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ecfb1-063a-4dbb-84a4-c75d261f6a71 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:05.756079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9675e27-c784-4428-9f86-3f5530e21e38 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:05.789501 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ecfb1-063a-4dbb-84a4-c75d261f6a71 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:05.801684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224be78-e0ec-480c-b13e-d975b38d8dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:05.802365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224be78-e0ec-480c-b13e-d975b38d8dac None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.802645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224be78-e0ec-480c-b13e-d975b38d8dac None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.802925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224be78-e0ec-480c-b13e-d975b38d8dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.816409 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224be78-e0ec-480c-b13e-d975b38d8dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:05.818024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224be78-e0ec-480c-b13e-d975b38d8dac None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:05.818835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:05.836119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614739bf-ec5f-456a-b333-c4dfb951e176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:05.837204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614739bf-ec5f-456a-b333-c4dfb951e176 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-4224be78-e0ec-480c-b13e-d975b38d8dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:05.837401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:05.838226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:05.839066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:05.839066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:05.839066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:05.839066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:05.839066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 237/471] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:05.840135 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614739bf-ec5f-456a-b333-c4dfb951e176 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.840413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f83bc7-951a-4b7f-9d1d-ab9bfc90326e None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.840693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f83bc7-951a-4b7f-9d1d-ab9bfc90326e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.841014 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f83bc7-951a-4b7f-9d1d-ab9bfc90326e None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.841231 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614739bf-ec5f-456a-b333-c4dfb951e176 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.842159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614739bf-ec5f-456a-b333-c4dfb951e176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:05.842660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614739bf-ec5f-456a-b333-c4dfb951e176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:05.842823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 238/472] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:05.844515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f83bc7-951a-4b7f-9d1d-ab9bfc90326e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:05.845326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614739bf-ec5f-456a-b333-c4dfb951e176 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:05.862403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 235/473] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:05.863631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa434fae-16be-44ea-97f4-9e33ec7d8e1e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:05.863912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa434fae-16be-44ea-97f4-9e33ec7d8e1e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:05.864186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa434fae-16be-44ea-97f4-9e33ec7d8e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:05.887192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fa434fae-16be-44ea-97f4-9e33ec7d8e1e None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:05.888843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fa434fae-16be-44ea-97f4-9e33ec7d8e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:05.924108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:05.986537 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 236/474] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:05.987648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa434fae-16be-44ea-97f4-9e33ec7d8e1e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:05.999163 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f83bc7-951a-4b7f-9d1d-ab9bfc90326e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:06.039912 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec386a6-8260-41b6-b225-d4a0eafd4276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:06.040990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec386a6-8260-41b6-b225-d4a0eafd4276 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:06.041536 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec386a6-8260-41b6-b225-d4a0eafd4276 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:06.042341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec386a6-8260-41b6-b225-d4a0eafd4276 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:06.043242 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec386a6-8260-41b6-b225-d4a0eafd4276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:06.043734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec386a6-8260-41b6-b225-d4a0eafd4276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:06.045496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec386a6-8260-41b6-b225-d4a0eafd4276 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:06.058775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 239/475] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:06.060003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec386a6-8260-41b6-b225-d4a0eafd4276 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:06.122333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa434fae-16be-44ea-97f4-9e33ec7d8e1e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:06.139724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:06.174222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b217407-bc14-4f4a-b806-e3ab42392327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:06.175701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b217407-bc14-4f4a-b806-e3ab42392327 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:06.176346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b217407-bc14-4f4a-b806-e3ab42392327 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:06.176969 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b217407-bc14-4f4a-b806-e3ab42392327 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:06.178629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b217407-bc14-4f4a-b806-e3ab42392327 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:06.180463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b217407-bc14-4f4a-b806-e3ab42392327 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:06.188407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec386a6-8260-41b6-b225-d4a0eafd4276 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:06.203234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:06.214754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 237/476] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:01:05 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:01:06.215956 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b217407-bc14-4f4a-b806-e3ab42392327 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:06.248155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cab8f-3c4c-41f2-8727-329bfef6b818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:06.249204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cab8f-3c4c-41f2-8727-329bfef6b818 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:06.249491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cab8f-3c4c-41f2-8727-329bfef6b818 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:06.249768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cab8f-3c4c-41f2-8727-329bfef6b818 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:06.250610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cab8f-3c4c-41f2-8727-329bfef6b818 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:06.252194 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cab8f-3c4c-41f2-8727-329bfef6b818 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:06.273858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.sql.core [None req-0b0cab8f-3c4c-41f2-8727-329bfef6b818 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 07:01:06.273858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 05 07:01:06.273858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [parameters: {'id': 'b9dec29f73f34e00a3153c81e51af274', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 05 07:01:06.273858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80395) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0b0cab8f-3c4c-41f2-8727-329bfef6b818 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application conn.query(q) Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application result.read() Aug 05 07:01:06.304071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return ref.to_dict() Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 07:01:06.305038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application next(self.gen) Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application yield resource Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application next(self.gen) Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise self.value Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application session.commit() Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 07:01:06.306075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self.session.flush() Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application compat.raise_( Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 07:01:06.306960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 07:01:06.307820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application conn.query(q) Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application result.read() Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 07:01:06.308612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [parameters: {'id': 'b9dec29f73f34e00a3153c81e51af274', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:06.312201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 05 07:01:06.314328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:06.316385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 240/477] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 5 07:01:06 2022] POST /identity/v3/roles => generated 144 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:06.316385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cab8f-3c4c-41f2-8727-329bfef6b818 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:06.416499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b217407-bc14-4f4a-b806-e3ab42392327 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:06.461639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa344395-0a6e-4239-b45c-5526215ffc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:06.462394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa344395-0a6e-4239-b45c-5526215ffc31 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:06.462789 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa344395-0a6e-4239-b45c-5526215ffc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:06.463262 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa344395-0a6e-4239-b45c-5526215ffc31 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:06.464446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa344395-0a6e-4239-b45c-5526215ffc31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:06.466510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa344395-0a6e-4239-b45c-5526215ffc31 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:06.495703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 238/478] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:01:06 2022] POST /identity/v3/users => generated 249 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:01:06.518417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cab8f-3c4c-41f2-8727-329bfef6b818 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:06.561832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c08044-f40c-4f09-aad4-3a2f0cb03ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:06.562616 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c08044-f40c-4f09-aad4-3a2f0cb03ece None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:06.562909 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c08044-f40c-4f09-aad4-3a2f0cb03ece None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:06.563185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c08044-f40c-4f09-aad4-3a2f0cb03ece None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:06.577826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c08044-f40c-4f09-aad4-3a2f0cb03ece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-90c08044-f40c-4f09-aad4-3a2f0cb03ece None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:06.583755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:06.585969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:06.587784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 241/479] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:01:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:06.591461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa344395-0a6e-4239-b45c-5526215ffc31 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:06.626912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:06.718269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa344395-0a6e-4239-b45c-5526215ffc31 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:06.759415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdcd71-0616-4687-9df4-73ea09ce0ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:06.760060 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdcd71-0616-4687-9df4-73ea09ce0ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:06.760378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdcd71-0616-4687-9df4-73ea09ce0ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:06.760652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdcd71-0616-4687-9df4-73ea09ce0ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:06.761426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdcd71-0616-4687-9df4-73ea09ce0ab5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:06.761729 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdcd71-0616-4687-9df4-73ea09ce0ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:06.763174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdcd71-0616-4687-9df4-73ea09ce0ab5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:06.773353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 239/480] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:07.643937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bd349-159f-4a1f-ad3f-a39a92628bca None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:07.644772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bd349-159f-4a1f-ad3f-a39a92628bca None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:07.645217 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bd349-159f-4a1f-ad3f-a39a92628bca None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:07.647353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 242/481] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:07.652654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308623a9-a029-4e9b-a947-d13573efa95b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:07.653516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308623a9-a029-4e9b-a947-d13573efa95b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:07.653938 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308623a9-a029-4e9b-a947-d13573efa95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:07.682024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-308623a9-a029-4e9b-a947-d13573efa95b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:07.683495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-308623a9-a029-4e9b-a947-d13573efa95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:07.782897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 240/482] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:07.830518 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bd349-159f-4a1f-ad3f-a39a92628bca None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:07.874089 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:07.982675 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bd349-159f-4a1f-ad3f-a39a92628bca None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:08.031026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36395519-6a8d-4225-8591-6161ddfa29b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:08.031957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36395519-6a8d-4225-8591-6161ddfa29b0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:08.032411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36395519-6a8d-4225-8591-6161ddfa29b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:08.032928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36395519-6a8d-4225-8591-6161ddfa29b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:08.051384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36395519-6a8d-4225-8591-6161ddfa29b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-36395519-6a8d-4225-8591-6161ddfa29b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:08.056712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:08.057809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:08.058790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:08.058790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:08.058790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:08.058790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:08.058790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:08.058790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:08.058790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:08.058790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:08.058790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:08.058790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:08.058790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:08.058790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:08.061217 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 243/483] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:08.067369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308623a9-a029-4e9b-a947-d13573efa95b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:08.089048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:08.122981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4885ec5-53ca-4bf4-8ccf-7beca25c255c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:08.123541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4885ec5-53ca-4bf4-8ccf-7beca25c255c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:08.123960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4885ec5-53ca-4bf4-8ccf-7beca25c255c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:08.125507 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 244/484] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:01:08.133326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11a10-1e70-4245-bcb0-34fda9a7c8f7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:08.133613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11a10-1e70-4245-bcb0-34fda9a7c8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:08.133960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11a10-1e70-4245-bcb0-34fda9a7c8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:08.165661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c9c11a10-1e70-4245-bcb0-34fda9a7c8f7 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:08.167012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c9c11a10-1e70-4245-bcb0-34fda9a7c8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:08.215800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308623a9-a029-4e9b-a947-d13573efa95b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:08.252065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d90685-40d3-4f0f-aa84-a8ea8d6e4c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:08.252660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90685-40d3-4f0f-aa84-a8ea8d6e4c33 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:08.252961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90685-40d3-4f0f-aa84-a8ea8d6e4c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:08.253265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90685-40d3-4f0f-aa84-a8ea8d6e4c33 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:08.254115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90685-40d3-4f0f-aa84-a8ea8d6e4c33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:08.254415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90685-40d3-4f0f-aa84-a8ea8d6e4c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:08.255785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90685-40d3-4f0f-aa84-a8ea8d6e4c33 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:08.265020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 241/485] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:08.279402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d90685-40d3-4f0f-aa84-a8ea8d6e4c33 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:08.281280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 245/486] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:01:08.348710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c11a10-1e70-4245-bcb0-34fda9a7c8f7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:08.397879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:08.448661 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:08.496372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d90685-40d3-4f0f-aa84-a8ea8d6e4c33 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:08.510360 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c11a10-1e70-4245-bcb0-34fda9a7c8f7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:08.548278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd83078-92db-48a8-b413-b6c9c9c25777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:08.549519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83078-92db-48a8-b413-b6c9c9c25777 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:08.549996 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83078-92db-48a8-b413-b6c9c9c25777 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:08.550491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83078-92db-48a8-b413-b6c9c9c25777 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:08.556409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb70b0c-ea43-41f2-8ea2-cd18a8d0395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:08.557009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb70b0c-ea43-41f2-8ea2-cd18a8d0395b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:08.557267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb70b0c-ea43-41f2-8ea2-cd18a8d0395b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:08.557537 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb70b0c-ea43-41f2-8ea2-cd18a8d0395b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:08.563512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd83078-92db-48a8-b413-b6c9c9c25777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-4bd83078-92db-48a8-b413-b6c9c9c25777 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:08.568917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:08.569796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:08.570563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:08.570563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:08.570563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:08.570563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:08.570563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:08.570563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:08.570563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:08.570563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:08.570563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:08.570563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:08.570563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:08.570563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:08.571186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb70b0c-ea43-41f2-8ea2-cd18a8d0395b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:08.572111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb70b0c-ea43-41f2-8ea2-cd18a8d0395b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:08.573525 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 246/487] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:08.579820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd83078-92db-48a8-b413-b6c9c9c25777 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4fb70b0c-ea43-41f2-8ea2-cd18a8d0395b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:08.589120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:08.590061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:08.590910 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:08.590910 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:08.590910 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:08.590910 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:08.590910 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 242/488] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:08.596781 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb70b0c-ea43-41f2-8ea2-cd18a8d0395b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:08.677134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:08.698849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd83078-92db-48a8-b413-b6c9c9c25777 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:08.709813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb70b0c-ea43-41f2-8ea2-cd18a8d0395b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:08.736297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a60f8f-c9a5-456c-8033-1345dd1ef516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:08.737347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a60f8f-c9a5-456c-8033-1345dd1ef516 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:08.737827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a60f8f-c9a5-456c-8033-1345dd1ef516 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:08.738328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a60f8f-c9a5-456c-8033-1345dd1ef516 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:08.739247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a60f8f-c9a5-456c-8033-1345dd1ef516 None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:08.739811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a60f8f-c9a5-456c-8033-1345dd1ef516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:08.741466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a60f8f-c9a5-456c-8033-1345dd1ef516 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:08.746099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:08.751711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 247/489] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:08.762931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a60f8f-c9a5-456c-8033-1345dd1ef516 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:08.765512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff901-31c4-43d0-8e14-ecaa8b854448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:08.766582 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff901-31c4-43d0-8e14-ecaa8b854448 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:08.767141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff901-31c4-43d0-8e14-ecaa8b854448 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:08.767536 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cff901-31c4-43d0-8e14-ecaa8b854448 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:08.769107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cff901-31c4-43d0-8e14-ecaa8b854448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:08.769511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cff901-31c4-43d0-8e14-ecaa8b854448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:08.776943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cff901-31c4-43d0-8e14-ecaa8b854448 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:08.790052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 243/490] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:08.792997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff901-31c4-43d0-8e14-ecaa8b854448 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:08.884101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a60f8f-c9a5-456c-8033-1345dd1ef516 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:08.925000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5c1e8-be4a-4273-a111-a62015f1d128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:08.926039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5c1e8-be4a-4273-a111-a62015f1d128 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:08.926531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5c1e8-be4a-4273-a111-a62015f1d128 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:08.926996 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5c1e8-be4a-4273-a111-a62015f1d128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:08.938891 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5c1e8-be4a-4273-a111-a62015f1d128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:08.940779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5c1e8-be4a-4273-a111-a62015f1d128 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:08.948957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cff901-31c4-43d0-8e14-ecaa8b854448 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:08.957541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-ecc5c1e8-be4a-4273-a111-a62015f1d128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:08.964904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:08.965993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:08.966881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:08.966881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:08.966881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:08.966881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:08.967086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 248/491] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:08.981541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5c1e8-be4a-4273-a111-a62015f1d128 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:09.003303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bb9d7-0822-4925-b6b1-1060572150bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:09.004271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bb9d7-0822-4925-b6b1-1060572150bf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.004826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bb9d7-0822-4925-b6b1-1060572150bf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.005259 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bb9d7-0822-4925-b6b1-1060572150bf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.019885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bb9d7-0822-4925-b6b1-1060572150bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:09.022519 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bb9d7-0822-4925-b6b1-1060572150bf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8e2bb9d7-0822-4925-b6b1-1060572150bf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:09.047112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:09.048079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:09.049204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:09.049204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:09.049204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:09.049204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:09.049204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:09.049204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:09.049204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:09.049204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:09.049204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 07:01:09.049204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:09.049204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 244/492] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:09.050779 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4265ea-fa93-43f3-8dcf-4f28734dbb2d None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.055314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4265ea-fa93-43f3-8dcf-4f28734dbb2d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.055314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4265ea-fa93-43f3-8dcf-4f28734dbb2d None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.056875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 245/493] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:09.058393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4265ea-fa93-43f3-8dcf-4f28734dbb2d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:09.124309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:09.153201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5c1e8-be4a-4273-a111-a62015f1d128 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:09.189478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723a105-8595-4053-8bd5-9cf30aaa2c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:09.189690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4265ea-fa93-43f3-8dcf-4f28734dbb2d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:09.190098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723a105-8595-4053-8bd5-9cf30aaa2c12 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.190376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723a105-8595-4053-8bd5-9cf30aaa2c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.190649 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723a105-8595-4053-8bd5-9cf30aaa2c12 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.191396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723a105-8595-4053-8bd5-9cf30aaa2c12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:09.191699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723a105-8595-4053-8bd5-9cf30aaa2c12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:09.193168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723a105-8595-4053-8bd5-9cf30aaa2c12 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:09.205905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 249/494] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:09.211341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f8dc7-3fff-481f-a371-ff83d5da4786 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.211624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f8dc7-3fff-481f-a371-ff83d5da4786 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.211903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f8dc7-3fff-481f-a371-ff83d5da4786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.225529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5954d6-8e67-4474-a6eb-6d2fd4ddca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:09.225856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5954d6-8e67-4474-a6eb-6d2fd4ddca7d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.226138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5954d6-8e67-4474-a6eb-6d2fd4ddca7d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.226410 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5954d6-8e67-4474-a6eb-6d2fd4ddca7d None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.227212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5954d6-8e67-4474-a6eb-6d2fd4ddca7d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:09.227524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5954d6-8e67-4474-a6eb-6d2fd4ddca7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:09.228995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5954d6-8e67-4474-a6eb-6d2fd4ddca7d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:09.230725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b20f8dc7-3fff-481f-a371-ff83d5da4786 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:09.231909 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b20f8dc7-3fff-481f-a371-ff83d5da4786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:09.279740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 246/495] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 5 07:01:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:09.279740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83620bf5-133c-4c45-a4b0-8be8bd875fb3 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.279740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83620bf5-133c-4c45-a4b0-8be8bd875fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.279740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83620bf5-133c-4c45-a4b0-8be8bd875fb3 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.283198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 247/496] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:09.283963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83620bf5-133c-4c45-a4b0-8be8bd875fb3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:09.290664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:09.316928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 250/497] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:09.316928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f8dc7-3fff-481f-a371-ff83d5da4786 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:09.401573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83620bf5-133c-4c45-a4b0-8be8bd875fb3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:09.413777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:09.418262 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f8dc7-3fff-481f-a371-ff83d5da4786 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:09.440106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bb308-6f01-4735-aaec-212efb228303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:09.440759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bb308-6f01-4735-aaec-212efb228303 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.441067 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bb308-6f01-4735-aaec-212efb228303 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.441343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bb308-6f01-4735-aaec-212efb228303 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.449011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bb308-6f01-4735-aaec-212efb228303 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:09.450460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bb308-6f01-4735-aaec-212efb228303 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:09.455203 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c4fab-f2c2-4790-9bf1-34c5260df9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:09.455826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c4fab-f2c2-4790-9bf1-34c5260df9dd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.456100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c4fab-f2c2-4790-9bf1-34c5260df9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.456369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c4fab-f2c2-4790-9bf1-34c5260df9dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-5d5bb308-6f01-4735-aaec-212efb228303 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:09.462524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:09.463438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 248/498] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 07:01:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ed350-95b1-4571-bc0b-59b913f8cfd6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.469154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ed350-95b1-4571-bc0b-59b913f8cfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.469839 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ed350-95b1-4571-bc0b-59b913f8cfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.484298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-620ed350-95b1-4571-bc0b-59b913f8cfd6 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:09.485526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-620ed350-95b1-4571-bc0b-59b913f8cfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:09.516819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:09.532598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c4fab-f2c2-4790-9bf1-34c5260df9dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:09.534117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c4fab-f2c2-4790-9bf1-34c5260df9dd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:09.565268 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 249/499] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:09.565268 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ed350-95b1-4571-bc0b-59b913f8cfd6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:09.643052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 251/500] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:09.643923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c4fab-f2c2-4790-9bf1-34c5260df9dd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:09.661908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:09.666949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ed350-95b1-4571-bc0b-59b913f8cfd6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:09.703971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a13ebd-5ee7-4d47-b203-514ffc47bf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:09.704854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a13ebd-5ee7-4d47-b203-514ffc47bf56 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.705222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a13ebd-5ee7-4d47-b203-514ffc47bf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.705498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a13ebd-5ee7-4d47-b203-514ffc47bf56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.715957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a13ebd-5ee7-4d47-b203-514ffc47bf56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-52a13ebd-5ee7-4d47-b203-514ffc47bf56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:09.720971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:09.722036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:09.722988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 250/501] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:09.724304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc6b4-116c-42de-9206-9dbbe59fc1df None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.724304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc6b4-116c-42de-9206-9dbbe59fc1df None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.724304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc6b4-116c-42de-9206-9dbbe59fc1df None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.728963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 251/502] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:09.728963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc6b4-116c-42de-9206-9dbbe59fc1df None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:09.737978 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:09.753703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c4fab-f2c2-4790-9bf1-34c5260df9dd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:09.787591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b5c9f-c136-4385-8eff-53a705658ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:09.788125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5c9f-c136-4385-8eff-53a705658ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.788749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5c9f-c136-4385-8eff-53a705658ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.789053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b5c9f-c136-4385-8eff-53a705658ea0 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.789851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b5c9f-c136-4385-8eff-53a705658ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:09.790160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b5c9f-c136-4385-8eff-53a705658ea0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:09.791626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b5c9f-c136-4385-8eff-53a705658ea0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:09.827174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc6b4-116c-42de-9206-9dbbe59fc1df None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:09.827618 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 252/503] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 07:01:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:09.828442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b5c9f-c136-4385-8eff-53a705658ea0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:09.866547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a143-4bed-4ed3-ad83-4fab835d4d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:09.867190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a143-4bed-4ed3-ad83-4fab835d4d1e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.867467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a143-4bed-4ed3-ad83-4fab835d4d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.867739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32a143-4bed-4ed3-ad83-4fab835d4d1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.878312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32a143-4bed-4ed3-ad83-4fab835d4d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4c32a143-4bed-4ed3-ad83-4fab835d4d1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:09.883296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:09.884336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:09.885257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 252/504] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:09.886335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a143-4bed-4ed3-ad83-4fab835d4d1e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:09.905344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:09.929817 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b5c9f-c136-4385-8eff-53a705658ea0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:09.965811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90da0b-9a3a-4e13-9ef7-8edce5b00447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:09.966474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90da0b-9a3a-4e13-9ef7-8edce5b00447 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.966941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90da0b-9a3a-4e13-9ef7-8edce5b00447 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.967081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90da0b-9a3a-4e13-9ef7-8edce5b00447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:09.978543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90da0b-9a3a-4e13-9ef7-8edce5b00447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:09.980021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90da0b-9a3a-4e13-9ef7-8edce5b00447 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:09.982765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:09.988457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32a143-4bed-4ed3-ad83-4fab835d4d1e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-2e90da0b-9a3a-4e13-9ef7-8edce5b00447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:09.996620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:09.997500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:09.997500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:09.997500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:09.997500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:09.997500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 253/505] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:09.998156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fd623-0afc-48f5-9738-3d88c2132a2c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:09.998432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fd623-0afc-48f5-9738-3d88c2132a2c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:09.998736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fd623-0afc-48f5-9738-3d88c2132a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:10.016942 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-993fd623-0afc-48f5-9738-3d88c2132a2c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:10.018198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-993fd623-0afc-48f5-9738-3d88c2132a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:10.028004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d538278-a461-44bd-8ef6-28e5d9b476b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:10.028642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d538278-a461-44bd-8ef6-28e5d9b476b3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:10.028961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d538278-a461-44bd-8ef6-28e5d9b476b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:10.029243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d538278-a461-44bd-8ef6-28e5d9b476b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:10.029964 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d538278-a461-44bd-8ef6-28e5d9b476b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:10.030273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d538278-a461-44bd-8ef6-28e5d9b476b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:10.031650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d538278-a461-44bd-8ef6-28e5d9b476b3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:10.044949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 253/506] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:10.044949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d538278-a461-44bd-8ef6-28e5d9b476b3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:10.089762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 254/507] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:10.090633 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fd623-0afc-48f5-9738-3d88c2132a2c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:10.144747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:10.165638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d538278-a461-44bd-8ef6-28e5d9b476b3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:10.191625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fd623-0afc-48f5-9738-3d88c2132a2c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:10.200219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4490f2e-5870-4dc2-9d88-913319a4b230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:10.200833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4490f2e-5870-4dc2-9d88-913319a4b230 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:10.201174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4490f2e-5870-4dc2-9d88-913319a4b230 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:10.201449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4490f2e-5870-4dc2-9d88-913319a4b230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:10.217603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:10.226693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a67c57-8621-4189-a73d-b0a8abbb000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:10.227313 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a67c57-8621-4189-a73d-b0a8abbb000e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:10.227607 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a67c57-8621-4189-a73d-b0a8abbb000e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:10.227857 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a67c57-8621-4189-a73d-b0a8abbb000e None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:10.228568 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a67c57-8621-4189-a73d-b0a8abbb000e None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:10.228864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a67c57-8621-4189-a73d-b0a8abbb000e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:10.230271 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a67c57-8621-4189-a73d-b0a8abbb000e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:10.238571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 255/508] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:10.239372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a67c57-8621-4189-a73d-b0a8abbb000e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:10.276686 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4490f2e-5870-4dc2-9d88-913319a4b230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:10.278203 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4490f2e-5870-4dc2-9d88-913319a4b230 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:10.340555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a67c57-8621-4189-a73d-b0a8abbb000e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:10.358211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:10.374576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79a749-46cb-4a2b-ad50-4164b65c2437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:10.375491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79a749-46cb-4a2b-ad50-4164b65c2437 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:10.375767 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79a749-46cb-4a2b-ad50-4164b65c2437 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:10.376036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79a749-46cb-4a2b-ad50-4164b65c2437 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:10.376746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79a749-46cb-4a2b-ad50-4164b65c2437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:10.377081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79a749-46cb-4a2b-ad50-4164b65c2437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:10.378197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 254/509] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:10.378456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79a749-46cb-4a2b-ad50-4164b65c2437 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:10.379051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4490f2e-5870-4dc2-9d88-913319a4b230 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:10.391202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 256/510] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:10.391871 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79a749-46cb-4a2b-ad50-4164b65c2437 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:10.441185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:10.478573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4490f2e-5870-4dc2-9d88-913319a4b230 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:10.492108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79a749-46cb-4a2b-ad50-4164b65c2437 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:10.512975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a90e85-297e-43ba-bede-b05dc2dee2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:10.513638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a90e85-297e-43ba-bede-b05dc2dee2ec None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:10.513920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a90e85-297e-43ba-bede-b05dc2dee2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:10.514200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a90e85-297e-43ba-bede-b05dc2dee2ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:10.525460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a90e85-297e-43ba-bede-b05dc2dee2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:10.526545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81486b2-b78a-4b42-939b-05c739dac4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:10.526955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a90e85-297e-43ba-bede-b05dc2dee2ec None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:10.527201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81486b2-b78a-4b42-939b-05c739dac4db None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:10.527480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81486b2-b78a-4b42-939b-05c739dac4db None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:10.527753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81486b2-b78a-4b42-939b-05c739dac4db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:10.539232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81486b2-b78a-4b42-939b-05c739dac4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:10.540710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81486b2-b78a-4b42-939b-05c739dac4db None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-63a90e85-297e-43ba-bede-b05dc2dee2ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:10.543427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:10.544270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:10.545390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:10.545390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:10.545390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:10.545390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:10.545390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 255/511] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:10.545788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a90e85-297e-43ba-bede-b05dc2dee2ec None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-f81486b2-b78a-4b42-939b-05c739dac4db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:10.555660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:10.556682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:10.557609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:10.557609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:10.557609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:10.557609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:10.557609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 257/512] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:10.557940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81486b2-b78a-4b42-939b-05c739dac4db None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:10.584755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:10.655065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a90e85-297e-43ba-bede-b05dc2dee2ec None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:10.658703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:10.661903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81486b2-b78a-4b42-939b-05c739dac4db None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:10.690350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3304894-5b5d-47fd-8a36-4aa363870047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:10.690999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304894-5b5d-47fd-8a36-4aa363870047 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:10.691279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304894-5b5d-47fd-8a36-4aa363870047 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:10.691552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304894-5b5d-47fd-8a36-4aa363870047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:10.696643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636c31b-e28b-4dc3-84bf-6cf18a4909d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:10.697321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636c31b-e28b-4dc3-84bf-6cf18a4909d7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:10.697604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636c31b-e28b-4dc3-84bf-6cf18a4909d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:10.697880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636c31b-e28b-4dc3-84bf-6cf18a4909d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:10.702913 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3304894-5b5d-47fd-8a36-4aa363870047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:10.704399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3304894-5b5d-47fd-8a36-4aa363870047 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:10.708751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636c31b-e28b-4dc3-84bf-6cf18a4909d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:10.710282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636c31b-e28b-4dc3-84bf-6cf18a4909d7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d3304894-5b5d-47fd-8a36-4aa363870047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:10.718976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:10.720304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:10.721194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:10.721194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:10.721194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:10.721194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:10.721194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 256/513] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:10.721194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3304894-5b5d-47fd-8a36-4aa363870047 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e636c31b-e28b-4dc3-84bf-6cf18a4909d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:10.725401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:10.726681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:10.728156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:10.728156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:10.728156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:10.728156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:10.728156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 258/514] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:10.728156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636c31b-e28b-4dc3-84bf-6cf18a4909d7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:10.811572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:10.828552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3304894-5b5d-47fd-8a36-4aa363870047 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:10.830602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636c31b-e28b-4dc3-84bf-6cf18a4909d7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:10.865084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cba094-e647-426a-bfbb-ff1ee61494ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:10.865373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddb3d2-104e-433d-b8fb-c6a9cc071620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:10.865740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cba094-e647-426a-bfbb-ff1ee61494ce None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:10.865995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddb3d2-104e-433d-b8fb-c6a9cc071620 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:10.866085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cba094-e647-426a-bfbb-ff1ee61494ce None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:10.866271 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddb3d2-104e-433d-b8fb-c6a9cc071620 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:10.866376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cba094-e647-426a-bfbb-ff1ee61494ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:10.866541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddb3d2-104e-433d-b8fb-c6a9cc071620 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:10.867228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddb3d2-104e-433d-b8fb-c6a9cc071620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:10.867528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddb3d2-104e-433d-b8fb-c6a9cc071620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:10.868973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ddb3d2-104e-433d-b8fb-c6a9cc071620 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:10.873724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cba094-e647-426a-bfbb-ff1ee61494ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:10.875162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cba094-e647-426a-bfbb-ff1ee61494ce None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:10.881533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 259/515] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:10.882401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddb3d2-104e-433d-b8fb-c6a9cc071620 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-16cba094-e647-426a-bfbb-ff1ee61494ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:10.888562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:10.889640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:10.890487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:10.890487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:10.890487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:10.890487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:10.890487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:10.890487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:10.890487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:10.890487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:10.890487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 257/516] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:10.890964 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cba094-e647-426a-bfbb-ff1ee61494ce None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:10.900839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:10.987191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ddb3d2-104e-433d-b8fb-c6a9cc071620 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:10.990445 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cba094-e647-426a-bfbb-ff1ee61494ce None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:11.020848 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3603b23-c3de-4133-83ae-9d9b15917061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:11.021498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3603b23-c3de-4133-83ae-9d9b15917061 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:11.021779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3603b23-c3de-4133-83ae-9d9b15917061 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:11.022052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3603b23-c3de-4133-83ae-9d9b15917061 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:11.022728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3603b23-c3de-4133-83ae-9d9b15917061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:11.023028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3603b23-c3de-4133-83ae-9d9b15917061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:11.023527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98150f-8d8d-40be-ad95-ae359354dfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:11.024147 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98150f-8d8d-40be-ad95-ae359354dfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:11.024406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3603b23-c3de-4133-83ae-9d9b15917061 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:11.024507 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98150f-8d8d-40be-ad95-ae359354dfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:11.024676 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98150f-8d8d-40be-ad95-ae359354dfb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:11.025407 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98150f-8d8d-40be-ad95-ae359354dfb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:11.025711 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98150f-8d8d-40be-ad95-ae359354dfb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:11.027043 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98150f-8d8d-40be-ad95-ae359354dfb1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:11.035949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 260/517] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:11.036752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3603b23-c3de-4133-83ae-9d9b15917061 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:11.039145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 258/518] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:11.039929 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98150f-8d8d-40be-ad95-ae359354dfb1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:11.043693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:11.111490 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:11.139420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98150f-8d8d-40be-ad95-ae359354dfb1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:11.141870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3603b23-c3de-4133-83ae-9d9b15917061 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:11.174542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124e1b5-3b6e-4155-b651-1c1b6b1fd3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:11.175200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124e1b5-3b6e-4155-b651-1c1b6b1fd3ce None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:11.175300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29406d-6877-4cd0-bd51-22225f7501f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:11.175483 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124e1b5-3b6e-4155-b651-1c1b6b1fd3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:11.175760 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124e1b5-3b6e-4155-b651-1c1b6b1fd3ce None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:11.175848 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29406d-6877-4cd0-bd51-22225f7501f9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:11.176097 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29406d-6877-4cd0-bd51-22225f7501f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:11.176368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29406d-6877-4cd0-bd51-22225f7501f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:11.177084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29406d-6877-4cd0-bd51-22225f7501f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:11.177385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29406d-6877-4cd0-bd51-22225f7501f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:11.178760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29406d-6877-4cd0-bd51-22225f7501f9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:11.183362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124e1b5-3b6e-4155-b651-1c1b6b1fd3ce None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:11.184807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124e1b5-3b6e-4155-b651-1c1b6b1fd3ce None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:11.191192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 261/519] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:11.192020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29406d-6877-4cd0-bd51-22225f7501f9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c124e1b5-3b6e-4155-b651-1c1b6b1fd3ce None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:11.201682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:11.202816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:11.204074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:11.204074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:11.204074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:11.204074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:11.204074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:11.204074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:11.204074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:11.204074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:11.204074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 07:01:11.204074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:11.204074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 259/520] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:11.204074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124e1b5-3b6e-4155-b651-1c1b6b1fd3ce None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:11.269742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:11.297156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29406d-6877-4cd0-bd51-22225f7501f9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:11.311188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124e1b5-3b6e-4155-b651-1c1b6b1fd3ce None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:11.328446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:11.334265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c8452-8842-4be7-b709-292a17d7bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:11.334889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c8452-8842-4be7-b709-292a17d7bbee None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:11.335170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c8452-8842-4be7-b709-292a17d7bbee None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:11.335443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c8452-8842-4be7-b709-292a17d7bbee None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:11.336196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c8452-8842-4be7-b709-292a17d7bbee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:11.336504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c8452-8842-4be7-b709-292a17d7bbee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:11.338006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c8452-8842-4be7-b709-292a17d7bbee None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:11.346447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5206-3a70-4922-8e41-f14aacbb6fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:11.347072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5206-3a70-4922-8e41-f14aacbb6fd0 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:11.347353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5206-3a70-4922-8e41-f14aacbb6fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:11.347683 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5206-3a70-4922-8e41-f14aacbb6fd0 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:11.348372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d5206-3a70-4922-8e41-f14aacbb6fd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:11.349871 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d5206-3a70-4922-8e41-f14aacbb6fd0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:11.356025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 262/521] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:11.356879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c8452-8842-4be7-b709-292a17d7bbee None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:11.375463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 260/522] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:01:11 2022] POST /identity/v3/users => generated 247 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:01:11.376411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5206-3a70-4922-8e41-f14aacbb6fd0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:11.470420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c8452-8842-4be7-b709-292a17d7bbee None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:11.508922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5206-3a70-4922-8e41-f14aacbb6fd0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:11.510938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55517f-b836-4e8b-be30-7ae0a0d90456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:11.511617 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55517f-b836-4e8b-be30-7ae0a0d90456 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:11.511897 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55517f-b836-4e8b-be30-7ae0a0d90456 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:11.512171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55517f-b836-4e8b-be30-7ae0a0d90456 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:11.521111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55517f-b836-4e8b-be30-7ae0a0d90456 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:11.522571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55517f-b836-4e8b-be30-7ae0a0d90456 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:11.534930 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-3a55517f-b836-4e8b-be30-7ae0a0d90456 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:11.537809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:11.539073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:11.540308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:11.540308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:11.540308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:11.540308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:11.540308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:11.540308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:11.540308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:11.540308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:11.540308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 07:01:11.540308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:11.540308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 263/523] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:11.541181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55517f-b836-4e8b-be30-7ae0a0d90456 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:11.555037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edca33-0199-4b2b-8707-ef2a039a480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:11.555976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edca33-0199-4b2b-8707-ef2a039a480c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:11.556258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edca33-0199-4b2b-8707-ef2a039a480c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:11.557037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edca33-0199-4b2b-8707-ef2a039a480c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:11.566421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edca33-0199-4b2b-8707-ef2a039a480c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:11.567894 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edca33-0199-4b2b-8707-ef2a039a480c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d8edca33-0199-4b2b-8707-ef2a039a480c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:11.580590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:11.581752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:11.582601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:11.582601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:11.582601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:11.582601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:11.582601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:11.582601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:11.582601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:11.582601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:11.583056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 261/524] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:11.584438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edca33-0199-4b2b-8707-ef2a039a480c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:11.611599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:11.663626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55517f-b836-4e8b-be30-7ae0a0d90456 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:11.699030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edca33-0199-4b2b-8707-ef2a039a480c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:11.700867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbc2ec-97a1-41da-a844-69b212102489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:11.701598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbc2ec-97a1-41da-a844-69b212102489 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:11.701947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbc2ec-97a1-41da-a844-69b212102489 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:11.702229 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbc2ec-97a1-41da-a844-69b212102489 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:11.703042 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbc2ec-97a1-41da-a844-69b212102489 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:11.703342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbc2ec-97a1-41da-a844-69b212102489 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:11.704853 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbc2ec-97a1-41da-a844-69b212102489 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:11.723659 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 264/525] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 5 07:01:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:11.724466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbc2ec-97a1-41da-a844-69b212102489 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:11.741189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8ec7-d6aa-42af-acd9-26228625229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:11.741888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8ec7-d6aa-42af-acd9-26228625229b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:11.742082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8ec7-d6aa-42af-acd9-26228625229b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:11.742353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8ec7-d6aa-42af-acd9-26228625229b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:11.743140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f8ec7-d6aa-42af-acd9-26228625229b None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=1c3d7cdad7f44f0f8df944ec7f69de26) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:11.743445 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f8ec7-d6aa-42af-acd9-26228625229b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:11.744888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f8ec7-d6aa-42af-acd9-26228625229b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:11.751200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 262/526] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:11 2022] GET /identity/v3/role_assignments?user.id=1c3d7cdad7f44f0f8df944ec7f69de26&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:11.751200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8ec7-d6aa-42af-acd9-26228625229b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:11.851096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbc2ec-97a1-41da-a844-69b212102489 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:11.864265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:11.870095 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:11.896645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b809e5-08b2-4210-b08f-e9456b4bad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:11.897544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b809e5-08b2-4210-b08f-e9456b4bad28 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:11.898005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b809e5-08b2-4210-b08f-e9456b4bad28 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:11.898378 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b809e5-08b2-4210-b08f-e9456b4bad28 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:11.899269 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b809e5-08b2-4210-b08f-e9456b4bad28 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:11.899645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b809e5-08b2-4210-b08f-e9456b4bad28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:11.901251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b809e5-08b2-4210-b08f-e9456b4bad28 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:11.905259 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8ec7-d6aa-42af-acd9-26228625229b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:11.925095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 265/527] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Aug 5 07:01:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:11.925632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b809e5-08b2-4210-b08f-e9456b4bad28 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:11.958638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d03e5-9a04-4a1a-836a-80d24cffdea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:11.959611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d03e5-9a04-4a1a-836a-80d24cffdea7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:11.959953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d03e5-9a04-4a1a-836a-80d24cffdea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:11.960288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d03e5-9a04-4a1a-836a-80d24cffdea7 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:11.961367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d03e5-9a04-4a1a-836a-80d24cffdea7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:11.961738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d03e5-9a04-4a1a-836a-80d24cffdea7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:11.964102 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d03e5-9a04-4a1a-836a-80d24cffdea7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:11.988735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 263/528] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:11.989724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d03e5-9a04-4a1a-836a-80d24cffdea7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:12.043482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b809e5-08b2-4210-b08f-e9456b4bad28 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:12.080130 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cb917-f4de-41b4-8db6-5b8afb450f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:12.081152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cb917-f4de-41b4-8db6-5b8afb450f64 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:12.081612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cb917-f4de-41b4-8db6-5b8afb450f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:12.082161 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cb917-f4de-41b4-8db6-5b8afb450f64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:12.125860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:12.137070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d03e5-9a04-4a1a-836a-80d24cffdea7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:12.140457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:12.175136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21fea4-cccd-4662-85dd-6908d22fcda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:12.175799 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21fea4-cccd-4662-85dd-6908d22fcda7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:12.176079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21fea4-cccd-4662-85dd-6908d22fcda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:12.176356 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21fea4-cccd-4662-85dd-6908d22fcda7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:12.176710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cb917-f4de-41b4-8db6-5b8afb450f64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:12.178420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cb917-f4de-41b4-8db6-5b8afb450f64 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:12.260221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21fea4-cccd-4662-85dd-6908d22fcda7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:12.265157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21fea4-cccd-4662-85dd-6908d22fcda7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:12.288927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 266/529] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:12.288927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cb917-f4de-41b4-8db6-5b8afb450f64 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:12.354541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:12.388214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 264/530] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:12.389494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21fea4-cccd-4662-85dd-6908d22fcda7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:12.391151 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cb917-f4de-41b4-8db6-5b8afb450f64 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:12.393486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:12.429410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be45e48-d797-45ce-98e1-88525a63eb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:12.430066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be45e48-d797-45ce-98e1-88525a63eb44 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:12.430345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be45e48-d797-45ce-98e1-88525a63eb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:12.430619 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be45e48-d797-45ce-98e1-88525a63eb44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:12.432003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be45e48-d797-45ce-98e1-88525a63eb44 None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=555de6e5c8c44f40a6433b3d2ffc52f3) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:12.432003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be45e48-d797-45ce-98e1-88525a63eb44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:12.433493 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be45e48-d797-45ce-98e1-88525a63eb44 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:12.440272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 267/531] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:12 2022] GET /identity/v3/role_assignments?user.id=555de6e5c8c44f40a6433b3d2ffc52f3&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:12.440989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be45e48-d797-45ce-98e1-88525a63eb44 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:12.508264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21fea4-cccd-4662-85dd-6908d22fcda7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:12.554955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be45e48-d797-45ce-98e1-88525a63eb44 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:12.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b12c5-15b6-4d7e-a603-5105fab3b67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:12.558326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b12c5-15b6-4d7e-a603-5105fab3b67d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:12.558829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b12c5-15b6-4d7e-a603-5105fab3b67d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:12.559298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b12c5-15b6-4d7e-a603-5105fab3b67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:12.580427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b12c5-15b6-4d7e-a603-5105fab3b67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:12.585312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b12c5-15b6-4d7e-a603-5105fab3b67d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:12.608485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-760b12c5-15b6-4d7e-a603-5105fab3b67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:12.618936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:12.619863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:12.620701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:12.620701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:12.620701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:12.620701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:12.620945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 265/532] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:12.626133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b12c5-15b6-4d7e-a603-5105fab3b67d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:12.629684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6827ccd-3fe4-49b0-b6ae-059625f11bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:12.630380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6827ccd-3fe4-49b0-b6ae-059625f11bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:12.630663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6827ccd-3fe4-49b0-b6ae-059625f11bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:12.631001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6827ccd-3fe4-49b0-b6ae-059625f11bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:12.654462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6827ccd-3fe4-49b0-b6ae-059625f11bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:12.655937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6827ccd-3fe4-49b0-b6ae-059625f11bb8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d6827ccd-3fe4-49b0-b6ae-059625f11bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:12.672723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:12.673783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:12.674849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:12.674849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:12.674849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:12.674849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:12.674849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 268/533] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:12.679878 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6827ccd-3fe4-49b0-b6ae-059625f11bb8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:12.742558 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:12.794010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6827ccd-3fe4-49b0-b6ae-059625f11bb8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:12.836253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b12c5-15b6-4d7e-a603-5105fab3b67d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:12.845465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb51b7-1815-4619-a7d6-b19e2266e701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:12.846182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb51b7-1815-4619-a7d6-b19e2266e701 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:12.846465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb51b7-1815-4619-a7d6-b19e2266e701 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:12.846742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb51b7-1815-4619-a7d6-b19e2266e701 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:12.847507 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb51b7-1815-4619-a7d6-b19e2266e701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:12.848055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb51b7-1815-4619-a7d6-b19e2266e701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:12.849762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb51b7-1815-4619-a7d6-b19e2266e701 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:12.875510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cae1e8-0ac0-42c3-a0d4-20b2bca39133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:12.876118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 269/534] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:12.877208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cae1e8-0ac0-42c3-a0d4-20b2bca39133 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:12.877666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cae1e8-0ac0-42c3-a0d4-20b2bca39133 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:12.878109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cae1e8-0ac0-42c3-a0d4-20b2bca39133 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:12.878982 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cae1e8-0ac0-42c3-a0d4-20b2bca39133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:12.879461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cae1e8-0ac0-42c3-a0d4-20b2bca39133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:12.881167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cae1e8-0ac0-42c3-a0d4-20b2bca39133 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:12.881672 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb51b7-1815-4619-a7d6-b19e2266e701 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:12.900978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 266/535] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:12.902594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cae1e8-0ac0-42c3-a0d4-20b2bca39133 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:12.975755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:13.042528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb51b7-1815-4619-a7d6-b19e2266e701 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:13.088527 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479a344-9647-429d-8800-bd454e8b0de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:13.089211 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a344-9647-429d-8800-bd454e8b0de0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:13.089486 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a344-9647-429d-8800-bd454e8b0de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:13.089761 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a344-9647-429d-8800-bd454e8b0de0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:13.101453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479a344-9647-429d-8800-bd454e8b0de0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:13.102938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479a344-9647-429d-8800-bd454e8b0de0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:13.105247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cae1e8-0ac0-42c3-a0d4-20b2bca39133 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a479a344-9647-429d-8800-bd454e8b0de0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:13.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:13.122446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:13.123261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:13.123261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:13.123261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:13.123261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:13.123261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:13.123261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:13.123261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:13.123261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:13.124342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 270/536] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:13.131266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479a344-9647-429d-8800-bd454e8b0de0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:13.141266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:13.161405 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44644866-2691-40dd-b67a-9ded2ecc7b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:13.162063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44644866-2691-40dd-b67a-9ded2ecc7b7f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:13.162340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44644866-2691-40dd-b67a-9ded2ecc7b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:13.162608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44644866-2691-40dd-b67a-9ded2ecc7b7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:13.180485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44644866-2691-40dd-b67a-9ded2ecc7b7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:13.181991 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44644866-2691-40dd-b67a-9ded2ecc7b7f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-44644866-2691-40dd-b67a-9ded2ecc7b7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:13.199615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:13.201666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:13.203733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:13.203733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:13.203733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:13.203733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:13.203733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:13.203733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:13.203733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:13.203733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:13.209385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 267/537] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:13.215371 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44644866-2691-40dd-b67a-9ded2ecc7b7f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:13.268557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479a344-9647-429d-8800-bd454e8b0de0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:13.271103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:13.309013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd43834-647a-49c8-a7d2-0467610d14b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:13.310028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd43834-647a-49c8-a7d2-0467610d14b9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:13.310520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd43834-647a-49c8-a7d2-0467610d14b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:13.310984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd43834-647a-49c8-a7d2-0467610d14b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:13.312068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd43834-647a-49c8-a7d2-0467610d14b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:13.312597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd43834-647a-49c8-a7d2-0467610d14b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:13.314638 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd43834-647a-49c8-a7d2-0467610d14b9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:13.328040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 271/538] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:13.338777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd43834-647a-49c8-a7d2-0467610d14b9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:13.365624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44644866-2691-40dd-b67a-9ded2ecc7b7f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:13.457032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc6a3a-66b5-4564-80f1-2c16f23f268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:13.458073 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc6a3a-66b5-4564-80f1-2c16f23f268a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:13.458542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc6a3a-66b5-4564-80f1-2c16f23f268a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:13.459001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc6a3a-66b5-4564-80f1-2c16f23f268a None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:13.459984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc6a3a-66b5-4564-80f1-2c16f23f268a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:13.460478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc6a3a-66b5-4564-80f1-2c16f23f268a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:13.462147 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc6a3a-66b5-4564-80f1-2c16f23f268a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:13.489946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 268/539] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:13.496709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc6a3a-66b5-4564-80f1-2c16f23f268a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:13.525933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd43834-647a-49c8-a7d2-0467610d14b9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:13.563872 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5bea5-b806-43a8-9cdc-ca1a196ad0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:13.565597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5bea5-b806-43a8-9cdc-ca1a196ad0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:13.566225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5bea5-b806-43a8-9cdc-ca1a196ad0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:13.567707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5bea5-b806-43a8-9cdc-ca1a196ad0a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:13.568923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5bea5-b806-43a8-9cdc-ca1a196ad0a1 None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=9c4ce8a3f876467f93e7c9efd9e33390) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:13.570860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5bea5-b806-43a8-9cdc-ca1a196ad0a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:13.572517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5bea5-b806-43a8-9cdc-ca1a196ad0a1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:13.584359 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 272/540] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:13 2022] GET /identity/v3/role_assignments?user.id=9c4ce8a3f876467f93e7c9efd9e33390&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:13.585099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:13.634373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcff2f9-1e4a-40db-8205-fb8dd69d91b9 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:13.634813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcff2f9-1e4a-40db-8205-fb8dd69d91b9 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:13.635272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcff2f9-1e4a-40db-8205-fb8dd69d91b9 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:13.650101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 273/541] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:13 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:13.679413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b98ac2-5548-4a52-b48a-6d35ff08a8b1 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:13.679807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b98ac2-5548-4a52-b48a-6d35ff08a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:13.680032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b98ac2-5548-4a52-b48a-6d35ff08a8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:13.710628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc6a3a-66b5-4564-80f1-2c16f23f268a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:13.734145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-77b98ac2-5548-4a52-b48a-6d35ff08a8b1 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:13.735436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-77b98ac2-5548-4a52-b48a-6d35ff08a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:13.759955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8278c-000d-4a7d-8d3f-37f34d3e2ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:13.761881 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8278c-000d-4a7d-8d3f-37f34d3e2ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:13.762605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8278c-000d-4a7d-8d3f-37f34d3e2ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:13.763073 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8278c-000d-4a7d-8d3f-37f34d3e2ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:13.764136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8278c-000d-4a7d-8d3f-37f34d3e2ed1 None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=d44bcb27daeb4116835bbfb5dcb1dc33) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:13.764671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8278c-000d-4a7d-8d3f-37f34d3e2ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:13.766719 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8278c-000d-4a7d-8d3f-37f34d3e2ed1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:13.775160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 269/542] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:13 2022] GET /identity/v3/role_assignments?user.id=d44bcb27daeb4116835bbfb5dcb1dc33&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:13.793166 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:13.851560 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 274/543] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:13.873689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8278c-000d-4a7d-8d3f-37f34d3e2ed1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:13.991014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:13.994595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8278c-000d-4a7d-8d3f-37f34d3e2ed1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:14.041185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d7ea0-b145-45d3-9741-d538e468c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:14.042372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7ea0-b145-45d3-9741-d538e468c22c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:14.042945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7ea0-b145-45d3-9741-d538e468c22c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:14.043571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7ea0-b145-45d3-9741-d538e468c22c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:14.063691 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d7ea0-b145-45d3-9741-d538e468c22c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-021d7ea0-b145-45d3-9741-d538e468c22c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:14.069463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:14.070525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:14.071462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:14.071462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:14.071462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:14.071462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:14.071462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:14.071462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:14.071462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:14.071462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:14.071462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:14.071462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:14.071462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:14.071462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:14.078549 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 270/544] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:14.084242 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b98ac2-5548-4a52-b48a-6d35ff08a8b1 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:14.118769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80475b00-c800-4d1c-8369-296020952b1f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:14.119284 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80475b00-c800-4d1c-8369-296020952b1f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:14.119729 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80475b00-c800-4d1c-8369-296020952b1f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:14.121541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 271/545] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:14.127559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ded3fd-b6c4-4b49-a4e6-ba535df72365 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:14.128149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ded3fd-b6c4-4b49-a4e6-ba535df72365 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:14.128632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ded3fd-b6c4-4b49-a4e6-ba535df72365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:14.162868 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-05ded3fd-b6c4-4b49-a4e6-ba535df72365 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:14.164856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-05ded3fd-b6c4-4b49-a4e6-ba535df72365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:14.252514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b98ac2-5548-4a52-b48a-6d35ff08a8b1 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:14.283530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 272/546] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:01:14.302224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e0fc4-78da-4f7b-9432-c348a1c1ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:14.302789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e0fc4-78da-4f7b-9432-c348a1c1ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:14.303131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e0fc4-78da-4f7b-9432-c348a1c1ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:14.303410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e0fc4-78da-4f7b-9432-c348a1c1ecc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:14.304143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e0fc4-78da-4f7b-9432-c348a1c1ecc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:14.304448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e0fc4-78da-4f7b-9432-c348a1c1ecc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:14.305869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e0fc4-78da-4f7b-9432-c348a1c1ecc3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:14.321299 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 275/547] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:14.327424 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ded3fd-b6c4-4b49-a4e6-ba535df72365 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:14.327585 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e0fc4-78da-4f7b-9432-c348a1c1ecc3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:14.352077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:14.443427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e0fc4-78da-4f7b-9432-c348a1c1ecc3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:14.479679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d26cc-e5f0-44e2-821a-06e26f31d98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:14.480344 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d26cc-e5f0-44e2-821a-06e26f31d98b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:14.480622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d26cc-e5f0-44e2-821a-06e26f31d98b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:14.480911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d26cc-e5f0-44e2-821a-06e26f31d98b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:14.507944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d26cc-e5f0-44e2-821a-06e26f31d98b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a05d26cc-e5f0-44e2-821a-06e26f31d98b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:14.514865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:14.515728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:14.516508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:14.516508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:14.516508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:14.516508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:14.516508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:14.516508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:14.516508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:14.516508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:14.516508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:14.516508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:14.516508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:14.516508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:14.523568 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 276/548] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:14.523925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:14.539324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d26cc-e5f0-44e2-821a-06e26f31d98b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:14.546116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ded3fd-b6c4-4b49-a4e6-ba535df72365 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:14.611447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9efab3-0c7f-4f66-80a7-2b93ccbbff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:14.612458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9efab3-0c7f-4f66-80a7-2b93ccbbff15 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:14.612950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9efab3-0c7f-4f66-80a7-2b93ccbbff15 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:14.613408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9efab3-0c7f-4f66-80a7-2b93ccbbff15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:14.637954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:14.641088 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9efab3-0c7f-4f66-80a7-2b93ccbbff15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:14.642963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9efab3-0c7f-4f66-80a7-2b93ccbbff15 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:14.663510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d26cc-e5f0-44e2-821a-06e26f31d98b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-1b9efab3-0c7f-4f66-80a7-2b93ccbbff15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:14.674239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:14.675561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:14.676660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:14.676660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:14.676660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:14.676660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:14.676660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 273/549] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:14.681418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9efab3-0c7f-4f66-80a7-2b93ccbbff15 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:14.714820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190cb3a-b6a3-4060-93b7-f3e0ac39237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:14.715459 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190cb3a-b6a3-4060-93b7-f3e0ac39237f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:14.715738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190cb3a-b6a3-4060-93b7-f3e0ac39237f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:14.716689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190cb3a-b6a3-4060-93b7-f3e0ac39237f None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:14.719009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190cb3a-b6a3-4060-93b7-f3e0ac39237f None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:14.719319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190cb3a-b6a3-4060-93b7-f3e0ac39237f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:14.721531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190cb3a-b6a3-4060-93b7-f3e0ac39237f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:14.744704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 277/550] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:14.745672 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190cb3a-b6a3-4060-93b7-f3e0ac39237f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:14.871834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9efab3-0c7f-4f66-80a7-2b93ccbbff15 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:14.873354 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190cb3a-b6a3-4060-93b7-f3e0ac39237f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:14.908249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1832f1-fa1a-45cb-88c7-12960952d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:14.909103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1832f1-fa1a-45cb-88c7-12960952d5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:14.909487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1832f1-fa1a-45cb-88c7-12960952d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:14.909858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1832f1-fa1a-45cb-88c7-12960952d5a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:14.921844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1832f1-fa1a-45cb-88c7-12960952d5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:14.923564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1832f1-fa1a-45cb-88c7-12960952d5a7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:14.933502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-2c1832f1-fa1a-45cb-88c7-12960952d5a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:14.939789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:14.940812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:14.941703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:14.941703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:14.941703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:14.941703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:14.944063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 278/551] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:14.949723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1832f1-fa1a-45cb-88c7-12960952d5a7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:15.001770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8f3d1-85f8-4a97-b1c3-a5431abc077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:15.003408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8f3d1-85f8-4a97-b1c3-a5431abc077b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:15.003408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8f3d1-85f8-4a97-b1c3-a5431abc077b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:15.003408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8f3d1-85f8-4a97-b1c3-a5431abc077b None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:15.003673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8f3d1-85f8-4a97-b1c3-a5431abc077b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:15.003966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8f3d1-85f8-4a97-b1c3-a5431abc077b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:15.005390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8f3d1-85f8-4a97-b1c3-a5431abc077b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:15.039545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 274/552] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:15.050532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8f3d1-85f8-4a97-b1c3-a5431abc077b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:15.053943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:15.067400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1832f1-fa1a-45cb-88c7-12960952d5a7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:15.102611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41477dc-8bb6-47c1-a4fe-5092ac51d249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:15.103274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41477dc-8bb6-47c1-a4fe-5092ac51d249 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:15.103526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41477dc-8bb6-47c1-a4fe-5092ac51d249 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:15.103799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41477dc-8bb6-47c1-a4fe-5092ac51d249 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:15.104522 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41477dc-8bb6-47c1-a4fe-5092ac51d249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:15.104826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41477dc-8bb6-47c1-a4fe-5092ac51d249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:15.106321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41477dc-8bb6-47c1-a4fe-5092ac51d249 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:15.119956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 279/553] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:15.126108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209af0d-0a29-44f6-aadf-2b792fc8fd72 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:15.126401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209af0d-0a29-44f6-aadf-2b792fc8fd72 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:15.126765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209af0d-0a29-44f6-aadf-2b792fc8fd72 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:15.128380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 280/554] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:15.129156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209af0d-0a29-44f6-aadf-2b792fc8fd72 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:15.173703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8f3d1-85f8-4a97-b1c3-a5431abc077b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:15.188454 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:15.215804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958c898-7aad-419a-8ba6-8b54dffb29ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:15.216880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958c898-7aad-419a-8ba6-8b54dffb29ae None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:15.217423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958c898-7aad-419a-8ba6-8b54dffb29ae None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:15.218018 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958c898-7aad-419a-8ba6-8b54dffb29ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:15.226387 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958c898-7aad-419a-8ba6-8b54dffb29ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:15.228313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958c898-7aad-419a-8ba6-8b54dffb29ae None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:15.234714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209af0d-0a29-44f6-aadf-2b792fc8fd72 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e958c898-7aad-419a-8ba6-8b54dffb29ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:15.241681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:15.242721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:15.243643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:15.243643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:15.243643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:15.243643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:15.243643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:15.243643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:15.243643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:15.243643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:15.243643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 07:01:15.243643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:15.246403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 275/555] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:15.247957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf827e-0856-4f8e-bbe3-54e6cd9c7d23 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:15.248436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf827e-0856-4f8e-bbe3-54e6cd9c7d23 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:15.248995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf827e-0856-4f8e-bbe3-54e6cd9c7d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:15.269113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-aedf827e-0856-4f8e-bbe3-54e6cd9c7d23 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:15.270816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-aedf827e-0856-4f8e-bbe3-54e6cd9c7d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:15.286319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3927a7-8ecc-4aae-8daf-1b48a6371c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:15.286982 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3927a7-8ecc-4aae-8daf-1b48a6371c99 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:15.287260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3927a7-8ecc-4aae-8daf-1b48a6371c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:15.287532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3927a7-8ecc-4aae-8daf-1b48a6371c99 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:15.295386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3927a7-8ecc-4aae-8daf-1b48a6371c99 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:15.296913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3927a7-8ecc-4aae-8daf-1b48a6371c99 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-ed3927a7-8ecc-4aae-8daf-1b48a6371c99 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:15.308613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:15.309599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:15.311532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:15.311532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:15.311532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:15.311532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:15.311532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:15.311532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:15.311532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:15.311532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:15.311532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 07:01:15.311532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:15.314707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 281/556] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:15.315600 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3927a7-8ecc-4aae-8daf-1b48a6371c99 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:15.342546 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:15.356460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 276/557] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:15.357852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf827e-0856-4f8e-bbe3-54e6cd9c7d23 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:15.418354 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3927a7-8ecc-4aae-8daf-1b48a6371c99 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:15.433997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:15.457672 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6feed5-bc8b-4582-9e80-8c2897cb2ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:15.458302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6feed5-bc8b-4582-9e80-8c2897cb2ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:15.458583 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6feed5-bc8b-4582-9e80-8c2897cb2ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:15.458858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6feed5-bc8b-4582-9e80-8c2897cb2ff2 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:15.459658 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6feed5-bc8b-4582-9e80-8c2897cb2ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:15.459967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6feed5-bc8b-4582-9e80-8c2897cb2ff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:15.461451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6feed5-bc8b-4582-9e80-8c2897cb2ff2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:15.478141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf827e-0856-4f8e-bbe3-54e6cd9c7d23 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:15.479739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 282/558] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Aug 5 07:01:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:15.480395 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6feed5-bc8b-4582-9e80-8c2897cb2ff2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:15.518332 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728522a-21fa-4d94-9417-7fd27db269fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:15.519368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728522a-21fa-4d94-9417-7fd27db269fb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:15.519926 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728522a-21fa-4d94-9417-7fd27db269fb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:15.520491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728522a-21fa-4d94-9417-7fd27db269fb None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:15.521526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728522a-21fa-4d94-9417-7fd27db269fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:15.522052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728522a-21fa-4d94-9417-7fd27db269fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:15.523794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728522a-21fa-4d94-9417-7fd27db269fb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:15.544648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 277/559] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 5 07:01:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:15.545902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728522a-21fa-4d94-9417-7fd27db269fb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:15.605096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6feed5-bc8b-4582-9e80-8c2897cb2ff2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:15.610953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:15.649259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616637d-1a6f-439e-85f2-b94faa22d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:15.650565 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616637d-1a6f-439e-85f2-b94faa22d67d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:15.651424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616637d-1a6f-439e-85f2-b94faa22d67d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:15.652152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616637d-1a6f-439e-85f2-b94faa22d67d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:15.666549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616637d-1a6f-439e-85f2-b94faa22d67d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-2616637d-1a6f-439e-85f2-b94faa22d67d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:15.671580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:15.672506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 283/560] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:15.674053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616637d-1a6f-439e-85f2-b94faa22d67d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:15.677575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728522a-21fa-4d94-9417-7fd27db269fb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:15.707714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:15.718596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975758f6-fedf-47d3-a5b6-a8edb7848810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:15.719719 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975758f6-fedf-47d3-a5b6-a8edb7848810 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:15.720925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975758f6-fedf-47d3-a5b6-a8edb7848810 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:15.721421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975758f6-fedf-47d3-a5b6-a8edb7848810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:15.785402 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616637d-1a6f-439e-85f2-b94faa22d67d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:15.800375 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975758f6-fedf-47d3-a5b6-a8edb7848810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:15.802233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975758f6-fedf-47d3-a5b6-a8edb7848810 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:15.821102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2302de-21a0-4c94-9e3b-87e7e217672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:15.821750 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2302de-21a0-4c94-9e3b-87e7e217672b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:15.822031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2302de-21a0-4c94-9e3b-87e7e217672b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:15.822297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2302de-21a0-4c94-9e3b-87e7e217672b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:15.833367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2302de-21a0-4c94-9e3b-87e7e217672b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:15.834850 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2302de-21a0-4c94-9e3b-87e7e217672b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-ee2302de-21a0-4c94-9e3b-87e7e217672b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:15.850193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:15.851198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:15.852132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:15.852132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:15.852132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:15.852132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:15.856185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 284/561] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:15.857175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2302de-21a0-4c94-9e3b-87e7e217672b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:15.862383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:15.921444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 278/562] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:15.923290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975758f6-fedf-47d3-a5b6-a8edb7848810 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:15.957189 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:15.975207 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2302de-21a0-4c94-9e3b-87e7e217672b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:16.012522 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04711c6e-a50e-4752-957b-f259bd71e6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:16.013171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711c6e-a50e-4752-957b-f259bd71e6ab None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.013548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711c6e-a50e-4752-957b-f259bd71e6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.013921 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711c6e-a50e-4752-957b-f259bd71e6ab None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.014697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711c6e-a50e-4752-957b-f259bd71e6ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:16.015002 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711c6e-a50e-4752-957b-f259bd71e6ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:16.016389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711c6e-a50e-4752-957b-f259bd71e6ab None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:16.030605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975758f6-fedf-47d3-a5b6-a8edb7848810 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:16.030798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 285/563] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:16.030798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5227d-4d4f-4bfb-ba90-0fa5f9dd041f None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.030798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5227d-4d4f-4bfb-ba90-0fa5f9dd041f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.030798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5227d-4d4f-4bfb-ba90-0fa5f9dd041f None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.030798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 286/564] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:16.030798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5227d-4d4f-4bfb-ba90-0fa5f9dd041f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:16.071697 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db41f33-ecba-4ed3-98ce-e2c94a2c52db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:16.072321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db41f33-ecba-4ed3-98ce-e2c94a2c52db None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.072601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db41f33-ecba-4ed3-98ce-e2c94a2c52db None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.072877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db41f33-ecba-4ed3-98ce-e2c94a2c52db None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.073591 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db41f33-ecba-4ed3-98ce-e2c94a2c52db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:16.073894 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db41f33-ecba-4ed3-98ce-e2c94a2c52db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:16.075259 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db41f33-ecba-4ed3-98ce-e2c94a2c52db None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:16.086383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 279/565] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:16.087173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db41f33-ecba-4ed3-98ce-e2c94a2c52db None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:16.100628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:16.136822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5227d-4d4f-4bfb-ba90-0fa5f9dd041f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:16.171727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce141efe-c89d-4ca4-9091-a34308b0849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:16.172353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce141efe-c89d-4ca4-9091-a34308b0849a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.172646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce141efe-c89d-4ca4-9091-a34308b0849a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.172927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce141efe-c89d-4ca4-9091-a34308b0849a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.183177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce141efe-c89d-4ca4-9091-a34308b0849a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:16.184553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce141efe-c89d-4ca4-9091-a34308b0849a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:16.189180 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db41f33-ecba-4ed3-98ce-e2c94a2c52db None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:16.191474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-ce141efe-c89d-4ca4-9091-a34308b0849a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:16.199699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:16.200763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:16.201888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:16.201888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:16.201888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:16.201888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:16.201888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 287/566] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:16.202221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba643ee-c9e9-4957-a779-bf7fa4c70d98 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.202443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba643ee-c9e9-4957-a779-bf7fa4c70d98 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.202703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba643ee-c9e9-4957-a779-bf7fa4c70d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.221663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-cba643ee-c9e9-4957-a779-bf7fa4c70d98 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:16.222852 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cba643ee-c9e9-4957-a779-bf7fa4c70d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:16.228790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8b38d-5fbe-41f8-aab2-d30e689b1724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:16.229466 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8b38d-5fbe-41f8-aab2-d30e689b1724 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.229739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8b38d-5fbe-41f8-aab2-d30e689b1724 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.230005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8b38d-5fbe-41f8-aab2-d30e689b1724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.240632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8b38d-5fbe-41f8-aab2-d30e689b1724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:16.242081 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8b38d-5fbe-41f8-aab2-d30e689b1724 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6cb8b38d-5fbe-41f8-aab2-d30e689b1724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:16.257432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:16.258344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:16.259211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:16.259211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:16.259211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:16.259211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:16.259211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 280/567] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:16.260290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae61d2-e688-4589-ac3d-4868b4c47bd6 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.260576 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae61d2-e688-4589-ac3d-4868b4c47bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.260852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae61d2-e688-4589-ac3d-4868b4c47bd6 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.262271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 281/568] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:16.262898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae61d2-e688-4589-ac3d-4868b4c47bd6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:16.300972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 288/569] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:16.301601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba643ee-c9e9-4957-a779-bf7fa4c70d98 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:16.348847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:16.393063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae61d2-e688-4589-ac3d-4868b4c47bd6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:16.417143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba643ee-c9e9-4957-a779-bf7fa4c70d98 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:16.430347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fdf56-3c57-4eee-8f01-6f452ead8fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:16.431125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fdf56-3c57-4eee-8f01-6f452ead8fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.431492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fdf56-3c57-4eee-8f01-6f452ead8fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.431853 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fdf56-3c57-4eee-8f01-6f452ead8fc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.439269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fdf56-3c57-4eee-8f01-6f452ead8fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:16.440939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9fdf56-3c57-4eee-8f01-6f452ead8fc6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:16.447825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8a9fdf56-3c57-4eee-8f01-6f452ead8fc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:16.452631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:16.453730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:16.454885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:16.454885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:16.454885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:16.454885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:16.454885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:16.454885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:16.454885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:16.454885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:16.455348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 282/570] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:16.456053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fdf56-3c57-4eee-8f01-6f452ead8fc6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:16.462100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e3686-00aa-42f8-bb8e-649fea9e87b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:16.462997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e3686-00aa-42f8-bb8e-649fea9e87b7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.463455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e3686-00aa-42f8-bb8e-649fea9e87b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.463932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e3686-00aa-42f8-bb8e-649fea9e87b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.464837 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e3686-00aa-42f8-bb8e-649fea9e87b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:16.465643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e3686-00aa-42f8-bb8e-649fea9e87b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:16.467481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e3686-00aa-42f8-bb8e-649fea9e87b7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:16.481206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 289/571] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:16.482564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2846ad-cd30-4d9b-9483-9a6befe06512 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.482845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2846ad-cd30-4d9b-9483-9a6befe06512 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.483112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2846ad-cd30-4d9b-9483-9a6befe06512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.505287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0b2846ad-cd30-4d9b-9483-9a6befe06512 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:16.506487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0b2846ad-cd30-4d9b-9483-9a6befe06512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:16.567001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fdf56-3c57-4eee-8f01-6f452ead8fc6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:16.575117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 290/572] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:16.576185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2846ad-cd30-4d9b-9483-9a6befe06512 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:16.590366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:16.602527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98525bc0-c6da-4a6f-8ff5-a6571bd2601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:16.603151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98525bc0-c6da-4a6f-8ff5-a6571bd2601d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.603426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98525bc0-c6da-4a6f-8ff5-a6571bd2601d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.603696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98525bc0-c6da-4a6f-8ff5-a6571bd2601d None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.604384 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98525bc0-c6da-4a6f-8ff5-a6571bd2601d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:16.604685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98525bc0-c6da-4a6f-8ff5-a6571bd2601d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:16.606126 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98525bc0-c6da-4a6f-8ff5-a6571bd2601d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:16.619378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 283/573] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:16.620212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98525bc0-c6da-4a6f-8ff5-a6571bd2601d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:16.707045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2846ad-cd30-4d9b-9483-9a6befe06512 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:16.723173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98525bc0-c6da-4a6f-8ff5-a6571bd2601d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:16.724374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:16.742352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59be1d-b67d-4d89-b17b-2ba548a38726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:16.743002 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59be1d-b67d-4d89-b17b-2ba548a38726 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.743282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59be1d-b67d-4d89-b17b-2ba548a38726 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.743577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59be1d-b67d-4d89-b17b-2ba548a38726 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.753763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59be1d-b67d-4d89-b17b-2ba548a38726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:16.756846 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d26bc0-e1b4-4dbf-a2f3-8a6bf90056fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:16.757499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d26bc0-e1b4-4dbf-a2f3-8a6bf90056fe None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.757775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d26bc0-e1b4-4dbf-a2f3-8a6bf90056fe None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.758052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d26bc0-e1b4-4dbf-a2f3-8a6bf90056fe None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-bc59be1d-b67d-4d89-b17b-2ba548a38726 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:16.758697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:16.759737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:16.760748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:16.760748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:16.760748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:16.760748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:16.760748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:16.760748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:16.760748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:16.760748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:16.760748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:16.760748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:16.760748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:16.760748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:16.761654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d26bc0-e1b4-4dbf-a2f3-8a6bf90056fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:16.761654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d26bc0-e1b4-4dbf-a2f3-8a6bf90056fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:16.761654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d26bc0-e1b4-4dbf-a2f3-8a6bf90056fe None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:16.761838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 291/574] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:16.762159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59be1d-b67d-4d89-b17b-2ba548a38726 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:16.772345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 284/575] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:16.773187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d26bc0-e1b4-4dbf-a2f3-8a6bf90056fe None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:16.819994 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:16.863135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59be1d-b67d-4d89-b17b-2ba548a38726 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:16.876463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d26bc0-e1b4-4dbf-a2f3-8a6bf90056fe None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:16.900428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e200a8-3a7d-4cc9-889b-2ca06df968ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:16.901106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e200a8-3a7d-4cc9-889b-2ca06df968ab None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.901385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e200a8-3a7d-4cc9-889b-2ca06df968ab None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.901646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e200a8-3a7d-4cc9-889b-2ca06df968ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.908778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e200a8-3a7d-4cc9-889b-2ca06df968ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:16.910237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5ae7c-9756-4635-91ce-664b3259096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:16.910395 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e200a8-3a7d-4cc9-889b-2ca06df968ab None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:16.910884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5ae7c-9756-4635-91ce-664b3259096b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:16.911161 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5ae7c-9756-4635-91ce-664b3259096b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:16.911434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5ae7c-9756-4635-91ce-664b3259096b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:16.921951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5ae7c-9756-4635-91ce-664b3259096b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-19e200a8-3a7d-4cc9-889b-2ca06df968ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:16.922512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:16.923451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:16.924317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:16.924317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:16.924317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:16.924317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:16.924317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:16.924317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:16.924317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:16.924317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:16.924317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 292/576] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:16.924317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e200a8-3a7d-4cc9-889b-2ca06df968ab None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a2e5ae7c-9756-4635-91ce-664b3259096b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:16.927327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:16.928528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 285/577] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:16.930433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5ae7c-9756-4635-91ce-664b3259096b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:16.967371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:17.029405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e200a8-3a7d-4cc9-889b-2ca06df968ab None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:17.033644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5ae7c-9756-4635-91ce-664b3259096b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:17.035225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:17.067185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecf311-eda4-4adf-a3b3-1c84589d757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:17.067828 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecf311-eda4-4adf-a3b3-1c84589d757a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:17.068125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecf311-eda4-4adf-a3b3-1c84589d757a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:17.068402 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecf311-eda4-4adf-a3b3-1c84589d757a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:17.073111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392775e-b7e0-4e75-bcfa-3e81ac83dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:17.073745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392775e-b7e0-4e75-bcfa-3e81ac83dc60 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:17.074023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392775e-b7e0-4e75-bcfa-3e81ac83dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:17.074299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392775e-b7e0-4e75-bcfa-3e81ac83dc60 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:17.075010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392775e-b7e0-4e75-bcfa-3e81ac83dc60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:17.075314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392775e-b7e0-4e75-bcfa-3e81ac83dc60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:17.076690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392775e-b7e0-4e75-bcfa-3e81ac83dc60 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:17.076793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecf311-eda4-4adf-a3b3-1c84589d757a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:17.078259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecf311-eda4-4adf-a3b3-1c84589d757a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:17.085398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 286/578] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:17.086314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392775e-b7e0-4e75-bcfa-3e81ac83dc60 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-8eecf311-eda4-4adf-a3b3-1c84589d757a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:17.090455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:17.091494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:17.092461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:17.092461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:17.092461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:17.092461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:17.092461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:17.092461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:17.092461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:17.092461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:17.092461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:01:17.092461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:17.092461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 293/579] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 07:01:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:17.092461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecf311-eda4-4adf-a3b3-1c84589d757a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:17.187719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:17.188584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392775e-b7e0-4e75-bcfa-3e81ac83dc60 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:17.192178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecf311-eda4-4adf-a3b3-1c84589d757a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:17.222655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da72c-5063-4e70-8b43-b293b0b3ae5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:17.223280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da72c-5063-4e70-8b43-b293b0b3ae5f None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:17.223555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da72c-5063-4e70-8b43-b293b0b3ae5f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:17.223823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da72c-5063-4e70-8b43-b293b0b3ae5f None admin] PATH_INFO: `/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/1c3d7cdad7f44f0f8df944ec7f69de26/roles/58b981aa32454837bd8eae9e804d811e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:17.225081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37acc9-3210-432e-a75d-2deb5b892141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:17.225701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37acc9-3210-432e-a75d-2deb5b892141 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:17.225981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37acc9-3210-432e-a75d-2deb5b892141 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:17.226257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37acc9-3210-432e-a75d-2deb5b892141 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:17.227024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37acc9-3210-432e-a75d-2deb5b892141 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:17.227331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37acc9-3210-432e-a75d-2deb5b892141 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:17.228773 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37acc9-3210-432e-a75d-2deb5b892141 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:17.238018 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576da72c-5063-4e70-8b43-b293b0b3ae5f None admin] RBAC: Authorizing `identity:create_grant(project_id=29b560f1bcf347f6b8b885cc02d52e33, user_id=1c3d7cdad7f44f0f8df944ec7f69de26, role_id=58b981aa32454837bd8eae9e804d811e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:17.239433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576da72c-5063-4e70-8b43-b293b0b3ae5f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:17.241532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 294/580] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:17.242345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37acc9-3210-432e-a75d-2deb5b892141 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:17.254147 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 287/581] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:01:17 2022] PUT /identity/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/1c3d7cdad7f44f0f8df944ec7f69de26/roles/58b981aa32454837bd8eae9e804d811e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:01:17.255295 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da72c-5063-4e70-8b43-b293b0b3ae5f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:17.272406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:17.368926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37acc9-3210-432e-a75d-2deb5b892141 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:17.372324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da72c-5063-4e70-8b43-b293b0b3ae5f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:17.408722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef03cb-612a-4a8d-bf85-b5d365993a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:17.409374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef03cb-612a-4a8d-bf85-b5d365993a02 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:17.409670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef03cb-612a-4a8d-bf85-b5d365993a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:17.409920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef03cb-612a-4a8d-bf85-b5d365993a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:17.411218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550655a-ce7b-483a-94b6-0fcb55007283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:17.412153 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550655a-ce7b-483a-94b6-0fcb55007283 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:17.412644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550655a-ce7b-483a-94b6-0fcb55007283 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:17.413498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550655a-ce7b-483a-94b6-0fcb55007283 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:17.414367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550655a-ce7b-483a-94b6-0fcb55007283 None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:17.414812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550655a-ce7b-483a-94b6-0fcb55007283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:17.416388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550655a-ce7b-483a-94b6-0fcb55007283 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:17.422947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef03cb-612a-4a8d-bf85-b5d365993a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:17.424479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef03cb-612a-4a8d-bf85-b5d365993a02 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:17.430755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 295/582] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:17.432549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550655a-ce7b-483a-94b6-0fcb55007283 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d1ef03cb-612a-4a8d-bf85-b5d365993a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:17.440821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:17.442002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:17.442920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:17.442920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:17.442920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:17.442920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:17.442920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 288/583] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:17.442920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef03cb-612a-4a8d-bf85-b5d365993a02 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:17.461814 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:17.514263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:17.546865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550655a-ce7b-483a-94b6-0fcb55007283 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:17.550382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef03cb-612a-4a8d-bf85-b5d365993a02 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:17.585141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c389831-f018-4f8d-b4df-a7c388282155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:17.585792 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87803db4-03df-444d-ade6-2498747be11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:17.585941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c389831-f018-4f8d-b4df-a7c388282155 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:17.586256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c389831-f018-4f8d-b4df-a7c388282155 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:17.586425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87803db4-03df-444d-ade6-2498747be11e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:17.586640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c389831-f018-4f8d-b4df-a7c388282155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:17.586742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87803db4-03df-444d-ade6-2498747be11e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:17.586971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87803db4-03df-444d-ade6-2498747be11e None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:17.587580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c389831-f018-4f8d-b4df-a7c388282155 None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=8d83b456cec84bc5ab02a190099c0baf) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:17.587765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87803db4-03df-444d-ade6-2498747be11e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:17.588004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c389831-f018-4f8d-b4df-a7c388282155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:17.588117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87803db4-03df-444d-ade6-2498747be11e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:17.589533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c389831-f018-4f8d-b4df-a7c388282155 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:17.589632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87803db4-03df-444d-ade6-2498747be11e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:17.596145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 289/584] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:17 2022] GET /identity/v3/role_assignments?user.id=8d83b456cec84bc5ab02a190099c0baf&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:17.596726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c389831-f018-4f8d-b4df-a7c388282155 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:17.623045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 296/585] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 07:01:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:17.624518 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87803db4-03df-444d-ade6-2498747be11e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:17.720774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c389831-f018-4f8d-b4df-a7c388282155 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:17.755461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:17.759597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:17.763121 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c80ff5-ada5-4ef4-9a19-7c94ec897348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:17.764402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c80ff5-ada5-4ef4-9a19-7c94ec897348 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:17.764632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c80ff5-ada5-4ef4-9a19-7c94ec897348 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:17.764951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c80ff5-ada5-4ef4-9a19-7c94ec897348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:17.775768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87803db4-03df-444d-ade6-2498747be11e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:17.779901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c80ff5-ada5-4ef4-9a19-7c94ec897348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:17.781784 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c80ff5-ada5-4ef4-9a19-7c94ec897348 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d3c80ff5-ada5-4ef4-9a19-7c94ec897348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:17.802298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:17.803240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:17.804101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:17.804101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:17.804101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:17.804101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:17.804101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 290/586] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:17.804802 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c80ff5-ada5-4ef4-9a19-7c94ec897348 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:17.821224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a7295-f27f-45a8-b73a-278e7576af14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:17.821948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a7295-f27f-45a8-b73a-278e7576af14 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:17.822232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a7295-f27f-45a8-b73a-278e7576af14 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:17.822556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a7295-f27f-45a8-b73a-278e7576af14 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:17.823404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a7295-f27f-45a8-b73a-278e7576af14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:17.823809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a7295-f27f-45a8-b73a-278e7576af14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:17.825221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a7295-f27f-45a8-b73a-278e7576af14 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:17.842562 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 297/587] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:17.843473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a7295-f27f-45a8-b73a-278e7576af14 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:17.928567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c80ff5-ada5-4ef4-9a19-7c94ec897348 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:17.952118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a7295-f27f-45a8-b73a-278e7576af14 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:17.973091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff48bf2-33d3-417a-b99a-98c554f9b041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:17.973803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff48bf2-33d3-417a-b99a-98c554f9b041 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:17.974665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff48bf2-33d3-417a-b99a-98c554f9b041 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:17.974961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff48bf2-33d3-417a-b99a-98c554f9b041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:17.990005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df033514-07f1-4c9b-a6b2-07aa1a95e5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:17.990643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df033514-07f1-4c9b-a6b2-07aa1a95e5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:17.990920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df033514-07f1-4c9b-a6b2-07aa1a95e5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:17.991194 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df033514-07f1-4c9b-a6b2-07aa1a95e5e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:17.991952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df033514-07f1-4c9b-a6b2-07aa1a95e5e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:17.992262 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df033514-07f1-4c9b-a6b2-07aa1a95e5e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:17.992561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff48bf2-33d3-417a-b99a-98c554f9b041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:17.993758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df033514-07f1-4c9b-a6b2-07aa1a95e5e7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:17.994454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff48bf2-33d3-417a-b99a-98c554f9b041 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:18.002315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:18.014988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 298/588] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:18.015838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df033514-07f1-4c9b-a6b2-07aa1a95e5e7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-cff48bf2-33d3-417a-b99a-98c554f9b041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:18.022013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:18.023213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:18.024325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:18.024325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:18.024325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:18.024325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:18.032293 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 291/589] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:18.032293 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff48bf2-33d3-417a-b99a-98c554f9b041 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:18.090296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:18.143956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df033514-07f1-4c9b-a6b2-07aa1a95e5e7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:18.177073 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff48bf2-33d3-417a-b99a-98c554f9b041 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:18.182485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e414a-c6fa-4213-aa58-2edb98d2b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:18.183237 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e414a-c6fa-4213-aa58-2edb98d2b299 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:18.183581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e414a-c6fa-4213-aa58-2edb98d2b299 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:18.183921 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e414a-c6fa-4213-aa58-2edb98d2b299 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:18.192295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e414a-c6fa-4213-aa58-2edb98d2b299 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:18.193925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e414a-c6fa-4213-aa58-2edb98d2b299 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-055e414a-c6fa-4213-aa58-2edb98d2b299 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:18.207263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:18.208206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:18.209181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:18.209181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:18.209181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:18.209181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:18.209181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:18.209181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:18.209181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:18.209181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:18.209181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 07:01:18.209181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:18.213449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 299/590] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:18.214378 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e414a-c6fa-4213-aa58-2edb98d2b299 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:18.225086 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db18ee-6ec5-4564-854a-1bd3b9bd545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:18.226364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db18ee-6ec5-4564-854a-1bd3b9bd545d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:18.226831 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db18ee-6ec5-4564-854a-1bd3b9bd545d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:18.227284 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db18ee-6ec5-4564-854a-1bd3b9bd545d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:18.237583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db18ee-6ec5-4564-854a-1bd3b9bd545d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:18.240074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db18ee-6ec5-4564-854a-1bd3b9bd545d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f8db18ee-6ec5-4564-854a-1bd3b9bd545d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:18.255609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:18.256573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:18.257590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:18.257590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:18.257590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:18.257590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:18.257590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:18.257590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:18.257590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:18.257590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:18.257590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 07:01:18.257590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:18.259837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 292/591] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:18.260970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db18ee-6ec5-4564-854a-1bd3b9bd545d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:18.283699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:18.348288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e414a-c6fa-4213-aa58-2edb98d2b299 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:18.370263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:18.377958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db18ee-6ec5-4564-854a-1bd3b9bd545d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:18.387970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b0c2b-b821-4cec-a668-5fa804872c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:18.388993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b0c2b-b821-4cec-a668-5fa804872c7a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:18.389282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b0c2b-b821-4cec-a668-5fa804872c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:18.389564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b0c2b-b821-4cec-a668-5fa804872c7a None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:18.390597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b0c2b-b821-4cec-a668-5fa804872c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:18.391194 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b0c2b-b821-4cec-a668-5fa804872c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:18.392863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b0c2b-b821-4cec-a668-5fa804872c7a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:18.413391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 300/592] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:18.414623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b0c2b-b821-4cec-a668-5fa804872c7a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:18.430010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab5e57-cf19-44c4-96c7-2de4d256173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:18.431333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab5e57-cf19-44c4-96c7-2de4d256173b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:18.431852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab5e57-cf19-44c4-96c7-2de4d256173b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:18.432585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab5e57-cf19-44c4-96c7-2de4d256173b None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:18.434121 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab5e57-cf19-44c4-96c7-2de4d256173b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:18.434902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab5e57-cf19-44c4-96c7-2de4d256173b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:18.437256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab5e57-cf19-44c4-96c7-2de4d256173b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:18.469152 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 293/593] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Aug 5 07:01:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:18.469970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab5e57-cf19-44c4-96c7-2de4d256173b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:18.542310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b0c2b-b821-4cec-a668-5fa804872c7a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:18.561980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:18.576245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab5e57-cf19-44c4-96c7-2de4d256173b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:18.584410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f118de-b6bc-486e-997f-0ac9f6d7d7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:18.585525 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f118de-b6bc-486e-997f-0ac9f6d7d7db None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:18.585825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f118de-b6bc-486e-997f-0ac9f6d7d7db None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:18.586101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f118de-b6bc-486e-997f-0ac9f6d7d7db None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:18.586909 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f118de-b6bc-486e-997f-0ac9f6d7d7db None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:18.587220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f118de-b6bc-486e-997f-0ac9f6d7d7db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:18.589077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f118de-b6bc-486e-997f-0ac9f6d7d7db None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:18.616346 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 301/594] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 5 07:01:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:18.616346 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f118de-b6bc-486e-997f-0ac9f6d7d7db None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:18.626999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67097c0-e06e-49b4-a835-7234d96d46ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:18.628377 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67097c0-e06e-49b4-a835-7234d96d46ed None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:18.629141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67097c0-e06e-49b4-a835-7234d96d46ed None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:18.629616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67097c0-e06e-49b4-a835-7234d96d46ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:18.638918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67097c0-e06e-49b4-a835-7234d96d46ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:18.641508 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67097c0-e06e-49b4-a835-7234d96d46ed None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b67097c0-e06e-49b4-a835-7234d96d46ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:18.657905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:18.658835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:18.659708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:18.659708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:18.659708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:18.659708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:18.659708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:18.659708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:18.659708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:18.659708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:18.667638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 294/595] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:18.667638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67097c0-e06e-49b4-a835-7234d96d46ed None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:18.682932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:18.732799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f118de-b6bc-486e-997f-0ac9f6d7d7db None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:18.770575 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44f248-55a2-4d9a-99f3-c73797a8b809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:18.771652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44f248-55a2-4d9a-99f3-c73797a8b809 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:18.772151 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44f248-55a2-4d9a-99f3-c73797a8b809 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:18.772624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44f248-55a2-4d9a-99f3-c73797a8b809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:18.774739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67097c0-e06e-49b4-a835-7234d96d46ed None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:18.784396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44f248-55a2-4d9a-99f3-c73797a8b809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:18.786404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44f248-55a2-4d9a-99f3-c73797a8b809 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-4d44f248-55a2-4d9a-99f3-c73797a8b809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:18.802684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:18.803588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:18.804489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:18.804489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:18.804489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:18.804489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:18.806440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 302/596] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:18.807448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44f248-55a2-4d9a-99f3-c73797a8b809 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:18.816306 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bca34-9b85-49ef-8024-27bbad0ba829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:18.817041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bca34-9b85-49ef-8024-27bbad0ba829 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:18.817326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bca34-9b85-49ef-8024-27bbad0ba829 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:18.817604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bca34-9b85-49ef-8024-27bbad0ba829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:18.829833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bca34-9b85-49ef-8024-27bbad0ba829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:18.831362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bca34-9b85-49ef-8024-27bbad0ba829 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:18.839652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-eb1bca34-9b85-49ef-8024-27bbad0ba829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:18.852217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:18.853216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:18.854272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:18.854272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:18.854272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:18.854272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:18.854272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 295/597] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:18.855095 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bca34-9b85-49ef-8024-27bbad0ba829 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:18.924197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:18.943449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44f248-55a2-4d9a-99f3-c73797a8b809 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:18.967370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bca34-9b85-49ef-8024-27bbad0ba829 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:18.990579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7c9cc-b335-4fe4-9b8b-85c1f909e26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:18.992127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7c9cc-b335-4fe4-9b8b-85c1f909e26c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:18.992591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7c9cc-b335-4fe4-9b8b-85c1f909e26c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:18.993306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7c9cc-b335-4fe4-9b8b-85c1f909e26c None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:18.994501 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7c9cc-b335-4fe4-9b8b-85c1f909e26c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:18.995429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7c9cc-b335-4fe4-9b8b-85c1f909e26c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:18.997794 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7c9cc-b335-4fe4-9b8b-85c1f909e26c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:19.003356 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323c0f-9854-463b-a8c5-03969cd0a5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:19.004076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323c0f-9854-463b-a8c5-03969cd0a5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.004505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323c0f-9854-463b-a8c5-03969cd0a5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.004843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323c0f-9854-463b-a8c5-03969cd0a5f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.005775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61323c0f-9854-463b-a8c5-03969cd0a5f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:19.006148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61323c0f-9854-463b-a8c5-03969cd0a5f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:19.007653 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61323c0f-9854-463b-a8c5-03969cd0a5f7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:19.018554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 303/598] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:19.018554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7c9cc-b335-4fe4-9b8b-85c1f909e26c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:19.029277 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 296/599] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:19.031102 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323c0f-9854-463b-a8c5-03969cd0a5f7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:19.121974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:19.137989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7c9cc-b335-4fe4-9b8b-85c1f909e26c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:19.154680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323c0f-9854-463b-a8c5-03969cd0a5f7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:19.175358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6752b-13c9-4dea-9d9c-6720bd114301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:19.176006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6752b-13c9-4dea-9d9c-6720bd114301 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.176379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6752b-13c9-4dea-9d9c-6720bd114301 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.176662 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6752b-13c9-4dea-9d9c-6720bd114301 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.177415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6752b-13c9-4dea-9d9c-6720bd114301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:19.177723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6752b-13c9-4dea-9d9c-6720bd114301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:19.179224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6752b-13c9-4dea-9d9c-6720bd114301 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:19.183150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:19.194554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 304/600] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:19.195479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6752b-13c9-4dea-9d9c-6720bd114301 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:19.200927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0028dc5-a0eb-496a-bd6a-7ccb5ef0b925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:19.200927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0028dc5-a0eb-496a-bd6a-7ccb5ef0b925 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.201191 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0028dc5-a0eb-496a-bd6a-7ccb5ef0b925 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.201263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0028dc5-a0eb-496a-bd6a-7ccb5ef0b925 None admin] PATH_INFO: `/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/555de6e5c8c44f40a6433b3d2ffc52f3/roles/58b981aa32454837bd8eae9e804d811e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.221754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0028dc5-a0eb-496a-bd6a-7ccb5ef0b925 None admin] RBAC: Authorizing `identity:create_grant(project_id=29b560f1bcf347f6b8b885cc02d52e33, user_id=555de6e5c8c44f40a6433b3d2ffc52f3, role_id=58b981aa32454837bd8eae9e804d811e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:19.223235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0028dc5-a0eb-496a-bd6a-7ccb5ef0b925 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:19.241564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 297/601] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:01:19 2022] PUT /identity/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/555de6e5c8c44f40a6433b3d2ffc52f3/roles/58b981aa32454837bd8eae9e804d811e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:01:19.242200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0028dc5-a0eb-496a-bd6a-7ccb5ef0b925 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:19.373203 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6752b-13c9-4dea-9d9c-6720bd114301 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:19.398855 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0028dc5-a0eb-496a-bd6a-7ccb5ef0b925 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:19.412190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a786a5-4600-46dd-9e72-690b97f5ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:19.412870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a786a5-4600-46dd-9e72-690b97f5ed0c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.413547 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a786a5-4600-46dd-9e72-690b97f5ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.413819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a786a5-4600-46dd-9e72-690b97f5ed0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.422101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a786a5-4600-46dd-9e72-690b97f5ed0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:19.423854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a786a5-4600-46dd-9e72-690b97f5ed0c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-99a786a5-4600-46dd-9e72-690b97f5ed0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:19.437080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:19.439414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:19.441886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:19.441886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:19.441886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:19.441886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:19.441886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:19.441886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:19.441886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:19.441886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:19.442883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b38dd7-6fd3-41fd-b45a-1d20828cc461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:19.442883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b38dd7-6fd3-41fd-b45a-1d20828cc461 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.443188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 305/602] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:19.443338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b38dd7-6fd3-41fd-b45a-1d20828cc461 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.443338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b38dd7-6fd3-41fd-b45a-1d20828cc461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.443605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3f2e-a34f-4334-bda4-279a22223559 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.443605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3f2e-a34f-4334-bda4-279a22223559 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.443605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa3f2e-a34f-4334-bda4-279a22223559 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.452931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 306/603] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:19.453249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b38dd7-6fd3-41fd-b45a-1d20828cc461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:19.453433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3f2e-a34f-4334-bda4-279a22223559 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:19.453581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b38dd7-6fd3-41fd-b45a-1d20828cc461 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:19.461285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-09b38dd7-6fd3-41fd-b45a-1d20828cc461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:19.467066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:19.468315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:19.470299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:19.470299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:19.470299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:19.470299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:19.470299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:19.470299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:19.470299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:19.470299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:19.470299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 298/604] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:19.475500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c6ec6-1975-4a60-837f-04c87fa84ada None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.476110 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c6ec6-1975-4a60-837f-04c87fa84ada None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.476587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c6ec6-1975-4a60-837f-04c87fa84ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.499965 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-159c6ec6-1975-4a60-837f-04c87fa84ada None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:19.501227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-159c6ec6-1975-4a60-837f-04c87fa84ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:19.535535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:19.572548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa3f2e-a34f-4334-bda4-279a22223559 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:19.597347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 299/605] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:19.597956 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c6ec6-1975-4a60-837f-04c87fa84ada None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:19.613067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedaa06-8aac-45fb-8d7f-81d06f3daaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:19.614119 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedaa06-8aac-45fb-8d7f-81d06f3daaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.614703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedaa06-8aac-45fb-8d7f-81d06f3daaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.615165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedaa06-8aac-45fb-8d7f-81d06f3daaf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.616163 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedaa06-8aac-45fb-8d7f-81d06f3daaf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:19.616705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedaa06-8aac-45fb-8d7f-81d06f3daaf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:19.618382 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedaa06-8aac-45fb-8d7f-81d06f3daaf5 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:19.632222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 307/606] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:19.638179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedaa06-8aac-45fb-8d7f-81d06f3daaf5 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:19.708995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:19.725806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c6ec6-1975-4a60-837f-04c87fa84ada None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:19.749260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedaa06-8aac-45fb-8d7f-81d06f3daaf5 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:19.768510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab37794-2e3d-471c-be9c-034db110e5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:19.769190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab37794-2e3d-471c-be9c-034db110e5cc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.769479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab37794-2e3d-471c-be9c-034db110e5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.769754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab37794-2e3d-471c-be9c-034db110e5cc None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.770518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab37794-2e3d-471c-be9c-034db110e5cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:19.770824 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab37794-2e3d-471c-be9c-034db110e5cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:19.772283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab37794-2e3d-471c-be9c-034db110e5cc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:19.787004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 300/607] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:19.788395 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab37794-2e3d-471c-be9c-034db110e5cc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:19.793666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f732b5-c0a8-4f56-808a-25eaceec60ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:19.794325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f732b5-c0a8-4f56-808a-25eaceec60ad None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.794601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f732b5-c0a8-4f56-808a-25eaceec60ad None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.794870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f732b5-c0a8-4f56-808a-25eaceec60ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.806015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f732b5-c0a8-4f56-808a-25eaceec60ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-36f732b5-c0a8-4f56-808a-25eaceec60ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:19.811484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:19.812421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:19.813370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 308/608] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:19.814655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4191f-2dcc-47ae-8400-00d22f444815 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.814655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4191f-2dcc-47ae-8400-00d22f444815 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.814815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4191f-2dcc-47ae-8400-00d22f444815 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.820135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 309/609] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:19.820135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4191f-2dcc-47ae-8400-00d22f444815 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:19.824884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:19.907016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab37794-2e3d-471c-be9c-034db110e5cc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:19.928096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4191f-2dcc-47ae-8400-00d22f444815 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:19.944254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b90e32-27d4-433c-a25a-c473242ccfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:19.944887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b90e32-27d4-433c-a25a-c473242ccfcc None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.945182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b90e32-27d4-433c-a25a-c473242ccfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.945453 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b90e32-27d4-433c-a25a-c473242ccfcc None admin] PATH_INFO: `/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/9c4ce8a3f876467f93e7c9efd9e33390/roles/58b981aa32454837bd8eae9e804d811e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.956492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:19.962091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b90e32-27d4-433c-a25a-c473242ccfcc None admin] RBAC: Authorizing `identity:create_grant(project_id=29b560f1bcf347f6b8b885cc02d52e33, user_id=9c4ce8a3f876467f93e7c9efd9e33390, role_id=58b981aa32454837bd8eae9e804d811e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:19.963562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b90e32-27d4-433c-a25a-c473242ccfcc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:19.965784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f673083-63e3-41c1-a6dc-a45795d28be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:19.966470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f673083-63e3-41c1-a6dc-a45795d28be2 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:19.966746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f673083-63e3-41c1-a6dc-a45795d28be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:19.967022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f673083-63e3-41c1-a6dc-a45795d28be2 None admin] PATH_INFO: `/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/d44bcb27daeb4116835bbfb5dcb1dc33/roles/58b981aa32454837bd8eae9e804d811e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:19.981476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 301/610] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:01:19 2022] PUT /identity/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/9c4ce8a3f876467f93e7c9efd9e33390/roles/58b981aa32454837bd8eae9e804d811e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:01:19.983083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b90e32-27d4-433c-a25a-c473242ccfcc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:19.990655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f673083-63e3-41c1-a6dc-a45795d28be2 None admin] RBAC: Authorizing `identity:create_grant(project_id=29b560f1bcf347f6b8b885cc02d52e33, user_id=d44bcb27daeb4116835bbfb5dcb1dc33, role_id=58b981aa32454837bd8eae9e804d811e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:19.992768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f673083-63e3-41c1-a6dc-a45795d28be2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:20.010959 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 310/611] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:01:19 2022] PUT /identity/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/d44bcb27daeb4116835bbfb5dcb1dc33/roles/58b981aa32454837bd8eae9e804d811e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:01:20.012823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634067b7-6337-4068-bd66-b3790d47dcde None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:20.013341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634067b7-6337-4068-bd66-b3790d47dcde None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:20.013839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634067b7-6337-4068-bd66-b3790d47dcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:20.035267 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-634067b7-6337-4068-bd66-b3790d47dcde None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:20.036976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-634067b7-6337-4068-bd66-b3790d47dcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:20.120806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 311/612] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:20.136331 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:20.166249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634067b7-6337-4068-bd66-b3790d47dcde None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:20.189711 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b90e32-27d4-433c-a25a-c473242ccfcc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:20.246447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c865df0-253e-46f8-adae-4f881774b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:20.246884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c865df0-253e-46f8-adae-4f881774b91d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:20.247213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c865df0-253e-46f8-adae-4f881774b91d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:20.247491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c865df0-253e-46f8-adae-4f881774b91d None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:20.248253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c865df0-253e-46f8-adae-4f881774b91d None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:20.248525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c865df0-253e-46f8-adae-4f881774b91d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:20.250045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c865df0-253e-46f8-adae-4f881774b91d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:20.266960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 302/613] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:20.274390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c865df0-253e-46f8-adae-4f881774b91d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:20.301732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634067b7-6337-4068-bd66-b3790d47dcde None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:20.314401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:20.345733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110987a5-f37f-48b0-a691-c0136ac53151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:20.346395 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110987a5-f37f-48b0-a691-c0136ac53151 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:20.346683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110987a5-f37f-48b0-a691-c0136ac53151 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:20.346998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110987a5-f37f-48b0-a691-c0136ac53151 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:20.361771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110987a5-f37f-48b0-a691-c0136ac53151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-110987a5-f37f-48b0-a691-c0136ac53151 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:20.367887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:20.368790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:20.369653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 312/614] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:20.377938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110987a5-f37f-48b0-a691-c0136ac53151 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:20.428008 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c865df0-253e-46f8-adae-4f881774b91d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:20.521045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71326a4e-07e1-471f-b0fb-add288ceb3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:20.522115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71326a4e-07e1-471f-b0fb-add288ceb3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:20.522615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71326a4e-07e1-471f-b0fb-add288ceb3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:20.523082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71326a4e-07e1-471f-b0fb-add288ceb3b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:20.537457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:20.559038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71326a4e-07e1-471f-b0fb-add288ceb3b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:20.560505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71326a4e-07e1-471f-b0fb-add288ceb3b1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:20.573175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110987a5-f37f-48b0-a691-c0136ac53151 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-71326a4e-07e1-471f-b0fb-add288ceb3b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:20.587416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:20.588388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:20.589324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:20.589324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:20.589324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:20.589324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:20.597616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 303/615] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:20.598574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71326a4e-07e1-471f-b0fb-add288ceb3b1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:20.615611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986313e6-be9f-4a0d-9d98-adb2f5d8e2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:20.616684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986313e6-be9f-4a0d-9d98-adb2f5d8e2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:20.617225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986313e6-be9f-4a0d-9d98-adb2f5d8e2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:20.617704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986313e6-be9f-4a0d-9d98-adb2f5d8e2e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:20.618662 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986313e6-be9f-4a0d-9d98-adb2f5d8e2e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:20.619313 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986313e6-be9f-4a0d-9d98-adb2f5d8e2e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:20.621263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986313e6-be9f-4a0d-9d98-adb2f5d8e2e7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:20.632541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 313/616] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:20.642022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986313e6-be9f-4a0d-9d98-adb2f5d8e2e7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:20.700576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:20.781524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71326a4e-07e1-471f-b0fb-add288ceb3b1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:20.825363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986313e6-be9f-4a0d-9d98-adb2f5d8e2e7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:20.842233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028933d5-10fd-49ee-9261-c9fed3db5684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:20.842857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028933d5-10fd-49ee-9261-c9fed3db5684 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:20.843132 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028933d5-10fd-49ee-9261-c9fed3db5684 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:20.843400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028933d5-10fd-49ee-9261-c9fed3db5684 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:20.844388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028933d5-10fd-49ee-9261-c9fed3db5684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:20.844692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028933d5-10fd-49ee-9261-c9fed3db5684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:20.846177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028933d5-10fd-49ee-9261-c9fed3db5684 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:20.874352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 304/617] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:20.883557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028933d5-10fd-49ee-9261-c9fed3db5684 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:20.885444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b427400-cc7b-48fc-b822-963bddfd7b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:20.886102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b427400-cc7b-48fc-b822-963bddfd7b39 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:20.886379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b427400-cc7b-48fc-b822-963bddfd7b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:20.886854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b427400-cc7b-48fc-b822-963bddfd7b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:20.905849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b427400-cc7b-48fc-b822-963bddfd7b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:20.907314 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b427400-cc7b-48fc-b822-963bddfd7b39 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-8b427400-cc7b-48fc-b822-963bddfd7b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:20.943206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:20.944152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:20.945059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:20.945059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:20.945059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:20.945059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:20.945059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 314/618] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:20.952209 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b427400-cc7b-48fc-b822-963bddfd7b39 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:20.981530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:21.062676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:21.084098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b427400-cc7b-48fc-b822-963bddfd7b39 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:21.107739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028933d5-10fd-49ee-9261-c9fed3db5684 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:21.128372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e9ce1-c45e-4dbd-b808-76b08df34dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:21.129042 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e9ce1-c45e-4dbd-b808-76b08df34dda None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:21.129327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e9ce1-c45e-4dbd-b808-76b08df34dda None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:21.129603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e9ce1-c45e-4dbd-b808-76b08df34dda None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:21.130307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e9ce1-c45e-4dbd-b808-76b08df34dda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:21.130614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e9ce1-c45e-4dbd-b808-76b08df34dda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:21.131993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e9ce1-c45e-4dbd-b808-76b08df34dda None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:21.159989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 315/619] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:21.166663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e9ce1-c45e-4dbd-b808-76b08df34dda None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:21.180177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81801f8e-7449-476c-ab54-f962edf8e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:21.180177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81801f8e-7449-476c-ab54-f962edf8e503 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:21.180177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81801f8e-7449-476c-ab54-f962edf8e503 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:21.180177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81801f8e-7449-476c-ab54-f962edf8e503 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:21.189215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81801f8e-7449-476c-ab54-f962edf8e503 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:21.190917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81801f8e-7449-476c-ab54-f962edf8e503 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-81801f8e-7449-476c-ab54-f962edf8e503 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:21.210607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:21.211705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:21.212637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:21.212637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:21.212637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:21.212637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:21.212637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:21.212637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:21.212637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:21.212637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:21.212637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 07:01:21.212637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:21.219479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 305/620] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:21.223756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81801f8e-7449-476c-ab54-f962edf8e503 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:21.339727 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81801f8e-7449-476c-ab54-f962edf8e503 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:21.350933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:21.376412 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd804c21-e6fb-4e13-a837-690493179448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:21.377136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd804c21-e6fb-4e13-a837-690493179448 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:21.377417 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd804c21-e6fb-4e13-a837-690493179448 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:21.377683 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd804c21-e6fb-4e13-a837-690493179448 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:21.378476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd804c21-e6fb-4e13-a837-690493179448 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:21.378779 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd804c21-e6fb-4e13-a837-690493179448 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:21.380202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd804c21-e6fb-4e13-a837-690493179448 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:21.395117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e9ce1-c45e-4dbd-b808-76b08df34dda None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:21.403271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 306/621] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 5 07:01:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:21.404586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd804c21-e6fb-4e13-a837-690493179448 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:21.466126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247e1ab-f0e6-489d-a7b2-41d5466b3f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:21.466734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247e1ab-f0e6-489d-a7b2-41d5466b3f9a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:21.467028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247e1ab-f0e6-489d-a7b2-41d5466b3f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:21.467303 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247e1ab-f0e6-489d-a7b2-41d5466b3f9a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:21.480101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247e1ab-f0e6-489d-a7b2-41d5466b3f9a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:21.487576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247e1ab-f0e6-489d-a7b2-41d5466b3f9a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-f247e1ab-f0e6-489d-a7b2-41d5466b3f9a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:21.500811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:21.501922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:21.502874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:21.502874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:21.502874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:21.502874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:21.502874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:21.502874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:21.502874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:21.502874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:21.502874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 07:01:21.502874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:21.502874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 316/622] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:21.503978 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53088a7f-29ac-4295-b18f-6624a62f8039 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:21.503978 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53088a7f-29ac-4295-b18f-6624a62f8039 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:21.504255 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53088a7f-29ac-4295-b18f-6624a62f8039 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:21.505919 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 317/623] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:21.509081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53088a7f-29ac-4295-b18f-6624a62f8039 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:21.512445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:21.522464 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd804c21-e6fb-4e13-a837-690493179448 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:21.561391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc3b04-a168-429b-94b2-0c0f0a0e4981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:21.562452 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc3b04-a168-429b-94b2-0c0f0a0e4981 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:21.563082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc3b04-a168-429b-94b2-0c0f0a0e4981 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:21.563566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc3b04-a168-429b-94b2-0c0f0a0e4981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:21.601355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:21.637763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53088a7f-29ac-4295-b18f-6624a62f8039 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:21.638426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc3b04-a168-429b-94b2-0c0f0a0e4981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:21.640363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc3b04-a168-429b-94b2-0c0f0a0e4981 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:21.673445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8235e-eda9-4294-9132-52d996f5d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:21.674072 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8235e-eda9-4294-9132-52d996f5d687 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:21.674357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8235e-eda9-4294-9132-52d996f5d687 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:21.674628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8235e-eda9-4294-9132-52d996f5d687 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:21.675422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8235e-eda9-4294-9132-52d996f5d687 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:21.675744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8235e-eda9-4294-9132-52d996f5d687 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:21.677196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8235e-eda9-4294-9132-52d996f5d687 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:21.695238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 318/624] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Aug 5 07:01:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:21.696582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2229d1-1b88-4df7-bf03-9043277fec0a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:21.696872 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2229d1-1b88-4df7-bf03-9043277fec0a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:21.697167 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2229d1-1b88-4df7-bf03-9043277fec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:21.714635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7a2229d1-1b88-4df7-bf03-9043277fec0a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:21.715843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7a2229d1-1b88-4df7-bf03-9043277fec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:21.751231 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 307/625] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:21.752485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc3b04-a168-429b-94b2-0c0f0a0e4981 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:21.772839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:21.788925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 319/626] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:21.788925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2229d1-1b88-4df7-bf03-9043277fec0a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:21.865402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:21.889588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc3b04-a168-429b-94b2-0c0f0a0e4981 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:21.890923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2229d1-1b88-4df7-bf03-9043277fec0a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:21.927860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7186f-2b6a-4a04-9dca-2aa4bc19a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:21.928529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7186f-2b6a-4a04-9dca-2aa4bc19a387 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:21.928815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7186f-2b6a-4a04-9dca-2aa4bc19a387 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:21.929133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7186f-2b6a-4a04-9dca-2aa4bc19a387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:21.929464 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf619d-dfe9-4118-82e8-4c9fdfe39496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:21.930405 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf619d-dfe9-4118-82e8-4c9fdfe39496 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:21.930886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf619d-dfe9-4118-82e8-4c9fdfe39496 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:21.931460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf619d-dfe9-4118-82e8-4c9fdfe39496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:21.940641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7186f-2b6a-4a04-9dca-2aa4bc19a387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:21.942149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7186f-2b6a-4a04-9dca-2aa4bc19a387 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:21.944096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf619d-dfe9-4118-82e8-4c9fdfe39496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:21.945912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf619d-dfe9-4118-82e8-4c9fdfe39496 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0dc7186f-2b6a-4a04-9dca-2aa4bc19a387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:21.958104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:21.959060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:21.959946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:21.959946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:21.959946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:21.959946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:21.959946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 320/627] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:21.960705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7186f-2b6a-4a04-9dca-2aa4bc19a387 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4bcf619d-dfe9-4118-82e8-4c9fdfe39496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:21.966066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:21.966985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:21.967958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:21.967958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:21.967958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:21.967958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:21.970468 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 308/628] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:21.971594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf619d-dfe9-4118-82e8-4c9fdfe39496 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:22.006107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:22.064968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7186f-2b6a-4a04-9dca-2aa4bc19a387 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:22.083491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf619d-dfe9-4118-82e8-4c9fdfe39496 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:22.100177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb277707-e106-4d30-bb52-78fa7b734e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:22.100965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb277707-e106-4d30-bb52-78fa7b734e12 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.101313 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb277707-e106-4d30-bb52-78fa7b734e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.101514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb277707-e106-4d30-bb52-78fa7b734e12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.112192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb277707-e106-4d30-bb52-78fa7b734e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:22.113257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-bb277707-e106-4d30-bb52-78fa7b734e12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:22.117666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:22.118602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:22.119413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:22.119413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:22.119413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:22.119413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:22.119413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:22.119413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:22.119413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:22.119413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:22.119413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:22.119413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:22.119413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:22.119413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:22.123937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 321/629] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:22.125064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb277707-e106-4d30-bb52-78fa7b734e12 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:22.127739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afad59-e12a-4557-83f1-f4d29ec46031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:22.128772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afad59-e12a-4557-83f1-f4d29ec46031 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.129485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afad59-e12a-4557-83f1-f4d29ec46031 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.129979 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afad59-e12a-4557-83f1-f4d29ec46031 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.130876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afad59-e12a-4557-83f1-f4d29ec46031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:22.131446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afad59-e12a-4557-83f1-f4d29ec46031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:22.133145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74afad59-e12a-4557-83f1-f4d29ec46031 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:22.147097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 309/630] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:22.148427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afad59-e12a-4557-83f1-f4d29ec46031 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:22.230332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb277707-e106-4d30-bb52-78fa7b734e12 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:22.231904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:22.272141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afad59-e12a-4557-83f1-f4d29ec46031 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:22.298816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4246b65-eee9-4247-93ab-f8b7f9848c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:22.300058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4246b65-eee9-4247-93ab-f8b7f9848c01 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.300875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4246b65-eee9-4247-93ab-f8b7f9848c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.301693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4246b65-eee9-4247-93ab-f8b7f9848c01 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.302952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4246b65-eee9-4247-93ab-f8b7f9848c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:22.303913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4246b65-eee9-4247-93ab-f8b7f9848c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:22.306159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4246b65-eee9-4247-93ab-f8b7f9848c01 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:22.311566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff3dbc-a5b3-4e80-a87e-e526b1a7292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:22.312210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff3dbc-a5b3-4e80-a87e-e526b1a7292e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.312488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff3dbc-a5b3-4e80-a87e-e526b1a7292e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.312763 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff3dbc-a5b3-4e80-a87e-e526b1a7292e None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.313527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff3dbc-a5b3-4e80-a87e-e526b1a7292e None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:22.314059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff3dbc-a5b3-4e80-a87e-e526b1a7292e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:22.315443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff3dbc-a5b3-4e80-a87e-e526b1a7292e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:22.323568 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 322/631] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:22.328932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4246b65-eee9-4247-93ab-f8b7f9848c01 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:22.336862 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 310/632] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:22.336862 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff3dbc-a5b3-4e80-a87e-e526b1a7292e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:22.386782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:22.448681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff3dbc-a5b3-4e80-a87e-e526b1a7292e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:22.457769 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4246b65-eee9-4247-93ab-f8b7f9848c01 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:22.482869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c8c46-3b1a-4817-a1b9-d5e200f5af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:22.483512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c8c46-3b1a-4817-a1b9-d5e200f5af1d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.483814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c8c46-3b1a-4817-a1b9-d5e200f5af1d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.484077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c8c46-3b1a-4817-a1b9-d5e200f5af1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.490947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c8c46-3b1a-4817-a1b9-d5e200f5af1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:22.492393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c8c46-3b1a-4817-a1b9-d5e200f5af1d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:22.492544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449128b-1d77-4ed7-8c93-f83553111904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:22.493231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449128b-1d77-4ed7-8c93-f83553111904 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.493507 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449128b-1d77-4ed7-8c93-f83553111904 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.493776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449128b-1d77-4ed7-8c93-f83553111904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.500500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449128b-1d77-4ed7-8c93-f83553111904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:22.501969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449128b-1d77-4ed7-8c93-f83553111904 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c22c8c46-3b1a-4817-a1b9-d5e200f5af1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:22.503741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:22.504608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:22.505801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:22.505801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:22.505801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:22.505801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:22.505801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:22.505801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:22.505801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:22.505801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:22.505801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 311/633] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:22.506438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c8c46-3b1a-4817-a1b9-d5e200f5af1d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-1449128b-1d77-4ed7-8c93-f83553111904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:22.513418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:22.514293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:22.515164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:22.515164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:22.515164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:22.515164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:22.515164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:22.515164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:22.515164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:22.515164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:22.515164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 323/634] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:22.516430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dffac-c62b-46e2-b6e0-bea0463a2c0f None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.516430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dffac-c62b-46e2-b6e0-bea0463a2c0f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.516430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dffac-c62b-46e2-b6e0-bea0463a2c0f None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.517557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 324/635] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:22.518579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913219a-a0a9-4af6-bfba-01ef017412ff None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.518859 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913219a-a0a9-4af6-bfba-01ef017412ff None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.519159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913219a-a0a9-4af6-bfba-01ef017412ff None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.520575 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 325/636] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:22.521317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913219a-a0a9-4af6-bfba-01ef017412ff None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:22.546309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:22.611118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:22.614397 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c8c46-3b1a-4817-a1b9-d5e200f5af1d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:22.633963 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913219a-a0a9-4af6-bfba-01ef017412ff None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:22.651227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc43a12-df3a-4905-b756-5ff8b4857fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:22.651886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc43a12-df3a-4905-b756-5ff8b4857fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.652147 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc43a12-df3a-4905-b756-5ff8b4857fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.652414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc43a12-df3a-4905-b756-5ff8b4857fc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.663337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc43a12-df3a-4905-b756-5ff8b4857fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:22.664782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc43a12-df3a-4905-b756-5ff8b4857fc0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:22.669639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438bf2c-2f69-4669-8601-3e5875635d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:22.670262 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438bf2c-2f69-4669-8601-3e5875635d7d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.670541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438bf2c-2f69-4669-8601-3e5875635d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.670814 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438bf2c-2f69-4669-8601-3e5875635d7d None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.671566 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438bf2c-2f69-4669-8601-3e5875635d7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:22.671873 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438bf2c-2f69-4669-8601-3e5875635d7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:22.673451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438bf2c-2f69-4669-8601-3e5875635d7d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-3dc43a12-df3a-4905-b756-5ff8b4857fc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:22.678837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:22.679925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:22.680867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:22.680867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:22.680867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:22.680867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:22.680867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 312/637] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:22.681263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc43a12-df3a-4905-b756-5ff8b4857fc0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:22.687010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 326/638] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:22.688398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b42594-de5a-4fdb-8ea9-5d7ab7a25a12 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.688794 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b42594-de5a-4fdb-8ea9-5d7ab7a25a12 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.689103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b42594-de5a-4fdb-8ea9-5d7ab7a25a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.708342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b8b42594-de5a-4fdb-8ea9-5d7ab7a25a12 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:22.709584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b8b42594-de5a-4fdb-8ea9-5d7ab7a25a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:22.778142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 327/639] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:22.779407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb7679-be23-4be5-9447-f17402bbc5a8 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.779696 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb7679-be23-4be5-9447-f17402bbc5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.779977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb7679-be23-4be5-9447-f17402bbc5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.781785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc43a12-df3a-4905-b756-5ff8b4857fc0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:22.798665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-cfbb7679-be23-4be5-9447-f17402bbc5a8 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:22.799912 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cfbb7679-be23-4be5-9447-f17402bbc5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:22.807990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:22.818316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe847fc6-ad5b-46de-ad4a-7821a31d40b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:22.818941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe847fc6-ad5b-46de-ad4a-7821a31d40b2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.819220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe847fc6-ad5b-46de-ad4a-7821a31d40b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.819493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe847fc6-ad5b-46de-ad4a-7821a31d40b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.820258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe847fc6-ad5b-46de-ad4a-7821a31d40b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:22.820578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe847fc6-ad5b-46de-ad4a-7821a31d40b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:22.822032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe847fc6-ad5b-46de-ad4a-7821a31d40b2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:22.834202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 313/640] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:22.835016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe847fc6-ad5b-46de-ad4a-7821a31d40b2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:22.850465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:22.870984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 328/641] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:22.871822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb7679-be23-4be5-9447-f17402bbc5a8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:22.955363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe847fc6-ad5b-46de-ad4a-7821a31d40b2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:22.972645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb7679-be23-4be5-9447-f17402bbc5a8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:22.990473 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb75f1-a095-499a-95b0-1116ae4b7d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:22.991094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb75f1-a095-499a-95b0-1116ae4b7d16 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:22.991383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb75f1-a095-499a-95b0-1116ae4b7d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:22.991660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb75f1-a095-499a-95b0-1116ae4b7d16 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:22.992346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb75f1-a095-499a-95b0-1116ae4b7d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:22.992644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb75f1-a095-499a-95b0-1116ae4b7d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:22.994008 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb75f1-a095-499a-95b0-1116ae4b7d16 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:23.005188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 314/642] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:23.006100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79fe8b-471a-4795-9d8c-1ec2eb8b409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:23.006239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb75f1-a095-499a-95b0-1116ae4b7d16 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:23.006790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79fe8b-471a-4795-9d8c-1ec2eb8b409e None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:23.007065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79fe8b-471a-4795-9d8c-1ec2eb8b409e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:23.007343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79fe8b-471a-4795-9d8c-1ec2eb8b409e None admin] PATH_INFO: `/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/8d83b456cec84bc5ab02a190099c0baf/roles/58b981aa32454837bd8eae9e804d811e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:23.020682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:23.024470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79fe8b-471a-4795-9d8c-1ec2eb8b409e None admin] RBAC: Authorizing `identity:create_grant(project_id=29b560f1bcf347f6b8b885cc02d52e33, user_id=8d83b456cec84bc5ab02a190099c0baf, role_id=58b981aa32454837bd8eae9e804d811e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:23.026215 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79fe8b-471a-4795-9d8c-1ec2eb8b409e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:23.039918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 329/643] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:01:22 2022] PUT /identity/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/8d83b456cec84bc5ab02a190099c0baf/roles/58b981aa32454837bd8eae9e804d811e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:01:23.040734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79fe8b-471a-4795-9d8c-1ec2eb8b409e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:23.092724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:23.127579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb75f1-a095-499a-95b0-1116ae4b7d16 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:23.165118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79fe8b-471a-4795-9d8c-1ec2eb8b409e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:23.165782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a67fb2-d75a-43c3-bb5c-3ad0df8f710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:23.166523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a67fb2-d75a-43c3-bb5c-3ad0df8f710d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:23.166870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a67fb2-d75a-43c3-bb5c-3ad0df8f710d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:23.167205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a67fb2-d75a-43c3-bb5c-3ad0df8f710d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:23.179358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a67fb2-d75a-43c3-bb5c-3ad0df8f710d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-82a67fb2-d75a-43c3-bb5c-3ad0df8f710d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:23.184923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:23.186013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:23.186878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 315/644] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:23.187586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a67fb2-d75a-43c3-bb5c-3ad0df8f710d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:23.215238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019ad88-2818-4a6e-ba5f-e953207280a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:23.215868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ad88-2818-4a6e-ba5f-e953207280a7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:23.216147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ad88-2818-4a6e-ba5f-e953207280a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:23.216422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ad88-2818-4a6e-ba5f-e953207280a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:23.217268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019ad88-2818-4a6e-ba5f-e953207280a7 None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=1c3d7cdad7f44f0f8df944ec7f69de26) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:23.217581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019ad88-2818-4a6e-ba5f-e953207280a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:23.219032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019ad88-2818-4a6e-ba5f-e953207280a7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:23.228924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 330/645] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:23 2022] GET /identity/v3/role_assignments?user.id=1c3d7cdad7f44f0f8df944ec7f69de26&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:23.228924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019ad88-2818-4a6e-ba5f-e953207280a7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:23.315247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:23.327772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a67fb2-d75a-43c3-bb5c-3ad0df8f710d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:23.360773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:23.363777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019ad88-2818-4a6e-ba5f-e953207280a7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:23.368372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353d75d-befc-44d9-bde8-b8fb6b063052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:23.368372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d75d-befc-44d9-bde8-b8fb6b063052 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:23.368647 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d75d-befc-44d9-bde8-b8fb6b063052 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:23.368839 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353d75d-befc-44d9-bde8-b8fb6b063052 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:23.381878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353d75d-befc-44d9-bde8-b8fb6b063052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9353d75d-befc-44d9-bde8-b8fb6b063052 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:23.387895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:23.389163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:23.390342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:23.390342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:23.390342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:23.390342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:23.390342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:23.390342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:23.390342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:23.390342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:23.390342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:23.390342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:23.390342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:23.390342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:23.392025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 316/646] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:23.393015 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353d75d-befc-44d9-bde8-b8fb6b063052 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:23.411642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad287d-a886-43fa-8f2f-43da5ac05e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:23.412597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad287d-a886-43fa-8f2f-43da5ac05e03 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:23.413500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad287d-a886-43fa-8f2f-43da5ac05e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:23.413776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad287d-a886-43fa-8f2f-43da5ac05e03 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:23.421896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad287d-a886-43fa-8f2f-43da5ac05e03 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:23.423440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad287d-a886-43fa-8f2f-43da5ac05e03 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-6cad287d-a886-43fa-8f2f-43da5ac05e03 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:23.437095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:23.438301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:23.439532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:23.439532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:23.439532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:23.439532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:23.439532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:23.439532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:23.439532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:23.439532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:23.439532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:01:23.439532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:23.439532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 331/647] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 07:01:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:23.439532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad287d-a886-43fa-8f2f-43da5ac05e03 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:23.522394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353d75d-befc-44d9-bde8-b8fb6b063052 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:23.563381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3104a-4d1d-4ea0-b39f-8cda2f26c56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:23.564101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3104a-4d1d-4ea0-b39f-8cda2f26c56d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:23.564345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3104a-4d1d-4ea0-b39f-8cda2f26c56d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:23.564655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3104a-4d1d-4ea0-b39f-8cda2f26c56d None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:23.565433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3104a-4d1d-4ea0-b39f-8cda2f26c56d None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:23.565762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3104a-4d1d-4ea0-b39f-8cda2f26c56d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:23.567082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3104a-4d1d-4ea0-b39f-8cda2f26c56d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:23.575704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad287d-a886-43fa-8f2f-43da5ac05e03 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:23.585102 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 317/648] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:23.586254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3104a-4d1d-4ea0-b39f-8cda2f26c56d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:23.597197 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:23.623013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e10f61-1c87-4da5-8467-608f766d6762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:23.623564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e10f61-1c87-4da5-8467-608f766d6762 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:23.623842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e10f61-1c87-4da5-8467-608f766d6762 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:23.624114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e10f61-1c87-4da5-8467-608f766d6762 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:23.624847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e10f61-1c87-4da5-8467-608f766d6762 None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:23.625179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e10f61-1c87-4da5-8467-608f766d6762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:23.627150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e10f61-1c87-4da5-8467-608f766d6762 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:23.640057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 332/649] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:23.641244 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e10f61-1c87-4da5-8467-608f766d6762 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:23.661754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:23.709043 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3104a-4d1d-4ea0-b39f-8cda2f26c56d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:23.744605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e32eb-db21-47cb-bb21-bf4e55929f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:23.745293 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e32eb-db21-47cb-bb21-bf4e55929f5d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:23.745578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e32eb-db21-47cb-bb21-bf4e55929f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:23.745915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e32eb-db21-47cb-bb21-bf4e55929f5d None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:23.746785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e32eb-db21-47cb-bb21-bf4e55929f5d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:23.747095 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e32eb-db21-47cb-bb21-bf4e55929f5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:23.748597 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e32eb-db21-47cb-bb21-bf4e55929f5d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:23.771320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 318/650] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 07:01:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:23.772233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e32eb-db21-47cb-bb21-bf4e55929f5d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:23.777223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e10f61-1c87-4da5-8467-608f766d6762 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:23.818689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4686e1-9fa0-44a3-9806-4cd2449e67b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:23.819757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4686e1-9fa0-44a3-9806-4cd2449e67b7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:23.820394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4686e1-9fa0-44a3-9806-4cd2449e67b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:23.820876 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4686e1-9fa0-44a3-9806-4cd2449e67b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:23.891528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e32eb-db21-47cb-bb21-bf4e55929f5d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:23.929292 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:23.933644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b1993-f2f5-4636-acb8-4bae56d66822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:23.934691 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b1993-f2f5-4636-acb8-4bae56d66822 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:23.935187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b1993-f2f5-4636-acb8-4bae56d66822 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:23.935666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b1993-f2f5-4636-acb8-4bae56d66822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:23.948013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b1993-f2f5-4636-acb8-4bae56d66822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:23.949888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b1993-f2f5-4636-acb8-4bae56d66822 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-028b1993-f2f5-4636-acb8-4bae56d66822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:23.966430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:23.967484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:23.968440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:23.968440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:23.968440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:23.968440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:23.971465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 319/651] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:23.971805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4686e1-9fa0-44a3-9806-4cd2449e67b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:23.972706 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b1993-f2f5-4636-acb8-4bae56d66822 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:23.973696 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4686e1-9fa0-44a3-9806-4cd2449e67b7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-6e4686e1-9fa0-44a3-9806-4cd2449e67b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:23.990110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:23.991264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:23.992386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:23.992386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:23.992386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:23.992386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:23.999063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 333/652] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:23.999063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4686e1-9fa0-44a3-9806-4cd2449e67b7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:24.040379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:24.112732 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b1993-f2f5-4636-acb8-4bae56d66822 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:24.127929 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4686e1-9fa0-44a3-9806-4cd2449e67b7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:24.149954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7616d-598d-478a-aca4-0de63bda03b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:24.150541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7616d-598d-478a-aca4-0de63bda03b8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:24.150786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7616d-598d-478a-aca4-0de63bda03b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:24.151054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7616d-598d-478a-aca4-0de63bda03b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:24.176771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeed365-5320-4762-9859-d51db2b0863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:24.178308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeed365-5320-4762-9859-d51db2b0863e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:24.178745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeed365-5320-4762-9859-d51db2b0863e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:24.179424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeed365-5320-4762-9859-d51db2b0863e None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:24.180376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeed365-5320-4762-9859-d51db2b0863e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:24.181116 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeed365-5320-4762-9859-d51db2b0863e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:24.183634 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeed365-5320-4762-9859-d51db2b0863e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:24.185857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:24.206581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 334/653] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:24.207664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeed365-5320-4762-9859-d51db2b0863e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:24.241279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7616d-598d-478a-aca4-0de63bda03b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:24.243019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7616d-598d-478a-aca4-0de63bda03b8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:24.318456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:24.333902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeed365-5320-4762-9859-d51db2b0863e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:24.370406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 320/654] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:24.371572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7616d-598d-478a-aca4-0de63bda03b8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:24.380247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30be8e3-d19b-4d4c-8c7f-35dbc23378d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:24.381776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30be8e3-d19b-4d4c-8c7f-35dbc23378d5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:24.382224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30be8e3-d19b-4d4c-8c7f-35dbc23378d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:24.382652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30be8e3-d19b-4d4c-8c7f-35dbc23378d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:24.383966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30be8e3-d19b-4d4c-8c7f-35dbc23378d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:24.384435 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30be8e3-d19b-4d4c-8c7f-35dbc23378d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:24.386699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30be8e3-d19b-4d4c-8c7f-35dbc23378d5 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:24.404768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 335/655] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:24.405647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30be8e3-d19b-4d4c-8c7f-35dbc23378d5 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:24.456738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:24.512722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7616d-598d-478a-aca4-0de63bda03b8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:24.513054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30be8e3-d19b-4d4c-8c7f-35dbc23378d5 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:24.550732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173de055-7293-45d2-8e90-7933c66dea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:24.551386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173de055-7293-45d2-8e90-7933c66dea38 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:24.551671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173de055-7293-45d2-8e90-7933c66dea38 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:24.552013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173de055-7293-45d2-8e90-7933c66dea38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:24.560478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560a48f-a40e-413a-9cd1-6c0ff4267d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:24.561570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a48f-a40e-413a-9cd1-6c0ff4267d14 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:24.561850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a48f-a40e-413a-9cd1-6c0ff4267d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:24.562128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a48f-a40e-413a-9cd1-6c0ff4267d14 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:24.565918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173de055-7293-45d2-8e90-7933c66dea38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:24.568145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173de055-7293-45d2-8e90-7933c66dea38 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:24.571326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560a48f-a40e-413a-9cd1-6c0ff4267d14 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:24.572830 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560a48f-a40e-413a-9cd1-6c0ff4267d14 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9560a48f-a40e-413a-9cd1-6c0ff4267d14 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:24.585408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:24.586396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:24.587344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:24.587344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:24.587344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:24.587344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:24.587344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:24.587344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:24.587344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:24.587344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:24.587344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 07:01:24.587344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:24.587344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 321/656] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:24.587957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560a48f-a40e-413a-9cd1-6c0ff4267d14 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-173de055-7293-45d2-8e90-7933c66dea38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:24.589316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:24.590694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:24.591798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:24.591798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:24.591798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:24.591798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:24.594764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 336/657] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:24.595809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173de055-7293-45d2-8e90-7933c66dea38 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:24.599004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:24.696554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560a48f-a40e-413a-9cd1-6c0ff4267d14 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:24.720926 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:24.730109 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173de055-7293-45d2-8e90-7933c66dea38 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:24.744887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46073dce-2386-42af-b380-c164336a10ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:24.745812 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073dce-2386-42af-b380-c164336a10ff None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:24.746094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073dce-2386-42af-b380-c164336a10ff None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:24.746392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073dce-2386-42af-b380-c164336a10ff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:24.757405 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46073dce-2386-42af-b380-c164336a10ff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:24.759224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46073dce-2386-42af-b380-c164336a10ff None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:24.767541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3732ad6-62d8-4a46-a80f-15feae991120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:24.768283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3732ad6-62d8-4a46-a80f-15feae991120 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:24.768658 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3732ad6-62d8-4a46-a80f-15feae991120 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:24.769072 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3732ad6-62d8-4a46-a80f-15feae991120 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:24.769964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3732ad6-62d8-4a46-a80f-15feae991120 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:24.770368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3732ad6-62d8-4a46-a80f-15feae991120 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:24.771884 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3732ad6-62d8-4a46-a80f-15feae991120 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-46073dce-2386-42af-b380-c164336a10ff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:24.772545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:24.773481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:24.774409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:24.774409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:24.774409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:24.774409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:24.774409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:24.774409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:24.774409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:24.774409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:24.774409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 07:01:24.774409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:24.776982 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 322/658] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:24.777882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46073dce-2386-42af-b380-c164336a10ff None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:24.796675 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 337/659] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Aug 5 07:01:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:24.797633 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3732ad6-62d8-4a46-a80f-15feae991120 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:24.862270 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:24.906127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3732ad6-62d8-4a46-a80f-15feae991120 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:24.919923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46073dce-2386-42af-b380-c164336a10ff None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:24.943027 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb301202-4968-44f4-9541-72484461c564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:24.943801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb301202-4968-44f4-9541-72484461c564 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:24.944175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb301202-4968-44f4-9541-72484461c564 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:24.944560 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb301202-4968-44f4-9541-72484461c564 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:24.945494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb301202-4968-44f4-9541-72484461c564 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:24.945899 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb301202-4968-44f4-9541-72484461c564 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:24.947598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb301202-4968-44f4-9541-72484461c564 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:24.962149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6395d-f770-4455-bc0a-07e1258a87c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:24.962790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6395d-f770-4455-bc0a-07e1258a87c9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:24.963597 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6395d-f770-4455-bc0a-07e1258a87c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:24.963875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6395d-f770-4455-bc0a-07e1258a87c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:24.964861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6395d-f770-4455-bc0a-07e1258a87c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:24.965320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6395d-f770-4455-bc0a-07e1258a87c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:24.966721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6395d-f770-4455-bc0a-07e1258a87c9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:24.967311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 338/660] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Aug 5 07:01:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:24.968299 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb301202-4968-44f4-9541-72484461c564 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:24.987636 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 323/661] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:24.988694 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6395d-f770-4455-bc0a-07e1258a87c9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:25.052242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:25.082236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb301202-4968-44f4-9541-72484461c564 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:25.101454 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:25.121500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e514fdf-6a2d-4055-919e-f48a3d5fe8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:25.122142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e514fdf-6a2d-4055-919e-f48a3d5fe8ec None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:25.122424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e514fdf-6a2d-4055-919e-f48a3d5fe8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:25.122693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e514fdf-6a2d-4055-919e-f48a3d5fe8ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:25.128755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6395d-f770-4455-bc0a-07e1258a87c9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:25.167685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb8dda-6239-4462-8442-a80613db8d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:25.168201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb8dda-6239-4462-8442-a80613db8d8f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:25.168516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb8dda-6239-4462-8442-a80613db8d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:25.168800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb8dda-6239-4462-8442-a80613db8d8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:25.195048 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e514fdf-6a2d-4055-919e-f48a3d5fe8ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:25.196833 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e514fdf-6a2d-4055-919e-f48a3d5fe8ec None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:25.244556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb8dda-6239-4462-8442-a80613db8d8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:25.246068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb8dda-6239-4462-8442-a80613db8d8f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:25.299980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:25.311988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 339/662] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:25.312922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e514fdf-6a2d-4055-919e-f48a3d5fe8ec None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:25.333773 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:25.361153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 324/663] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:25.361153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2368e-d8fd-49cf-b233-03334a461c06 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:25.361153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2368e-d8fd-49cf-b233-03334a461c06 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:25.361153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2368e-d8fd-49cf-b233-03334a461c06 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:25.361153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 325/664] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:25.361153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2368e-d8fd-49cf-b233-03334a461c06 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:25.427235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e514fdf-6a2d-4055-919e-f48a3d5fe8ec None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:25.460911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ea3ce-5d09-4dc8-8cf6-18333d5c2bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:25.461571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ea3ce-5d09-4dc8-8cf6-18333d5c2bca None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:25.461838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ea3ce-5d09-4dc8-8cf6-18333d5c2bca None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:25.462107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ea3ce-5d09-4dc8-8cf6-18333d5c2bca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:25.463512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2368e-d8fd-49cf-b233-03334a461c06 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:25.468659 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ea3ce-5d09-4dc8-8cf6-18333d5c2bca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:25.470155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ea3ce-5d09-4dc8-8cf6-18333d5c2bca None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-164ea3ce-5d09-4dc8-8cf6-18333d5c2bca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:25.481134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:25.482062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:25.482945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:25.482945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:25.482945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:25.482945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:25.482945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:25.482945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:25.482945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:25.482945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:25.482945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 340/665] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:25.483488 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ea3ce-5d09-4dc8-8cf6-18333d5c2bca None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:25.502084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6f5cc-f9e2-4301-8b81-95024751f85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:25.502661 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6f5cc-f9e2-4301-8b81-95024751f85c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:25.502943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6f5cc-f9e2-4301-8b81-95024751f85c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:25.503222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6f5cc-f9e2-4301-8b81-95024751f85c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:25.513491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6f5cc-f9e2-4301-8b81-95024751f85c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:25.514952 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6f5cc-f9e2-4301-8b81-95024751f85c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:25.517609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-88f6f5cc-f9e2-4301-8b81-95024751f85c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:25.530457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:25.531392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:25.537193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:25.537193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:25.537193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:25.537193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:25.537193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 326/666] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:25.537193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7ebd2-bffa-4082-b662-067ed7edc82e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:25.537193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7ebd2-bffa-4082-b662-067ed7edc82e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:25.537193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7ebd2-bffa-4082-b662-067ed7edc82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:25.551614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-97d7ebd2-bffa-4082-b662-067ed7edc82e None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:25.552803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-97d7ebd2-bffa-4082-b662-067ed7edc82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:25.566333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:25.588043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ea3ce-5d09-4dc8-8cf6-18333d5c2bca None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:25.619480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 327/667] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:25.620488 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4960308-27a3-4a85-9830-369327683e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:25.621068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca8cd6-c57c-4198-b5d3-6e5b1bb8efa2 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:25.621068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca8cd6-c57c-4198-b5d3-6e5b1bb8efa2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:25.621247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4960308-27a3-4a85-9830-369327683e76 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:25.621317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca8cd6-c57c-4198-b5d3-6e5b1bb8efa2 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:25.621501 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4960308-27a3-4a85-9830-369327683e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:25.621704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4960308-27a3-4a85-9830-369327683e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:25.626651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 328/668] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:25.626651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca8cd6-c57c-4198-b5d3-6e5b1bb8efa2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:25.636562 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4960308-27a3-4a85-9830-369327683e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:25.638145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4960308-27a3-4a85-9830-369327683e76 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-b4960308-27a3-4a85-9830-369327683e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:25.653254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:25.654177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:25.655065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:25.655065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:25.655065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:25.655065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:25.655065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 341/669] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:25.655381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4960308-27a3-4a85-9830-369327683e76 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:25.738237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca8cd6-c57c-4198-b5d3-6e5b1bb8efa2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:25.755738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4960308-27a3-4a85-9830-369327683e76 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:25.764400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:25.773494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ebb85-2f74-469f-8479-7c13d349cc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:25.774110 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ebb85-2f74-469f-8479-7c13d349cc3f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:25.774388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ebb85-2f74-469f-8479-7c13d349cc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:25.774657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ebb85-2f74-469f-8479-7c13d349cc3f None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:25.775411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ebb85-2f74-469f-8479-7c13d349cc3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:25.776010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ebb85-2f74-469f-8479-7c13d349cc3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:25.777195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ebb85-2f74-469f-8479-7c13d349cc3f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:25.784401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:25.789422 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 329/670] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:25.790660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0ffaa-71e0-4a32-91d7-c9020c5bb9af None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:25.790948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0ffaa-71e0-4a32-91d7-c9020c5bb9af None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:25.791221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0ffaa-71e0-4a32-91d7-c9020c5bb9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:25.796084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a562e6f-01b4-47f2-85dd-e3cc3edd463c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:25.796740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a562e6f-01b4-47f2-85dd-e3cc3edd463c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:25.797044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a562e6f-01b4-47f2-85dd-e3cc3edd463c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:25.797517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a562e6f-01b4-47f2-85dd-e3cc3edd463c None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:25.798217 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a562e6f-01b4-47f2-85dd-e3cc3edd463c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:25.798542 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a562e6f-01b4-47f2-85dd-e3cc3edd463c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:25.799879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a562e6f-01b4-47f2-85dd-e3cc3edd463c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:25.809030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-85e0ffaa-71e0-4a32-91d7-c9020c5bb9af None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:25.810233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-85e0ffaa-71e0-4a32-91d7-c9020c5bb9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:25.812796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 342/671] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:25.813553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a562e6f-01b4-47f2-85dd-e3cc3edd463c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:25.884823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 330/672] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:25.885543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0ffaa-71e0-4a32-91d7-c9020c5bb9af None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:25.914184 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a562e6f-01b4-47f2-85dd-e3cc3edd463c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:25.947053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b572e3-1fb2-482d-a26d-e468a9a16630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:25.947710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b572e3-1fb2-482d-a26d-e468a9a16630 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:25.947990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b572e3-1fb2-482d-a26d-e468a9a16630 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:25.948264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b572e3-1fb2-482d-a26d-e468a9a16630 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:25.958340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b572e3-1fb2-482d-a26d-e468a9a16630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-63b572e3-1fb2-482d-a26d-e468a9a16630 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:25.963245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:25.964254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:25.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 343/673] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:25.966324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b572e3-1fb2-482d-a26d-e468a9a16630 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:25.986770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0ffaa-71e0-4a32-91d7-c9020c5bb9af None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:26.003817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:26.016808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:26.021145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748413a-1520-4213-ae20-6d81d0c8dcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:26.021770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748413a-1520-4213-ae20-6d81d0c8dcbf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:26.022046 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748413a-1520-4213-ae20-6d81d0c8dcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:26.022316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748413a-1520-4213-ae20-6d81d0c8dcbf None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:26.023007 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748413a-1520-4213-ae20-6d81d0c8dcbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:26.023305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748413a-1520-4213-ae20-6d81d0c8dcbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:26.024681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748413a-1520-4213-ae20-6d81d0c8dcbf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:26.035832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 331/674] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:26.036627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748413a-1520-4213-ae20-6d81d0c8dcbf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:26.067315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b572e3-1fb2-482d-a26d-e468a9a16630 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:26.100559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaa062-7753-45e7-966a-e855a75755f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:26.101202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaa062-7753-45e7-966a-e855a75755f9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:26.101479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaa062-7753-45e7-966a-e855a75755f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:26.101751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaa062-7753-45e7-966a-e855a75755f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:26.102538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaa062-7753-45e7-966a-e855a75755f9 None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=555de6e5c8c44f40a6433b3d2ffc52f3) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:26.102846 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaa062-7753-45e7-966a-e855a75755f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:26.104281 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaa062-7753-45e7-966a-e855a75755f9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:26.110294 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 344/675] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:25 2022] GET /identity/v3/role_assignments?user.id=555de6e5c8c44f40a6433b3d2ffc52f3&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:26.111120 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaa062-7753-45e7-966a-e855a75755f9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:26.140421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748413a-1520-4213-ae20-6d81d0c8dcbf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:26.180814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19572c-a275-4c63-a4ca-223ccc9f20ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:26.181620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19572c-a275-4c63-a4ca-223ccc9f20ec None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:26.181900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19572c-a275-4c63-a4ca-223ccc9f20ec None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:26.182332 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19572c-a275-4c63-a4ca-223ccc9f20ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:26.191066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19572c-a275-4c63-a4ca-223ccc9f20ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:26.192559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19572c-a275-4c63-a4ca-223ccc9f20ec None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-3f19572c-a275-4c63-a4ca-223ccc9f20ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:26.205309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:26.206463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:26.207707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:26.207707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:26.207707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:26.207707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:26.207707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:26.207707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:26.207707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:26.207707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:26.207707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 332/676] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:26.207707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19572c-a275-4c63-a4ca-223ccc9f20ec None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:26.245642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaa062-7753-45e7-966a-e855a75755f9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:26.250234 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:26.267260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:26.292987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54fc86-71b5-44f6-babd-dbc14053c25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:26.293644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54fc86-71b5-44f6-babd-dbc14053c25d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:26.293925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54fc86-71b5-44f6-babd-dbc14053c25d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:26.294193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54fc86-71b5-44f6-babd-dbc14053c25d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:26.308699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54fc86-71b5-44f6-babd-dbc14053c25d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:26.310219 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54fc86-71b5-44f6-babd-dbc14053c25d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:26.327821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19572c-a275-4c63-a4ca-223ccc9f20ec None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-bf54fc86-71b5-44f6-babd-dbc14053c25d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:26.327988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:26.328799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:26.329802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:26.329802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:26.329802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:26.329802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:26.329802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 345/677] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:26.330554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54fc86-71b5-44f6-babd-dbc14053c25d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:26.371493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fbaac-c49c-44fa-890b-ebe5d143dedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:26.372116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fbaac-c49c-44fa-890b-ebe5d143dedf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:26.372393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fbaac-c49c-44fa-890b-ebe5d143dedf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:26.372665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fbaac-c49c-44fa-890b-ebe5d143dedf None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:26.373419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fbaac-c49c-44fa-890b-ebe5d143dedf None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:26.373723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fbaac-c49c-44fa-890b-ebe5d143dedf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:26.375434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fbaac-c49c-44fa-890b-ebe5d143dedf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:26.388275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 333/678] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:26.388275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fbaac-c49c-44fa-890b-ebe5d143dedf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:26.449303 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54fc86-71b5-44f6-babd-dbc14053c25d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:26.484324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4d0db-d41e-45a1-ab6e-3edbe66d2bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:26.484997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4d0db-d41e-45a1-ab6e-3edbe66d2bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:26.485274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4d0db-d41e-45a1-ab6e-3edbe66d2bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:26.485632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4d0db-d41e-45a1-ab6e-3edbe66d2bb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:26.486484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:26.490709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fbaac-c49c-44fa-890b-ebe5d143dedf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:26.492854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4d0db-d41e-45a1-ab6e-3edbe66d2bb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:26.494403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4d0db-d41e-45a1-ab6e-3edbe66d2bb0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-c5a4d0db-d41e-45a1-ab6e-3edbe66d2bb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:26.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:26.506842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:26.507780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:26.507780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:26.507780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:26.507780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:26.507780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:26.507780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:26.507780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:26.507780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:26.507780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 346/679] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:26.507780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4d0db-d41e-45a1-ab6e-3edbe66d2bb0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:26.534334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7ff75-dbcd-475e-b2bf-d1e93b80763f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:26.535373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7ff75-dbcd-475e-b2bf-d1e93b80763f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:26.535898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7ff75-dbcd-475e-b2bf-d1e93b80763f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:26.536346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7ff75-dbcd-475e-b2bf-d1e93b80763f None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:26.537287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7ff75-dbcd-475e-b2bf-d1e93b80763f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:26.538229 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:26.538595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7ff75-dbcd-475e-b2bf-d1e93b80763f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:26.540547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7ff75-dbcd-475e-b2bf-d1e93b80763f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:26.553696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 334/680] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:26.554318 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7ff75-dbcd-475e-b2bf-d1e93b80763f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:26.618914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4d0db-d41e-45a1-ab6e-3edbe66d2bb0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:26.652588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcc708-6196-40c8-a88d-857ebd7c7f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:26.653304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcc708-6196-40c8-a88d-857ebd7c7f40 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:26.653532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcc708-6196-40c8-a88d-857ebd7c7f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:26.653758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcc708-6196-40c8-a88d-857ebd7c7f40 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:26.654442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcc708-6196-40c8-a88d-857ebd7c7f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:26.654744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcc708-6196-40c8-a88d-857ebd7c7f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:26.656108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcc708-6196-40c8-a88d-857ebd7c7f40 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:26.666240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7ff75-dbcd-475e-b2bf-d1e93b80763f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:26.668941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 347/681] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:26.669314 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcc708-6196-40c8-a88d-857ebd7c7f40 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:26.710000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562af9c-d1e2-485f-abd8-868b61669cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:26.710642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562af9c-d1e2-485f-abd8-868b61669cda None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:26.710917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562af9c-d1e2-485f-abd8-868b61669cda None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:26.711184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562af9c-d1e2-485f-abd8-868b61669cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:26.722318 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562af9c-d1e2-485f-abd8-868b61669cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:26.723758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562af9c-d1e2-485f-abd8-868b61669cda None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4562af9c-d1e2-485f-abd8-868b61669cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:26.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:26.739946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:26.741068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:26.741068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:26.741068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:26.741068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:26.744713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 335/682] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:26.745498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562af9c-d1e2-485f-abd8-868b61669cda None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:26.758662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:26.774004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:26.791329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcc708-6196-40c8-a88d-857ebd7c7f40 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:26.824640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb674873-eefe-4d8c-a384-a4155beebdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:26.825276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb674873-eefe-4d8c-a384-a4155beebdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:26.825553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb674873-eefe-4d8c-a384-a4155beebdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:26.825822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb674873-eefe-4d8c-a384-a4155beebdd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:26.826558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb674873-eefe-4d8c-a384-a4155beebdd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:26.826860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb674873-eefe-4d8c-a384-a4155beebdd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:26.828289 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb674873-eefe-4d8c-a384-a4155beebdd9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:26.846408 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 348/683] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:26.846408 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb674873-eefe-4d8c-a384-a4155beebdd9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:26.857652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562af9c-d1e2-485f-abd8-868b61669cda None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:26.894450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ee33c-5f90-4c80-9132-23e04c36a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:26.895607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ee33c-5f90-4c80-9132-23e04c36a67c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:26.896042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ee33c-5f90-4c80-9132-23e04c36a67c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:26.896326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ee33c-5f90-4c80-9132-23e04c36a67c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:26.897156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ee33c-5f90-4c80-9132-23e04c36a67c None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=d44bcb27daeb4116835bbfb5dcb1dc33) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:26.897467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ee33c-5f90-4c80-9132-23e04c36a67c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:26.898970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ee33c-5f90-4c80-9132-23e04c36a67c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:26.905109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 336/684] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:26 2022] GET /identity/v3/role_assignments?user.id=d44bcb27daeb4116835bbfb5dcb1dc33&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:26.905923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ee33c-5f90-4c80-9132-23e04c36a67c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:26.976472 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb674873-eefe-4d8c-a384-a4155beebdd9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:27.015506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ed313-20b4-452f-acff-8a0815dc2a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:27.016153 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ed313-20b4-452f-acff-8a0815dc2a16 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:27.016433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ed313-20b4-452f-acff-8a0815dc2a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:27.016837 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ed313-20b4-452f-acff-8a0815dc2a16 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:27.017573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ed313-20b4-452f-acff-8a0815dc2a16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:27.019062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ed313-20b4-452f-acff-8a0815dc2a16 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:27.019688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:27.048143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 349/685] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:01:26 2022] POST /identity/v3/users => generated 254 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:01:27.049377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ed313-20b4-452f-acff-8a0815dc2a16 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:27.052668 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:27.070085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ee33c-5f90-4c80-9132-23e04c36a67c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:27.119715 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040338-3c34-44b5-a3d9-dcd69c224f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:27.120385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040338-3c34-44b5-a3d9-dcd69c224f61 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:27.120662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040338-3c34-44b5-a3d9-dcd69c224f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:27.120987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9040338-3c34-44b5-a3d9-dcd69c224f61 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:27.122059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040338-3c34-44b5-a3d9-dcd69c224f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:27.122059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040338-3c34-44b5-a3d9-dcd69c224f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:27.124207 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9040338-3c34-44b5-a3d9-dcd69c224f61 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:27.143703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 337/686] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:27.145227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040338-3c34-44b5-a3d9-dcd69c224f61 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:27.214376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ed313-20b4-452f-acff-8a0815dc2a16 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:27.264008 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f782fe-3673-41f8-bcda-bee1198ecc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:27.264806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f782fe-3673-41f8-bcda-bee1198ecc5b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:27.264973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f782fe-3673-41f8-bcda-bee1198ecc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:27.265231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f782fe-3673-41f8-bcda-bee1198ecc5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:27.266035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f782fe-3673-41f8-bcda-bee1198ecc5b None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=9c4ce8a3f876467f93e7c9efd9e33390) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:27.266342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f782fe-3673-41f8-bcda-bee1198ecc5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:27.267862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f782fe-3673-41f8-bcda-bee1198ecc5b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:27.275650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 350/687] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:27 2022] GET /identity/v3/role_assignments?user.id=9c4ce8a3f876467f93e7c9efd9e33390&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:27.288277 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9040338-3c34-44b5-a3d9-dcd69c224f61 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:27.334653 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741f55c-f84b-4f72-af7a-d1aeb9850ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:27.335250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741f55c-f84b-4f72-af7a-d1aeb9850ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:27.335530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741f55c-f84b-4f72-af7a-d1aeb9850ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:27.335805 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741f55c-f84b-4f72-af7a-d1aeb9850ea5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:27.338187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:27.347051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741f55c-f84b-4f72-af7a-d1aeb9850ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:27.348550 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741f55c-f84b-4f72-af7a-d1aeb9850ea5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-1741f55c-f84b-4f72-af7a-d1aeb9850ea5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:27.362282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:27.363290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:27.364500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:27.364500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:27.364500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:27.364500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:27.364500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:27.364500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:27.364500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:27.364500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:27.364500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 07:01:27.364500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:27.364500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 338/688] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:27.372684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f782fe-3673-41f8-bcda-bee1198ecc5b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:27.457102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:27.498117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f782fe-3673-41f8-bcda-bee1198ecc5b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:27.535697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070509a-2a97-4cc7-89be-72eb283e7683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:27.536334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070509a-2a97-4cc7-89be-72eb283e7683 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:27.536602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070509a-2a97-4cc7-89be-72eb283e7683 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:27.536874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070509a-2a97-4cc7-89be-72eb283e7683 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:27.537701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070509a-2a97-4cc7-89be-72eb283e7683 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:27.538343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070509a-2a97-4cc7-89be-72eb283e7683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:27.539777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070509a-2a97-4cc7-89be-72eb283e7683 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:27.558635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 351/689] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Aug 5 07:01:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:27.563887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741f55c-f84b-4f72-af7a-d1aeb9850ea5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:27.690557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741f55c-f84b-4f72-af7a-d1aeb9850ea5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:27.726775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b374d31-b014-4239-afe6-867fbaa675e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:27.727413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374d31-b014-4239-afe6-867fbaa675e3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:27.727693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374d31-b014-4239-afe6-867fbaa675e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:27.727969 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374d31-b014-4239-afe6-867fbaa675e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:27.793446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:27.801348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b374d31-b014-4239-afe6-867fbaa675e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:27.802831 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b374d31-b014-4239-afe6-867fbaa675e3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:27.906272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 339/690] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:27.911616 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070509a-2a97-4cc7-89be-72eb283e7683 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:28.045603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070509a-2a97-4cc7-89be-72eb283e7683 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:28.081516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:28.093976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93762ba-61d1-4915-b8e0-f60dec048f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:28.094632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93762ba-61d1-4915-b8e0-f60dec048f10 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:28.094982 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93762ba-61d1-4915-b8e0-f60dec048f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:28.095252 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93762ba-61d1-4915-b8e0-f60dec048f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:28.112400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93762ba-61d1-4915-b8e0-f60dec048f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:28.113888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93762ba-61d1-4915-b8e0-f60dec048f10 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-f93762ba-61d1-4915-b8e0-f60dec048f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:28.131594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:28.132516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:28.133483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:28.133483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:28.133483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:28.133483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:28.133483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 352/691] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:28.138476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b374d31-b014-4239-afe6-867fbaa675e3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:28.235949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:28.250850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b374d31-b014-4239-afe6-867fbaa675e3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:28.294858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45980802-b852-4d10-b6d3-fa902b547fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:28.295499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45980802-b852-4d10-b6d3-fa902b547fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:28.295836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45980802-b852-4d10-b6d3-fa902b547fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:28.296050 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45980802-b852-4d10-b6d3-fa902b547fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:28.296754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45980802-b852-4d10-b6d3-fa902b547fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:28.297091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45980802-b852-4d10-b6d3-fa902b547fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:28.298524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45980802-b852-4d10-b6d3-fa902b547fd9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:28.310902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 340/692] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:28.318008 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93762ba-61d1-4915-b8e0-f60dec048f10 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:28.441156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93762ba-61d1-4915-b8e0-f60dec048f10 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:28.470896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ee0a3-6a35-4450-a424-785d754fc97e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:28.471212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ee0a3-6a35-4450-a424-785d754fc97e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:28.471441 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ee0a3-6a35-4450-a424-785d754fc97e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:28.472924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 341/693] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:01:28.478362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44af239-93ee-4edf-ab8d-1943af7010d1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:28.478668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44af239-93ee-4edf-ab8d-1943af7010d1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:28.478945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44af239-93ee-4edf-ab8d-1943af7010d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:28.496832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61c319-4135-4c66-8b03-cfb13fb65f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:28.497494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61c319-4135-4c66-8b03-cfb13fb65f36 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:28.497775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61c319-4135-4c66-8b03-cfb13fb65f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:28.498055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61c319-4135-4c66-8b03-cfb13fb65f36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:28.504166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d44af239-93ee-4edf-ab8d-1943af7010d1 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:28.505480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d44af239-93ee-4edf-ab8d-1943af7010d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:28.514719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61c319-4135-4c66-8b03-cfb13fb65f36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:28.516205 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61c319-4135-4c66-8b03-cfb13fb65f36 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0a61c319-4135-4c66-8b03-cfb13fb65f36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:28.536742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:28.537686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:28.539396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:28.539396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:28.539396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:28.539396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:28.539396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:28.539396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:28.539396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:28.539396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:28.539396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 353/694] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:28.547034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61c319-4135-4c66-8b03-cfb13fb65f36 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:28.596143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:28.659199 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61c319-4135-4c66-8b03-cfb13fb65f36 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:28.691521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 342/695] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:28.697605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef716cd7-dcb0-42c0-821c-64f93e39f039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:28.698233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef716cd7-dcb0-42c0-821c-64f93e39f039 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:28.698515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef716cd7-dcb0-42c0-821c-64f93e39f039 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:28.698785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef716cd7-dcb0-42c0-821c-64f93e39f039 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:28.699547 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef716cd7-dcb0-42c0-821c-64f93e39f039 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:28.699852 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef716cd7-dcb0-42c0-821c-64f93e39f039 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:28.701340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef716cd7-dcb0-42c0-821c-64f93e39f039 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:28.723538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 354/696] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:28.727701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44af239-93ee-4edf-ab8d-1943af7010d1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:28.730650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef716cd7-dcb0-42c0-821c-64f93e39f039 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:28.896256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:28.910986 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:28.923903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef716cd7-dcb0-42c0-821c-64f93e39f039 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:28.933379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44af239-93ee-4edf-ab8d-1943af7010d1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:28.986615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59d35-f52c-4854-921d-25171e448e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:28.988583 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59d35-f52c-4854-921d-25171e448e82 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:28.990447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59d35-f52c-4854-921d-25171e448e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:28.990937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59d35-f52c-4854-921d-25171e448e82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:28.991955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce59d35-f52c-4854-921d-25171e448e82 None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=8d83b456cec84bc5ab02a190099c0baf) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:28.993879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce59d35-f52c-4854-921d-25171e448e82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:28.995561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce59d35-f52c-4854-921d-25171e448e82 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:29.008222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721698a5-ac7a-4699-9232-712937e2bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:29.009310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721698a5-ac7a-4699-9232-712937e2bd8a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:29.009848 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721698a5-ac7a-4699-9232-712937e2bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:29.010334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721698a5-ac7a-4699-9232-712937e2bd8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:29.011589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 355/697] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:28 2022] GET /identity/v3/role_assignments?user.id=8d83b456cec84bc5ab02a190099c0baf&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:29.031072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721698a5-ac7a-4699-9232-712937e2bd8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-721698a5-ac7a-4699-9232-712937e2bd8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:29.036575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:29.037527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:29.038707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:29.038707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:29.038707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:29.038707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:29.038707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:29.038707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:29.038707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:29.038707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:29.038707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:29.038707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:29.038707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:29.038707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:29.045731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 343/698] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:29.051564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59d35-f52c-4854-921d-25171e448e82 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:29.171588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59d35-f52c-4854-921d-25171e448e82 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:29.216706 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca770d-b13e-4c83-aa0e-defb7131938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:29.217924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca770d-b13e-4c83-aa0e-defb7131938b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:29.218398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca770d-b13e-4c83-aa0e-defb7131938b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:29.218863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca770d-b13e-4c83-aa0e-defb7131938b None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:29.219866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca770d-b13e-4c83-aa0e-defb7131938b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:29.220383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca770d-b13e-4c83-aa0e-defb7131938b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:29.222034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca770d-b13e-4c83-aa0e-defb7131938b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:29.232212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 356/699] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:29.237684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721698a5-ac7a-4699-9232-712937e2bd8a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:29.377245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721698a5-ac7a-4699-9232-712937e2bd8a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:29.416513 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113904fc-dea3-4978-8d68-26e485550c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:29.417263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113904fc-dea3-4978-8d68-26e485550c57 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:29.417544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113904fc-dea3-4978-8d68-26e485550c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:29.417818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113904fc-dea3-4978-8d68-26e485550c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:29.429838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113904fc-dea3-4978-8d68-26e485550c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:29.431228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113904fc-dea3-4978-8d68-26e485550c57 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:29.437341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-113904fc-dea3-4978-8d68-26e485550c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:29.450648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:29.451619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:29.452491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:29.452491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:29.452491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:29.452491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:29.458230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 344/700] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:29.466021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca770d-b13e-4c83-aa0e-defb7131938b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:29.493640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:29.494614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c6570-1233-4911-bbee-643383693b3d None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:29.495303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c6570-1233-4911-bbee-643383693b3d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:29.495779 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c6570-1233-4911-bbee-643383693b3d None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:29.497871 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 345/701] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:01:29.505473 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759dabf-9c9f-4ed1-9fac-9fc7391f5436 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:29.506114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759dabf-9c9f-4ed1-9fac-9fc7391f5436 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:29.506684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759dabf-9c9f-4ed1-9fac-9fc7391f5436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:29.531803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9759dabf-9c9f-4ed1-9fac-9fc7391f5436 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:29.533698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9759dabf-9c9f-4ed1-9fac-9fc7391f5436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:29.574341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca770d-b13e-4c83-aa0e-defb7131938b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:29.623804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d7846-dc6a-4353-a459-1a86e01a917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:29.623804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d7846-dc6a-4353-a459-1a86e01a917d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:29.623804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d7846-dc6a-4353-a459-1a86e01a917d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:29.623804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d7846-dc6a-4353-a459-1a86e01a917d None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:29.624519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d7846-dc6a-4353-a459-1a86e01a917d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:29.625123 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d7846-dc6a-4353-a459-1a86e01a917d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:29.626581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d7846-dc6a-4353-a459-1a86e01a917d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:29.644940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 346/702] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 07:01:29.647439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 357/703] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:29.652578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759dabf-9c9f-4ed1-9fac-9fc7391f5436 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:29.666922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d7846-dc6a-4353-a459-1a86e01a917d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:29.772028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:29.781010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759dabf-9c9f-4ed1-9fac-9fc7391f5436 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:29.801916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d7846-dc6a-4353-a459-1a86e01a917d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:29.820594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:29.833779 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed6e5f-bd6e-45a6-88b3-fd106b7035be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:29.835442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed6e5f-bd6e-45a6-88b3-fd106b7035be None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:29.836186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed6e5f-bd6e-45a6-88b3-fd106b7035be None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:29.836704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed6e5f-bd6e-45a6-88b3-fd106b7035be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:29.840337 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360e961-c164-4247-89a1-f0552ca15566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:29.840572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e961-c164-4247-89a1-f0552ca15566 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:29.840825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e961-c164-4247-89a1-f0552ca15566 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:29.841182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e961-c164-4247-89a1-f0552ca15566 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:29.841814 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360e961-c164-4247-89a1-f0552ca15566 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:29.843194 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360e961-c164-4247-89a1-f0552ca15566 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:29.846611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed6e5f-bd6e-45a6-88b3-fd106b7035be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:29.849080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed6e5f-bd6e-45a6-88b3-fd106b7035be None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-7360e961-c164-4247-89a1-f0552ca15566 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:29.855880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:29.856883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 07:01:29.857757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:29.862322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 358/704] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Aug 5 07:01:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:29.863786 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aaebf-eb72-4edb-a800-114b8a5e4cd3 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:29.864072 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aaebf-eb72-4edb-a800-114b8a5e4cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:29.864372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aaebf-eb72-4edb-a800-114b8a5e4cd3 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:29.866321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 359/705] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:29.867123 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785aaebf-eb72-4edb-a800-114b8a5e4cd3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-25ed6e5f-bd6e-45a6-88b3-fd106b7035be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:29.868492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:29.869551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:29.870570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:29.870570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:29.870570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:29.870570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:29.870570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:29.870570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:29.870570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:29.870570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:29.870570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:01:29.870570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:29.874176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 347/706] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 07:01:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:29.875600 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea56a1-bf3a-411e-92ee-f43fd2bda492 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:29.876095 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea56a1-bf3a-411e-92ee-f43fd2bda492 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:29.876506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea56a1-bf3a-411e-92ee-f43fd2bda492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:29.900849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c8ea56a1-bf3a-411e-92ee-f43fd2bda492 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:29.902831 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c8ea56a1-bf3a-411e-92ee-f43fd2bda492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:29.988927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 348/707] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:29.988927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea56a1-bf3a-411e-92ee-f43fd2bda492 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:29.990006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785aaebf-eb72-4edb-a800-114b8a5e4cd3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:30.034579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596408f-200d-433e-a1a0-8b3d8f1a75d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:30.035139 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596408f-200d-433e-a1a0-8b3d8f1a75d8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:30.035414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596408f-200d-433e-a1a0-8b3d8f1a75d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:30.035684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596408f-200d-433e-a1a0-8b3d8f1a75d8 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:30.036388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596408f-200d-433e-a1a0-8b3d8f1a75d8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:30.036688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596408f-200d-433e-a1a0-8b3d8f1a75d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:30.038457 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596408f-200d-433e-a1a0-8b3d8f1a75d8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:30.043081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 360/708] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 5 07:01:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:30.044341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe19a-d770-48ea-9370-ff798db50799 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:30.044632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe19a-d770-48ea-9370-ff798db50799 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:30.044974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe19a-d770-48ea-9370-ff798db50799 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:30.046285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 361/709] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:30.046870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fe19a-d770-48ea-9370-ff798db50799 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:30.064100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:30.108237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea56a1-bf3a-411e-92ee-f43fd2bda492 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:30.127121 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:30.147474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f3041-4cd1-4211-abfa-0992ac10d089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:30.148069 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f3041-4cd1-4211-abfa-0992ac10d089 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:30.148398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f3041-4cd1-4211-abfa-0992ac10d089 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:30.148675 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f3041-4cd1-4211-abfa-0992ac10d089 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:30.149616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f3041-4cd1-4211-abfa-0992ac10d089 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:30.149851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f3041-4cd1-4211-abfa-0992ac10d089 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:30.151289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f3041-4cd1-4211-abfa-0992ac10d089 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:30.175271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 349/710] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 07:01:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:30.175271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f3041-4cd1-4211-abfa-0992ac10d089 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:30.179637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fe19a-d770-48ea-9370-ff798db50799 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:30.218174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ac5c6-24ce-448a-aca5-49c7d14d210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:30.218819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ac5c6-24ce-448a-aca5-49c7d14d210d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:30.219098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ac5c6-24ce-448a-aca5-49c7d14d210d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:30.219368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ac5c6-24ce-448a-aca5-49c7d14d210d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:30.230030 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ac5c6-24ce-448a-aca5-49c7d14d210d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-3e2ac5c6-24ce-448a-aca5-49c7d14d210d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:30.234983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:30.236001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:30.236862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 362/711] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:30.238288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c695a1-5e52-43e7-8d04-ef4077250df1 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:30.238288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c695a1-5e52-43e7-8d04-ef4077250df1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:30.238288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c695a1-5e52-43e7-8d04-ef4077250df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:30.256293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f2c695a1-5e52-43e7-8d04-ef4077250df1 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:30.260023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f2c695a1-5e52-43e7-8d04-ef4077250df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:30.298324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f3041-4cd1-4211-abfa-0992ac10d089 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:30.332337 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:30.336278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42725f69-fd27-4998-828e-f94669424307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:30.337212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 363/712] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:30.338099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c695a1-5e52-43e7-8d04-ef4077250df1 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:30.349002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42725f69-fd27-4998-828e-f94669424307 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:30.349366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42725f69-fd27-4998-828e-f94669424307 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:30.349652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42725f69-fd27-4998-828e-f94669424307 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:30.350390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42725f69-fd27-4998-828e-f94669424307 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:30.350702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42725f69-fd27-4998-828e-f94669424307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:30.352093 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42725f69-fd27-4998-828e-f94669424307 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:30.367601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 350/713] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 5 07:01:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:30.368627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42725f69-fd27-4998-828e-f94669424307 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:30.421309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:30.454758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c695a1-5e52-43e7-8d04-ef4077250df1 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:30.502294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42725f69-fd27-4998-828e-f94669424307 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:30.508074 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b74762-8f41-42b6-a0c1-7a75b5cd515b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:30.508947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b74762-8f41-42b6-a0c1-7a75b5cd515b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:30.509322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b74762-8f41-42b6-a0c1-7a75b5cd515b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:30.509686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b74762-8f41-42b6-a0c1-7a75b5cd515b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:30.547638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4a3e4-2a40-4eb0-b414-c8566c94aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:30.547638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4a3e4-2a40-4eb0-b414-c8566c94aa59 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:30.549955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4a3e4-2a40-4eb0-b414-c8566c94aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:30.549955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4a3e4-2a40-4eb0-b414-c8566c94aa59 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:30.549955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4a3e4-2a40-4eb0-b414-c8566c94aa59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:30.550195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4a3e4-2a40-4eb0-b414-c8566c94aa59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:30.552065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4a3e4-2a40-4eb0-b414-c8566c94aa59 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:30.563718 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 351/714] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:30.564575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4a3e4-2a40-4eb0-b414-c8566c94aa59 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:30.606612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:30.610910 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b74762-8f41-42b6-a0c1-7a75b5cd515b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:30.613325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b74762-8f41-42b6-a0c1-7a75b5cd515b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:30.685246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:30.688513 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4a3e4-2a40-4eb0-b414-c8566c94aa59 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:30.723458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 364/715] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:30.724399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b74762-8f41-42b6-a0c1-7a75b5cd515b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:30.724599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda60b2-08f6-42c1-9c36-9bba7e3fb4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:30.725265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda60b2-08f6-42c1-9c36-9bba7e3fb4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:30.725544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda60b2-08f6-42c1-9c36-9bba7e3fb4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:30.725816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda60b2-08f6-42c1-9c36-9bba7e3fb4f2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:30.726451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda60b2-08f6-42c1-9c36-9bba7e3fb4f2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:30.727823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda60b2-08f6-42c1-9c36-9bba7e3fb4f2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-fbda60b2-08f6-42c1-9c36-9bba7e3fb4f2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:30.739271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:30.740363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:30.741249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 352/716] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:30 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:30.742669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda60b2-08f6-42c1-9c36-9bba7e3fb4f2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:30.828316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:30.832414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b74762-8f41-42b6-a0c1-7a75b5cd515b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:30.844256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda60b2-08f6-42c1-9c36-9bba7e3fb4f2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:30.869622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4ca7b-76aa-4a3d-a3c5-2afe1086fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:30.870627 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4ca7b-76aa-4a3d-a3c5-2afe1086fdcd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:30.871059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4ca7b-76aa-4a3d-a3c5-2afe1086fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:30.871467 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4ca7b-76aa-4a3d-a3c5-2afe1086fdcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:30.879247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6650954-fb30-4207-a1dd-ed5a0de26087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:30.879906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6650954-fb30-4207-a1dd-ed5a0de26087 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:30.880185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6650954-fb30-4207-a1dd-ed5a0de26087 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:30.880458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6650954-fb30-4207-a1dd-ed5a0de26087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:30.884822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4ca7b-76aa-4a3d-a3c5-2afe1086fdcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:30.886641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4ca7b-76aa-4a3d-a3c5-2afe1086fdcd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:30.892657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6650954-fb30-4207-a1dd-ed5a0de26087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:30.894265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6650954-fb30-4207-a1dd-ed5a0de26087 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-38a4ca7b-76aa-4a3d-a3c5-2afe1086fdcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:30.902784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:30.903845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:30.904942 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:30.904942 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:30.904942 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:30.904942 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:30.906819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 365/717] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:30.907924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4ca7b-76aa-4a3d-a3c5-2afe1086fdcd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e6650954-fb30-4207-a1dd-ed5a0de26087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:30.909281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:30.910304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:30.911529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:30.911529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:30.911529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:30.911529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:30.911529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 353/718] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:30.916585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6650954-fb30-4207-a1dd-ed5a0de26087 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:30.936358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:31.022169 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4ca7b-76aa-4a3d-a3c5-2afe1086fdcd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:31.039811 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6650954-fb30-4207-a1dd-ed5a0de26087 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:31.069430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9933f-803c-4533-b14b-c88ea749aa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:31.070115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9933f-803c-4533-b14b-c88ea749aa25 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:31.070395 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9933f-803c-4533-b14b-c88ea749aa25 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:31.070727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9933f-803c-4533-b14b-c88ea749aa25 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:31.072022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9933f-803c-4533-b14b-c88ea749aa25 None admin] RBAC: Adding query filter params (name=network) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:31.072343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9933f-803c-4533-b14b-c88ea749aa25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:31.074049 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9933f-803c-4533-b14b-c88ea749aa25 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:31.077198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea210f34-77fa-4d23-b2b0-a41fc9776386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:31.078091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea210f34-77fa-4d23-b2b0-a41fc9776386 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:31.078604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea210f34-77fa-4d23-b2b0-a41fc9776386 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:31.079168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea210f34-77fa-4d23-b2b0-a41fc9776386 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:31.079273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 366/719] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:01:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:31.079997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9933f-803c-4533-b14b-c88ea749aa25 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:31.080434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea210f34-77fa-4d23-b2b0-a41fc9776386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:31.081076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea210f34-77fa-4d23-b2b0-a41fc9776386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:31.082655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea210f34-77fa-4d23-b2b0-a41fc9776386 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:31.096958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 354/720] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:31.098263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea210f34-77fa-4d23-b2b0-a41fc9776386 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:31.103610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:31.203257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:31.206477 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9933f-803c-4533-b14b-c88ea749aa25 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:31.234020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea210f34-77fa-4d23-b2b0-a41fc9776386 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:31.245561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb509d63-6802-428a-b5e1-8b5ebe7da868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:31.246605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb509d63-6802-428a-b5e1-8b5ebe7da868 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:31.247076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb509d63-6802-428a-b5e1-8b5ebe7da868 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:31.247587 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb509d63-6802-428a-b5e1-8b5ebe7da868 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:31.248498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb509d63-6802-428a-b5e1-8b5ebe7da868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:31.249033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb509d63-6802-428a-b5e1-8b5ebe7da868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:31.250699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb509d63-6802-428a-b5e1-8b5ebe7da868 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:31.272193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 367/721] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:31.274332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb509d63-6802-428a-b5e1-8b5ebe7da868 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:31.286556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c53b92-cb66-476d-a142-83597aef6ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:31.287652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c53b92-cb66-476d-a142-83597aef6ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:31.288497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c53b92-cb66-476d-a142-83597aef6ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:31.289021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c53b92-cb66-476d-a142-83597aef6ea9 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:31.290299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c53b92-cb66-476d-a142-83597aef6ea9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:31.290802 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c53b92-cb66-476d-a142-83597aef6ea9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:31.292376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c53b92-cb66-476d-a142-83597aef6ea9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:31.298230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 355/722] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:01:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:31.299423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c53b92-cb66-476d-a142-83597aef6ea9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:31.383562 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:31.441778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb509d63-6802-428a-b5e1-8b5ebe7da868 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:31.443886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c53b92-cb66-476d-a142-83597aef6ea9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:31.510679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cf5f4-b73c-40e2-95ed-4ed726b7ba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:31.511847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cf5f4-b73c-40e2-95ed-4ed726b7ba24 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:31.512323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cf5f4-b73c-40e2-95ed-4ed726b7ba24 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:31.512911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cf5f4-b73c-40e2-95ed-4ed726b7ba24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:31.520625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4a998-8c42-44d0-8cd7-4db2400251f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:31.521345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4a998-8c42-44d0-8cd7-4db2400251f9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:31.521621 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4a998-8c42-44d0-8cd7-4db2400251f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:31.521893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4a998-8c42-44d0-8cd7-4db2400251f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:31.522198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cf5f4-b73c-40e2-95ed-4ed726b7ba24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:31.523955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cf5f4-b73c-40e2-95ed-4ed726b7ba24 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:31.528213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:31.533475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4a998-8c42-44d0-8cd7-4db2400251f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:31.535010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4a998-8c42-44d0-8cd7-4db2400251f9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2a0cf5f4-b73c-40e2-95ed-4ed726b7ba24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:31.541997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:31.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:31.543873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:31.543873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:31.543873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:31.543873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:31.543873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:31.543873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:31.543873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:31.543873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:31.546980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 356/723] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-7cc4a998-8c42-44d0-8cd7-4db2400251f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:31.555513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:31.557307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:31.558261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:31.558261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:31.558261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:31.558261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:31.558261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:31.558261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:31.558261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:31.558261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:31.558261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 07:01:31.558261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:31.558261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 368/724] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 07:01:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:31.558830 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cf5f4-b73c-40e2-95ed-4ed726b7ba24 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:31.564938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4a998-8c42-44d0-8cd7-4db2400251f9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:31.705371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4a998-8c42-44d0-8cd7-4db2400251f9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:31.711414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cf5f4-b73c-40e2-95ed-4ed726b7ba24 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:31.745665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a1c8a-512d-4ce5-bae2-c786c7931fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:31.746723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1c8a-512d-4ce5-bae2-c786c7931fce None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:31.747307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1c8a-512d-4ce5-bae2-c786c7931fce None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:31.747705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a1c8a-512d-4ce5-bae2-c786c7931fce None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:31.748934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1c8a-512d-4ce5-bae2-c786c7931fce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:31.749418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1c8a-512d-4ce5-bae2-c786c7931fce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:31.751326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a1c8a-512d-4ce5-bae2-c786c7931fce None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:31.751472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b6707-8ea7-4a92-b350-bac92009237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:31.752175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6707-8ea7-4a92-b350-bac92009237f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:31.752519 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6707-8ea7-4a92-b350-bac92009237f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:31.752854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6707-8ea7-4a92-b350-bac92009237f None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:31.753710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b6707-8ea7-4a92-b350-bac92009237f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:31.754082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b6707-8ea7-4a92-b350-bac92009237f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:31.754811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:31.756395 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b6707-8ea7-4a92-b350-bac92009237f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:31.770904 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 357/725] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:31.772393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da160c12-0b92-4429-bbf6-94447f162f82 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:31.772771 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da160c12-0b92-4429-bbf6-94447f162f82 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:31.773154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da160c12-0b92-4429-bbf6-94447f162f82 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:31.774746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 358/726] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:31.774860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 369/727] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Aug 5 07:01:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:31.777281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da160c12-0b92-4429-bbf6-94447f162f82 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:31.780688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94c155-72e2-4010-a41d-cc3b5f967be8 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:31.781017 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94c155-72e2-4010-a41d-cc3b5f967be8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:31.781296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94c155-72e2-4010-a41d-cc3b5f967be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:31.805662 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2b94c155-72e2-4010-a41d-cc3b5f967be8 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:31.806919 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2b94c155-72e2-4010-a41d-cc3b5f967be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:31.859838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:31.897026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 370/728] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:31.897933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94c155-72e2-4010-a41d-cc3b5f967be8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:31.907674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da160c12-0b92-4429-bbf6-94447f162f82 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:31.953447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795681b2-8833-444b-9730-f1a30dd9d174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:31.954240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795681b2-8833-444b-9730-f1a30dd9d174 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:31.954522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795681b2-8833-444b-9730-f1a30dd9d174 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:31.954837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795681b2-8833-444b-9730-f1a30dd9d174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:31.956137 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795681b2-8833-444b-9730-f1a30dd9d174 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=555de6e5c8c44f40a6433b3d2ffc52f3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:31.956410 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795681b2-8833-444b-9730-f1a30dd9d174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:31.958204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795681b2-8833-444b-9730-f1a30dd9d174 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:31.966316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 359/729] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:31 2022] GET /identity/v3/role_assignments?user.id=555de6e5c8c44f40a6433b3d2ffc52f3&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:31.967186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795681b2-8833-444b-9730-f1a30dd9d174 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:32.072170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94c155-72e2-4010-a41d-cc3b5f967be8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:32.132122 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:32.156076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87319c93-aaa4-45c3-b084-ae96f3065862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:32.156784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87319c93-aaa4-45c3-b084-ae96f3065862 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:32.157641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87319c93-aaa4-45c3-b084-ae96f3065862 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:32.157641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87319c93-aaa4-45c3-b084-ae96f3065862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:32.180866 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795681b2-8833-444b-9730-f1a30dd9d174 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:32.225299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:32.235384 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a78039-14e8-4291-97fe-cd68667621f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:32.236310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a78039-14e8-4291-97fe-cd68667621f7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:32.236310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a78039-14e8-4291-97fe-cd68667621f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:32.236592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a78039-14e8-4291-97fe-cd68667621f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:32.267440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a78039-14e8-4291-97fe-cd68667621f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f2a78039-14e8-4291-97fe-cd68667621f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:32.287208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:32.288538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:32.289413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:32.289413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:32.289413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:32.289413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:32.289413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:32.289413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:32.289413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:32.289413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:32.289413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:32.289413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:32.289413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:32.289413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:32.293143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 360/730] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:32.296875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a78039-14e8-4291-97fe-cd68667621f7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:32.326340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87319c93-aaa4-45c3-b084-ae96f3065862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:32.327885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87319c93-aaa4-45c3-b084-ae96f3065862 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:32.495429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 371/731] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:32.501801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87319c93-aaa4-45c3-b084-ae96f3065862 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:32.527028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a78039-14e8-4291-97fe-cd68667621f7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:32.545266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:32.579622 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1caa1-f4a7-4b7c-9c5f-c3025a535922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:32.580630 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1caa1-f4a7-4b7c-9c5f-c3025a535922 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:32.580935 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1caa1-f4a7-4b7c-9c5f-c3025a535922 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:32.581205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1caa1-f4a7-4b7c-9c5f-c3025a535922 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:32.581925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1caa1-f4a7-4b7c-9c5f-c3025a535922 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:32.582227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1caa1-f4a7-4b7c-9c5f-c3025a535922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:32.584144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1caa1-f4a7-4b7c-9c5f-c3025a535922 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:32.598981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 361/732] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:32.600835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6990e28-0dfe-422d-88a2-fb75f1fc0ca3 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:32.601142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6990e28-0dfe-422d-88a2-fb75f1fc0ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:32.601416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6990e28-0dfe-422d-88a2-fb75f1fc0ca3 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:32.604977 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 362/733] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:32.605794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6990e28-0dfe-422d-88a2-fb75f1fc0ca3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:32.643989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87319c93-aaa4-45c3-b084-ae96f3065862 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:32.658807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:32.683823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70467a91-9211-4c29-a4ff-1ba0b95ab50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:32.684811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70467a91-9211-4c29-a4ff-1ba0b95ab50b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:32.685425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70467a91-9211-4c29-a4ff-1ba0b95ab50b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:32.685834 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70467a91-9211-4c29-a4ff-1ba0b95ab50b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:32.697266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70467a91-9211-4c29-a4ff-1ba0b95ab50b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:32.699073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70467a91-9211-4c29-a4ff-1ba0b95ab50b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-70467a91-9211-4c29-a4ff-1ba0b95ab50b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:32.715554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:32.716681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:32.717838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:32.717838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:32.717838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:32.717838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:32.718099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6990e28-0dfe-422d-88a2-fb75f1fc0ca3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:32.719984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 372/734] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:32.721643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113f1cb-1f5c-4ece-8009-e2b26b1f8134 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:32.722070 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113f1cb-1f5c-4ece-8009-e2b26b1f8134 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:32.722525 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113f1cb-1f5c-4ece-8009-e2b26b1f8134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:32.744356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8113f1cb-1f5c-4ece-8009-e2b26b1f8134 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:32.746099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8113f1cb-1f5c-4ece-8009-e2b26b1f8134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:32.754954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca6f88-bd5a-4ad1-a22f-723a3c24e08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:32.755671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca6f88-bd5a-4ad1-a22f-723a3c24e08f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:32.756045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca6f88-bd5a-4ad1-a22f-723a3c24e08f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:32.756393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca6f88-bd5a-4ad1-a22f-723a3c24e08f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:32.767699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca6f88-bd5a-4ad1-a22f-723a3c24e08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:32.769290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca6f88-bd5a-4ad1-a22f-723a3c24e08f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-75ca6f88-bd5a-4ad1-a22f-723a3c24e08f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:32.784208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:32.785177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:32.786092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:32.786092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:32.786092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:32.786092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:32.790874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 363/735] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:32.791846 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca6f88-bd5a-4ad1-a22f-723a3c24e08f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:32.825283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 373/736] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:32.826489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113f1cb-1f5c-4ece-8009-e2b26b1f8134 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:32.835358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:32.892976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:32.896630 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca6f88-bd5a-4ad1-a22f-723a3c24e08f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:32.933577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e51b1-8f04-47ef-b8ca-597e6072c1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:32.934320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e51b1-8f04-47ef-b8ca-597e6072c1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:32.934698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e51b1-8f04-47ef-b8ca-597e6072c1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:32.935014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e51b1-8f04-47ef-b8ca-597e6072c1a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:32.935787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e51b1-8f04-47ef-b8ca-597e6072c1a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:32.936278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e51b1-8f04-47ef-b8ca-597e6072c1a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:32.937638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e51b1-8f04-47ef-b8ca-597e6072c1a4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:32.942701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113f1cb-1f5c-4ece-8009-e2b26b1f8134 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:32.950145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 364/737] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:32.951317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e51b1-8f04-47ef-b8ca-597e6072c1a4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:32.981876 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc77211-9be7-45ac-8959-cba24bcc73c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:32.982811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc77211-9be7-45ac-8959-cba24bcc73c9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:32.983369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc77211-9be7-45ac-8959-cba24bcc73c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:32.983810 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc77211-9be7-45ac-8959-cba24bcc73c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:32.984780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc77211-9be7-45ac-8959-cba24bcc73c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:32.985444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc77211-9be7-45ac-8959-cba24bcc73c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:32.986991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc77211-9be7-45ac-8959-cba24bcc73c9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:33.000335 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 374/738] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:33.001684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc77211-9be7-45ac-8959-cba24bcc73c9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:33.061705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e51b1-8f04-47ef-b8ca-597e6072c1a4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:33.074153 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:33.098168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c5419-7ce8-47b1-9f1a-266cc6ddd40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:33.098962 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c5419-7ce8-47b1-9f1a-266cc6ddd40a None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:33.099251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c5419-7ce8-47b1-9f1a-266cc6ddd40a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:33.099601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c5419-7ce8-47b1-9f1a-266cc6ddd40a None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:33.100382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c5419-7ce8-47b1-9f1a-266cc6ddd40a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:33.101930 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c5419-7ce8-47b1-9f1a-266cc6ddd40a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:33.116520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc77211-9be7-45ac-8959-cba24bcc73c9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:33.122772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 365/739] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:01:32 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:01:33.123912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c5419-7ce8-47b1-9f1a-266cc6ddd40a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:33.146790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:33.171070 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb101e9-a453-446a-a96b-75bff543a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:33.172188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb101e9-a453-446a-a96b-75bff543a7ec None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:33.172673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb101e9-a453-446a-a96b-75bff543a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:33.173225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb101e9-a453-446a-a96b-75bff543a7ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:33.181937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb101e9-a453-446a-a96b-75bff543a7ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:33.183720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb101e9-a453-446a-a96b-75bff543a7ec None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9bb101e9-a453-446a-a96b-75bff543a7ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:33.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:33.198749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:33.199636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:33.199636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:33.199636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:33.199636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:33.199636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:33.199636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:33.199636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:33.199636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:33.202335 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 375/740] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:33.210122 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb101e9-a453-446a-a96b-75bff543a7ec None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:33.248958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c5419-7ce8-47b1-9f1a-266cc6ddd40a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:33.309713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc40a8-3ddb-4941-a34c-9bb9e5e4bfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:33.310602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc40a8-3ddb-4941-a34c-9bb9e5e4bfcd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:33.310939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc40a8-3ddb-4941-a34c-9bb9e5e4bfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:33.311286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc40a8-3ddb-4941-a34c-9bb9e5e4bfcd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:33.324955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc40a8-3ddb-4941-a34c-9bb9e5e4bfcd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:33.326415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc40a8-3ddb-4941-a34c-9bb9e5e4bfcd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c7fc40a8-3ddb-4941-a34c-9bb9e5e4bfcd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:33.356250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:33.357313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:33.358249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:33.358249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:33.358249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:33.358249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:33.358249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:33.358249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:33.358249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:33.358249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:33.358249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 07:01:33.358249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:33.366279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 366/741] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:33.371682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc40a8-3ddb-4941-a34c-9bb9e5e4bfcd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:33.411614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb101e9-a453-446a-a96b-75bff543a7ec None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:33.437813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:33.451913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ace2b-7017-4e84-b0f9-6f5b57255a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:33.452945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ace2b-7017-4e84-b0f9-6f5b57255a0b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:33.453422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ace2b-7017-4e84-b0f9-6f5b57255a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:33.454052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ace2b-7017-4e84-b0f9-6f5b57255a0b None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:33.455001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ace2b-7017-4e84-b0f9-6f5b57255a0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:33.455499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ace2b-7017-4e84-b0f9-6f5b57255a0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:33.457284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ace2b-7017-4e84-b0f9-6f5b57255a0b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:33.471678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 376/742] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:33.477838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ace2b-7017-4e84-b0f9-6f5b57255a0b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:33.488082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:33.518564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc40a8-3ddb-4941-a34c-9bb9e5e4bfcd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:33.558949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f580482-3032-456c-8e2a-c0018b497f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:33.559577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f580482-3032-456c-8e2a-c0018b497f9a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:33.559920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f580482-3032-456c-8e2a-c0018b497f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:33.560038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f580482-3032-456c-8e2a-c0018b497f9a None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:33.561265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f580482-3032-456c-8e2a-c0018b497f9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:33.561480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f580482-3032-456c-8e2a-c0018b497f9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:33.562980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f580482-3032-456c-8e2a-c0018b497f9a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:33.586423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 367/743] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Aug 5 07:01:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:33.588165 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3ee88-8766-4d52-a77a-aa064fb52730 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:33.588688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3ee88-8766-4d52-a77a-aa064fb52730 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:33.589085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3ee88-8766-4d52-a77a-aa064fb52730 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:33.590853 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 368/744] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:33.594148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3ee88-8766-4d52-a77a-aa064fb52730 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:33.617895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ace2b-7017-4e84-b0f9-6f5b57255a0b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:33.660831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e40ce-833d-433f-aca5-7420d61da3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:33.662098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e40ce-833d-433f-aca5-7420d61da3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:33.662524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e40ce-833d-433f-aca5-7420d61da3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:33.663310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e40ce-833d-433f-aca5-7420d61da3b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:33.664335 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e40ce-833d-433f-aca5-7420d61da3b6 None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=0dc4cfe4a3ce4e34a1b664d99eb34d2a) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:33.665284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e40ce-833d-433f-aca5-7420d61da3b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:33.667157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e40ce-833d-433f-aca5-7420d61da3b6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:33.675993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 377/745] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:33 2022] GET /identity/v3/role_assignments?user.id=0dc4cfe4a3ce4e34a1b664d99eb34d2a&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:33.677831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5cb4e-3f0d-462f-be4c-7a9e150d5844 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:33.678445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5cb4e-3f0d-462f-be4c-7a9e150d5844 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:33.678880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5cb4e-3f0d-462f-be4c-7a9e150d5844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:33.725973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-88a5cb4e-3f0d-462f-be4c-7a9e150d5844 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:33.727463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-88a5cb4e-3f0d-462f-be4c-7a9e150d5844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:33.744085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3ee88-8766-4d52-a77a-aa064fb52730 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:33.788734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443bc8a-25c4-45e3-a24d-218b8e88153c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:33.789397 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443bc8a-25c4-45e3-a24d-218b8e88153c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:33.789673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443bc8a-25c4-45e3-a24d-218b8e88153c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:33.789945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443bc8a-25c4-45e3-a24d-218b8e88153c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:33.800820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:33.821851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:33.853972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 378/746] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 07:01:33.887882 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5cb4e-3f0d-462f-be4c-7a9e150d5844 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:33.942025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443bc8a-25c4-45e3-a24d-218b8e88153c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:33.943503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443bc8a-25c4-45e3-a24d-218b8e88153c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:34.017372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5cb4e-3f0d-462f-be4c-7a9e150d5844 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:34.063439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990381b-e4c9-4536-8dd8-5d935694d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:34.064358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990381b-e4c9-4536-8dd8-5d935694d12c None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:34.064591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990381b-e4c9-4536-8dd8-5d935694d12c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:34.065101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990381b-e4c9-4536-8dd8-5d935694d12c None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:34.065815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990381b-e4c9-4536-8dd8-5d935694d12c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:34.067304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990381b-e4c9-4536-8dd8-5d935694d12c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:34.106821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 369/747] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 07:01:34.112081 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443bc8a-25c4-45e3-a24d-218b8e88153c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:34.122721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 379/748] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:01:33 2022] POST /identity/v3/services => generated 240 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:01:34.182050 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:34.199473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec84305-c623-48bf-90c6-decdbab70257 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:34.199756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec84305-c623-48bf-90c6-decdbab70257 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:34.200033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec84305-c623-48bf-90c6-decdbab70257 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:34.202018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 380/749] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:01:34.210294 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553feb8-0499-495e-b5a2-804d10ab9093 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:34.210604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553feb8-0499-495e-b5a2-804d10ab9093 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:34.210851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553feb8-0499-495e-b5a2-804d10ab9093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:34.240172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5553feb8-0499-495e-b5a2-804d10ab9093 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:34.241526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5553feb8-0499-495e-b5a2-804d10ab9093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:34.270202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443bc8a-25c4-45e3-a24d-218b8e88153c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:34.324835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13976a4b-81b6-4545-bb05-21838631eb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:34.325541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13976a4b-81b6-4545-bb05-21838631eb2a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:34.325852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13976a4b-81b6-4545-bb05-21838631eb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:34.326719 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13976a4b-81b6-4545-bb05-21838631eb2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:34.330769 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:34.340741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13976a4b-81b6-4545-bb05-21838631eb2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:34.343382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13976a4b-81b6-4545-bb05-21838631eb2a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-13976a4b-81b6-4545-bb05-21838631eb2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:34.361640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:34.362564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:34.363423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:34.363423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:34.363423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:34.363423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:34.363423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 370/750] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:34.370855 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13976a4b-81b6-4545-bb05-21838631eb2a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:34.422819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 381/751] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:34.448934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553feb8-0499-495e-b5a2-804d10ab9093 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:34.501271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:34.524471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13976a4b-81b6-4545-bb05-21838631eb2a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:34.563754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bb75a-d6d9-4900-872b-8389449e571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:34.564387 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bb75a-d6d9-4900-872b-8389449e571a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:34.564655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bb75a-d6d9-4900-872b-8389449e571a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:34.564963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bb75a-d6d9-4900-872b-8389449e571a None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:34.565674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bb75a-d6d9-4900-872b-8389449e571a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:34.565974 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bb75a-d6d9-4900-872b-8389449e571a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:34.567416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bb75a-d6d9-4900-872b-8389449e571a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:34.581394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 371/752] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:34.586170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553feb8-0499-495e-b5a2-804d10ab9093 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:34.587054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bb75a-d6d9-4900-872b-8389449e571a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:34.634774 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eed514-e3fd-414e-8844-ac893056a7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:34.635793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eed514-e3fd-414e-8844-ac893056a7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:34.637230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eed514-e3fd-414e-8844-ac893056a7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:34.637731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eed514-e3fd-414e-8844-ac893056a7f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:34.650733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eed514-e3fd-414e-8844-ac893056a7f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-06eed514-e3fd-414e-8844-ac893056a7f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:34.657171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:34.658108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:34.658940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:34.658940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:34.658940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:34.658940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:34.658940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:34.658940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:34.658940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:34.658940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:34.658940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:34.658940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:34.658940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:34.658940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:34.661969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 382/753] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:34.670545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eed514-e3fd-414e-8844-ac893056a7f2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:34.704730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:34.798302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bb75a-d6d9-4900-872b-8389449e571a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:34.813501 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eed514-e3fd-414e-8844-ac893056a7f2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:34.863400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981022a-684d-47db-98b6-7214a8a29977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:34.864062 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981022a-684d-47db-98b6-7214a8a29977 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:34.864340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981022a-684d-47db-98b6-7214a8a29977 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:34.864613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981022a-684d-47db-98b6-7214a8a29977 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:34.881215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981022a-684d-47db-98b6-7214a8a29977 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:34.882675 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981022a-684d-47db-98b6-7214a8a29977 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:34.887212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759c9f5-5f29-4a96-b8bc-ff63416263f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:34.887781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759c9f5-5f29-4a96-b8bc-ff63416263f6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:34.888057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759c9f5-5f29-4a96-b8bc-ff63416263f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:34.888329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759c9f5-5f29-4a96-b8bc-ff63416263f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:34.889082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759c9f5-5f29-4a96-b8bc-ff63416263f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:34.889388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759c9f5-5f29-4a96-b8bc-ff63416263f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:34.890759 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759c9f5-5f29-4a96-b8bc-ff63416263f6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:34.910511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 383/754] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4981022a-684d-47db-98b6-7214a8a29977 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:34.911877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:34.913120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:34.914343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:34.914343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:34.914343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:34.914343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:34.914343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:34.914343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:34.914343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:34.914343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:34.914343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 372/755] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:34.921518 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759c9f5-5f29-4a96-b8bc-ff63416263f6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:34.924628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981022a-684d-47db-98b6-7214a8a29977 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:34.929643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:35.035045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:35.051169 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759c9f5-5f29-4a96-b8bc-ff63416263f6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:35.117905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a673f-2e21-47f1-b24a-46bab46d8cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:35.118559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a673f-2e21-47f1-b24a-46bab46d8cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:35.118836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a673f-2e21-47f1-b24a-46bab46d8cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:35.119103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a673f-2e21-47f1-b24a-46bab46d8cb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:35.130256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981022a-684d-47db-98b6-7214a8a29977 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:35.148019 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a673f-2e21-47f1-b24a-46bab46d8cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:35.150228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a673f-2e21-47f1-b24a-46bab46d8cb1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-f58a673f-2e21-47f1-b24a-46bab46d8cb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:35.174654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:35.176934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:35.179071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:35.179071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:35.179071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:35.179071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:35.179071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 384/756] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:35.182026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a673f-2e21-47f1-b24a-46bab46d8cb1 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:35.182220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887e536-3652-43c4-a0c1-d203a7ca5ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:35.182753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887e536-3652-43c4-a0c1-d203a7ca5ace None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:35.183038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887e536-3652-43c4-a0c1-d203a7ca5ace None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:35.183319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887e536-3652-43c4-a0c1-d203a7ca5ace None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:35.184099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887e536-3652-43c4-a0c1-d203a7ca5ace None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:35.184410 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887e536-3652-43c4-a0c1-d203a7ca5ace None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:35.186020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887e536-3652-43c4-a0c1-d203a7ca5ace None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:35.216559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 373/757] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:35.222680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887e536-3652-43c4-a0c1-d203a7ca5ace None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:35.344771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a673f-2e21-47f1-b24a-46bab46d8cb1 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:35.380631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:35.416920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5af2f-54c1-4439-8cde-1e906a40070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:35.417466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5af2f-54c1-4439-8cde-1e906a40070e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:35.417744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5af2f-54c1-4439-8cde-1e906a40070e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:35.418024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5af2f-54c1-4439-8cde-1e906a40070e None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:35.418723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5af2f-54c1-4439-8cde-1e906a40070e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:35.419027 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5af2f-54c1-4439-8cde-1e906a40070e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:35.420413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5af2f-54c1-4439-8cde-1e906a40070e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:35.439332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:35.447432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 385/758] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:35.450493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887e536-3652-43c4-a0c1-d203a7ca5ace None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:35.452739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5af2f-54c1-4439-8cde-1e906a40070e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:35.524215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a3050-38a0-4167-8d38-6661fae89bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:35.524859 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3050-38a0-4167-8d38-6661fae89bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:35.525164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3050-38a0-4167-8d38-6661fae89bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:35.525435 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3050-38a0-4167-8d38-6661fae89bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:35.526400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a3050-38a0-4167-8d38-6661fae89bd0 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=8d83b456cec84bc5ab02a190099c0baf) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:35.526710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a3050-38a0-4167-8d38-6661fae89bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:35.528152 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a3050-38a0-4167-8d38-6661fae89bd0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:35.539387 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 374/759] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:35 2022] GET /identity/v3/role_assignments?user.id=8d83b456cec84bc5ab02a190099c0baf&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:35.593779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5af2f-54c1-4439-8cde-1e906a40070e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:35.631617 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282949b-b132-4316-b602-843a8575bc8f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:35.632290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282949b-b132-4316-b602-843a8575bc8f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:35.632290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282949b-b132-4316-b602-843a8575bc8f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:35.633869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 375/760] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:35.636615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775048d-8034-4491-a683-4f598237d09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:35.637316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775048d-8034-4491-a683-4f598237d09d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:35.637603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775048d-8034-4491-a683-4f598237d09d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:35.637962 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775048d-8034-4491-a683-4f598237d09d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:35.639854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae1c0-6da3-4c89-b74e-5a8d61c1b8e6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:35.640143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae1c0-6da3-4c89-b74e-5a8d61c1b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:35.640422 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae1c0-6da3-4c89-b74e-5a8d61c1b8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:35.649144 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775048d-8034-4491-a683-4f598237d09d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:35.650685 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775048d-8034-4491-a683-4f598237d09d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-7775048d-8034-4491-a683-4f598237d09d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:35.664951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:35.667198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:35.669406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:35.669406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:35.669406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:35.669406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:35.669406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:35.669406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:35.669406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:35.669406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:35.669406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:01:35.669406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:35.669406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 386/761] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 07:01:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:35.675260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-643ae1c0-6da3-4c89-b74e-5a8d61c1b8e6 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:35.676205 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775048d-8034-4491-a683-4f598237d09d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:35.682400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-643ae1c0-6da3-4c89-b74e-5a8d61c1b8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:35.746310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:35.797359 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775048d-8034-4491-a683-4f598237d09d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:35.848447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 376/762] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:35.878057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ae1c0-6da3-4c89-b74e-5a8d61c1b8e6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:35.878378 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f829b0-4d4b-41b1-8e07-161fcdbe2a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:35.878737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f829b0-4d4b-41b1-8e07-161fcdbe2a7d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:35.879022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f829b0-4d4b-41b1-8e07-161fcdbe2a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:35.879298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f829b0-4d4b-41b1-8e07-161fcdbe2a7d None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:35.880113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f829b0-4d4b-41b1-8e07-161fcdbe2a7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:35.880421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f829b0-4d4b-41b1-8e07-161fcdbe2a7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:35.881970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f829b0-4d4b-41b1-8e07-161fcdbe2a7d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:35.931582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 387/763] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 07:01:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:35.937164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f829b0-4d4b-41b1-8e07-161fcdbe2a7d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:35.946970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:35.995996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ae1c0-6da3-4c89-b74e-5a8d61c1b8e6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:36.081351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f829b0-4d4b-41b1-8e07-161fcdbe2a7d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:36.101871 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:36.123473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2733d41-ebd6-437b-8d6f-b5a86bc76757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:36.124484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2733d41-ebd6-437b-8d6f-b5a86bc76757 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:36.124944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2733d41-ebd6-437b-8d6f-b5a86bc76757 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:36.125362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2733d41-ebd6-437b-8d6f-b5a86bc76757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:36.139566 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2733d41-ebd6-437b-8d6f-b5a86bc76757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:36.142135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2733d41-ebd6-437b-8d6f-b5a86bc76757 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:36.162522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f43405-0a7f-442a-beca-3112a82b94ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-c2733d41-ebd6-437b-8d6f-b5a86bc76757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:36.163475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:36.164860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:36.165983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:36.165983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:36.165983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:36.165983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:36.166300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f43405-0a7f-442a-beca-3112a82b94ba None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:36.166300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f43405-0a7f-442a-beca-3112a82b94ba None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:36.166451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f43405-0a7f-442a-beca-3112a82b94ba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:36.167183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f43405-0a7f-442a-beca-3112a82b94ba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:36.168326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 388/764] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:36.169887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9596c0-0713-479d-bcd8-2754c58c21e9 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:36.170308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9596c0-0713-479d-bcd8-2754c58c21e9 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:36.170708 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9596c0-0713-479d-bcd8-2754c58c21e9 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:36.172474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 389/765] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:36.173504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f43405-0a7f-442a-beca-3112a82b94ba None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:36.174247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9596c0-0713-479d-bcd8-2754c58c21e9 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-55f43405-0a7f-442a-beca-3112a82b94ba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:36.191542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:36.192608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 07:01:36.193503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:36.195055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 377/766] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Aug 5 07:01:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:36.196647 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c317625-2aa0-4465-a389-eb8c8f0278fd None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:36.197219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c317625-2aa0-4465-a389-eb8c8f0278fd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:36.197735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c317625-2aa0-4465-a389-eb8c8f0278fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:36.219075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6c317625-2aa0-4465-a389-eb8c8f0278fd None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:36.220322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6c317625-2aa0-4465-a389-eb8c8f0278fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:36.308416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9596c0-0713-479d-bcd8-2754c58c21e9 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:36.321689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 378/767] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:36.323014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c317625-2aa0-4465-a389-eb8c8f0278fd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:36.366740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352c75a-4a5b-48b3-85e8-e52acd97fa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:36.367471 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352c75a-4a5b-48b3-85e8-e52acd97fa57 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:36.367758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352c75a-4a5b-48b3-85e8-e52acd97fa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:36.368036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352c75a-4a5b-48b3-85e8-e52acd97fa57 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:36.368749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352c75a-4a5b-48b3-85e8-e52acd97fa57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:36.369110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352c75a-4a5b-48b3-85e8-e52acd97fa57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:36.370792 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352c75a-4a5b-48b3-85e8-e52acd97fa57 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:36.386328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:36.388111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 390/768] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:36.389128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352c75a-4a5b-48b3-85e8-e52acd97fa57 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:36.423789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:36.448532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c317625-2aa0-4465-a389-eb8c8f0278fd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:36.499089 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c10f3-100b-4f4e-9f5c-9432820c0510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:36.499718 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c10f3-100b-4f4e-9f5c-9432820c0510 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:36.500061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c10f3-100b-4f4e-9f5c-9432820c0510 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:36.500338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c10f3-100b-4f4e-9f5c-9432820c0510 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:36.501232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c10f3-100b-4f4e-9f5c-9432820c0510 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:36.501538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c10f3-100b-4f4e-9f5c-9432820c0510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:36.503021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c10f3-100b-4f4e-9f5c-9432820c0510 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:36.512847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 379/769] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 5 07:01:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:36.513851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c10f3-100b-4f4e-9f5c-9432820c0510 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:36.523946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352c75a-4a5b-48b3-85e8-e52acd97fa57 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:36.567496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790a922-b482-4a35-b178-97954e05b56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:36.568155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790a922-b482-4a35-b178-97954e05b56f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:36.568438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790a922-b482-4a35-b178-97954e05b56f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:36.568715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790a922-b482-4a35-b178-97954e05b56f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:36.580500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790a922-b482-4a35-b178-97954e05b56f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0790a922-b482-4a35-b178-97954e05b56f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:36.586533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:36.587452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:36.588287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:36.588287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:36.588287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:36.588287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:36.588287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:36.588287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:36.588287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:36.588287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:36.588287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:36.588287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:36.588287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:36.588287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:36.592696 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 391/770] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:36.593818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790a922-b482-4a35-b178-97954e05b56f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:36.627233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c10f3-100b-4f4e-9f5c-9432820c0510 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:36.644321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:36.664854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61893c7-a69c-456c-9015-d6e8a7a86e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:36.665987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61893c7-a69c-456c-9015-d6e8a7a86e8f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:36.666465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61893c7-a69c-456c-9015-d6e8a7a86e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:36.666931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61893c7-a69c-456c-9015-d6e8a7a86e8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:36.674400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61893c7-a69c-456c-9015-d6e8a7a86e8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:36.676190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61893c7-a69c-456c-9015-d6e8a7a86e8f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b61893c7-a69c-456c-9015-d6e8a7a86e8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:36.688588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:36.689578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:36.690459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:36.690459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:36.690459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:36.690459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:36.690459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:36.690459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:36.690459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:36.690459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:36.692925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 380/771] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:36.694025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61893c7-a69c-456c-9015-d6e8a7a86e8f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:36.701492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:36.713482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790a922-b482-4a35-b178-97954e05b56f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:36.749408 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7d750-c046-4019-8548-3d3128348c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:36.750038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d750-c046-4019-8548-3d3128348c3c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:36.750321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d750-c046-4019-8548-3d3128348c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:36.750597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d750-c046-4019-8548-3d3128348c3c None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:36.751332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7d750-c046-4019-8548-3d3128348c3c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:36.751634 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7d750-c046-4019-8548-3d3128348c3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:36.753324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7d750-c046-4019-8548-3d3128348c3c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:36.759298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 392/772] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 5 07:01:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:36.760106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7d750-c046-4019-8548-3d3128348c3c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:36.810291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61893c7-a69c-456c-9015-d6e8a7a86e8f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:36.849496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dca06-cc69-4795-b138-43f5fec04e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:36.850791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dca06-cc69-4795-b138-43f5fec04e3a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:36.851262 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dca06-cc69-4795-b138-43f5fec04e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:36.851825 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dca06-cc69-4795-b138-43f5fec04e3a None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:36.852778 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dca06-cc69-4795-b138-43f5fec04e3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:36.853296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dca06-cc69-4795-b138-43f5fec04e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:36.854979 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dca06-cc69-4795-b138-43f5fec04e3a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:36.865619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 381/773] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:36.866995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe107fe-ad77-4f93-8a52-e05c75c27285 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:36.867283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe107fe-ad77-4f93-8a52-e05c75c27285 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:36.867557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe107fe-ad77-4f93-8a52-e05c75c27285 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:36.872785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 382/774] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:36.872785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe107fe-ad77-4f93-8a52-e05c75c27285 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:36.876204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7d750-c046-4019-8548-3d3128348c3c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:36.910591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f48855-855d-4911-8c4c-5099be7c0564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:36.911206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f48855-855d-4911-8c4c-5099be7c0564 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:36.911481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f48855-855d-4911-8c4c-5099be7c0564 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:36.911751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f48855-855d-4911-8c4c-5099be7c0564 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:36.912478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f48855-855d-4911-8c4c-5099be7c0564 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:36.913677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f48855-855d-4911-8c4c-5099be7c0564 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:36.913795 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:36.914734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f48855-855d-4911-8c4c-5099be7c0564 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:36.927305 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 393/775] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:36.928108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f48855-855d-4911-8c4c-5099be7c0564 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:36.947913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:36.983001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe107fe-ad77-4f93-8a52-e05c75c27285 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:37.018479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4a863-2415-4a51-82d8-ed1a718683db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:37.019111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4a863-2415-4a51-82d8-ed1a718683db None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.019373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4a863-2415-4a51-82d8-ed1a718683db None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.019640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4a863-2415-4a51-82d8-ed1a718683db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:37.020398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4a863-2415-4a51-82d8-ed1a718683db None admin] RBAC: Adding query filter params (interface=public, service_id=bfb1edf4b59d46acb65749d2f3fa44e8, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:37.020704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4a863-2415-4a51-82d8-ed1a718683db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:37.022086 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4a863-2415-4a51-82d8-ed1a718683db None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:37.034225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 383/776] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 07:01:36 2022] GET /identity/v3/endpoints?service_id=bfb1edf4b59d46acb65749d2f3fa44e8&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:37.034225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e158-3086-49a9-bf64-f31c5216fa5f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.034225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e158-3086-49a9-bf64-f31c5216fa5f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.034225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e158-3086-49a9-bf64-f31c5216fa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:37.048690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f48855-855d-4911-8c4c-5099be7c0564 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:37.049070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-49d5e158-3086-49a9-bf64-f31c5216fa5f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:37.050237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-49d5e158-3086-49a9-bf64-f31c5216fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:37.089125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799f4d6-f055-4fc8-b8ec-e0cbbfdd590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:37.090165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799f4d6-f055-4fc8-b8ec-e0cbbfdd590c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.090670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799f4d6-f055-4fc8-b8ec-e0cbbfdd590c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.091204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799f4d6-f055-4fc8-b8ec-e0cbbfdd590c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:37.102579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799f4d6-f055-4fc8-b8ec-e0cbbfdd590c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:37.104106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799f4d6-f055-4fc8-b8ec-e0cbbfdd590c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-6799f4d6-f055-4fc8-b8ec-e0cbbfdd590c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:37.119611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:37.120558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:37.126553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:37.126553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:37.126553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:37.126553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:37.126553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 394/777] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:37.126553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799f4d6-f055-4fc8-b8ec-e0cbbfdd590c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:37.129732 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 384/778] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:37.130194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5e158-3086-49a9-bf64-f31c5216fa5f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:37.168742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:37.198065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:37.235309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799f4d6-f055-4fc8-b8ec-e0cbbfdd590c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:37.243149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5e158-3086-49a9-bf64-f31c5216fa5f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:37.273783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226eb8ce-4945-477b-a853-72d9b97eaa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:37.274472 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226eb8ce-4945-477b-a853-72d9b97eaa43 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.274755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226eb8ce-4945-477b-a853-72d9b97eaa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.275032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226eb8ce-4945-477b-a853-72d9b97eaa43 None admin] PATH_INFO: `/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/555de6e5c8c44f40a6433b3d2ffc52f3/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:37.277094 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226eb8ce-4945-477b-a853-72d9b97eaa43 None admin] RBAC: Authorizing `identity:create_grant(project_id=29b560f1bcf347f6b8b885cc02d52e33, user_id=555de6e5c8c44f40a6433b3d2ffc52f3, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:37.278559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226eb8ce-4945-477b-a853-72d9b97eaa43 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:37.288851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f5714-09e5-4c0d-9b80-712b6df9d317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:37.289529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f5714-09e5-4c0d-9b80-712b6df9d317 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.289796 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f5714-09e5-4c0d-9b80-712b6df9d317 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.290162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f5714-09e5-4c0d-9b80-712b6df9d317 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:37.290956 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f5714-09e5-4c0d-9b80-712b6df9d317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:37.292153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f5714-09e5-4c0d-9b80-712b6df9d317 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:37.303441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 395/779] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:01:37 2022] PUT /identity/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/555de6e5c8c44f40a6433b3d2ffc52f3/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:01:37.303441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226eb8ce-4945-477b-a853-72d9b97eaa43 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:37.303780 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 385/780] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 07:01:37 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:37.303780 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f5714-09e5-4c0d-9b80-712b6df9d317 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:37.497236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:37.507496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f5714-09e5-4c0d-9b80-712b6df9d317 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:37.516245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226eb8ce-4945-477b-a853-72d9b97eaa43 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:37.544743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:37.550315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783573f-050d-4bbf-952f-78eba04fe5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:37.550985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783573f-050d-4bbf-952f-78eba04fe5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.551269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783573f-050d-4bbf-952f-78eba04fe5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.551547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783573f-050d-4bbf-952f-78eba04fe5b1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:37.552190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783573f-050d-4bbf-952f-78eba04fe5b1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:37.554689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783573f-050d-4bbf-952f-78eba04fe5b1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:37.557995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7aae2-fb78-4eda-9cc2-78b5e1777b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:37.558842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7aae2-fb78-4eda-9cc2-78b5e1777b6e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.559290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7aae2-fb78-4eda-9cc2-78b5e1777b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.559752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7aae2-fb78-4eda-9cc2-78b5e1777b6e None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:37.560740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7aae2-fb78-4eda-9cc2-78b5e1777b6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:37.561241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7aae2-fb78-4eda-9cc2-78b5e1777b6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:37.562777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7aae2-fb78-4eda-9cc2-78b5e1777b6e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b783573f-050d-4bbf-952f-78eba04fe5b1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:37.565657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:37.566607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:37.567420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 386/781] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:37 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:37.573073 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783573f-050d-4bbf-952f-78eba04fe5b1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:37.581150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 396/782] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:37.588923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7aae2-fb78-4eda-9cc2-78b5e1777b6e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:37.686603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783573f-050d-4bbf-952f-78eba04fe5b1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:37.713077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7aae2-fb78-4eda-9cc2-78b5e1777b6e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:37.723146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059a0a8-8576-4a26-a81f-b1610b69eca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:37.723792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059a0a8-8576-4a26-a81f-b1610b69eca1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.724074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059a0a8-8576-4a26-a81f-b1610b69eca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.724373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059a0a8-8576-4a26-a81f-b1610b69eca1 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:37.725077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059a0a8-8576-4a26-a81f-b1610b69eca1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:37.725387 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059a0a8-8576-4a26-a81f-b1610b69eca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:37.726831 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059a0a8-8576-4a26-a81f-b1610b69eca1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:37.732233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 387/783] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:01:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:37.737914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059a0a8-8576-4a26-a81f-b1610b69eca1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:37.753086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d3422-7d5d-494d-b9d1-24b1adfcd2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:37.754124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d3422-7d5d-494d-b9d1-24b1adfcd2eb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.754558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d3422-7d5d-494d-b9d1-24b1adfcd2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.755013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d3422-7d5d-494d-b9d1-24b1adfcd2eb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:37.764044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d3422-7d5d-494d-b9d1-24b1adfcd2eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:37.764526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:37.767545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d3422-7d5d-494d-b9d1-24b1adfcd2eb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-393d3422-7d5d-494d-b9d1-24b1adfcd2eb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:37.781546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:37.782896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:37.784104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:37.784104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:37.784104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:37.784104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:37.784104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:37.784104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:37.784104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:37.784104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:37.784104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 07:01:37.784104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:37.786547 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 397/784] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 07:01:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:37.793352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d3422-7d5d-494d-b9d1-24b1adfcd2eb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:37.846601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:37.871206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059a0a8-8576-4a26-a81f-b1610b69eca1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:37.905840 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d3422-7d5d-494d-b9d1-24b1adfcd2eb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:37.920122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b92f8-1756-4091-bdb8-840ea0cfba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:37.921328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b92f8-1756-4091-bdb8-840ea0cfba92 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.921783 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b92f8-1756-4091-bdb8-840ea0cfba92 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.922733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b92f8-1756-4091-bdb8-840ea0cfba92 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:37.923861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b92f8-1756-4091-bdb8-840ea0cfba92 None admin] RBAC: Adding query filter params (type=network) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:37.924337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b92f8-1756-4091-bdb8-840ea0cfba92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:37.926564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b92f8-1756-4091-bdb8-840ea0cfba92 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:37.933823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 388/785] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:01:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:37.940627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb39790-63a8-4057-8f39-1b59e5dcaba2 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.940627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb39790-63a8-4057-8f39-1b59e5dcaba2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.940627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb39790-63a8-4057-8f39-1b59e5dcaba2 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:37.940627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 389/786] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:37.942922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb39790-63a8-4057-8f39-1b59e5dcaba2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:37.957684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d769b4-e5d4-4281-9c3c-2f62253ab5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:37.959228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d769b4-e5d4-4281-9c3c-2f62253ab5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.959707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d769b4-e5d4-4281-9c3c-2f62253ab5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.960186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d769b4-e5d4-4281-9c3c-2f62253ab5e8 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:37.961697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d769b4-e5d4-4281-9c3c-2f62253ab5e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:37.962590 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d769b4-e5d4-4281-9c3c-2f62253ab5e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:37.964592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d769b4-e5d4-4281-9c3c-2f62253ab5e8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:37.993373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 398/787] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Aug 5 07:01:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:37.995015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b07f4c-1e88-4844-b3c1-e50530edd0b7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:37.996094 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b07f4c-1e88-4844-b3c1-e50530edd0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:37.996555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b07f4c-1e88-4844-b3c1-e50530edd0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:38.021003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-92b07f4c-1e88-4844-b3c1-e50530edd0b7 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:38.022969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-92b07f4c-1e88-4844-b3c1-e50530edd0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:38.058709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:38.074709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb39790-63a8-4057-8f39-1b59e5dcaba2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:38.116026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d8fd6-95b7-4f50-a679-9e77c6f05b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:38.117039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d8fd6-95b7-4f50-a679-9e77c6f05b7a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:38.117503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d8fd6-95b7-4f50-a679-9e77c6f05b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:38.117938 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d8fd6-95b7-4f50-a679-9e77c6f05b7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:38.118844 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d8fd6-95b7-4f50-a679-9e77c6f05b7a None admin] RBAC: Adding query filter params (interface=public, service_id=f1c2ca4708324071a359c15dff7ec47d, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:38.119314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d8fd6-95b7-4f50-a679-9e77c6f05b7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:38.120833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d8fd6-95b7-4f50-a679-9e77c6f05b7a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:38.122545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 399/788] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:38.123916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b07f4c-1e88-4844-b3c1-e50530edd0b7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:38.127311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 390/789] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 07:01:37 2022] GET /identity/v3/endpoints?service_id=f1c2ca4708324071a359c15dff7ec47d&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:38.133560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d8fd6-95b7-4f50-a679-9e77c6f05b7a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:38.177452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:38.252279 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b07f4c-1e88-4844-b3c1-e50530edd0b7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:38.264462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d8fd6-95b7-4f50-a679-9e77c6f05b7a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:38.299080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ecd04-d041-4fc9-9bb6-30eb58a186c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:38.300178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ecd04-d041-4fc9-9bb6-30eb58a186c2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:38.300550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ecd04-d041-4fc9-9bb6-30eb58a186c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:38.301105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ecd04-d041-4fc9-9bb6-30eb58a186c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:38.308218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c16d70-a435-422e-9eba-f8d1b7c95d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:38.309086 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c16d70-a435-422e-9eba-f8d1b7c95d71 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:38.309557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c16d70-a435-422e-9eba-f8d1b7c95d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:38.310042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c16d70-a435-422e-9eba-f8d1b7c95d71 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:38.310882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c16d70-a435-422e-9eba-f8d1b7c95d71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:38.312446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c16d70-a435-422e-9eba-f8d1b7c95d71 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:38.313474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ecd04-d041-4fc9-9bb6-30eb58a186c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:38.315361 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ecd04-d041-4fc9-9bb6-30eb58a186c2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:38.319231 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 391/790] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 07:01:38 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:38.320264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c16d70-a435-422e-9eba-f8d1b7c95d71 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-cc7ecd04-d041-4fc9-9bb6-30eb58a186c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:38.342657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:38.343641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:38.344573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:38.344573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:38.344573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:38.344573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:38.351920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 400/791] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:38.356383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ecd04-d041-4fc9-9bb6-30eb58a186c2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:38.362977 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:38.522815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c16d70-a435-422e-9eba-f8d1b7c95d71 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:38.559638 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:38.580250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ecd04-d041-4fc9-9bb6-30eb58a186c2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:38.588934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aa95a-b272-4209-8bff-4c9f09ea7b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:38.590171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aa95a-b272-4209-8bff-4c9f09ea7b3f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:38.590440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aa95a-b272-4209-8bff-4c9f09ea7b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:38.590744 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aa95a-b272-4209-8bff-4c9f09ea7b3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:38.608277 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5aa95a-b272-4209-8bff-4c9f09ea7b3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9d5aa95a-b272-4209-8bff-4c9f09ea7b3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:38.614016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:38.614988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:38.616082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 392/792] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:38.623058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aa95a-b272-4209-8bff-4c9f09ea7b3f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:38.630733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e6de-01af-42c0-8daf-cc5751e6efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:38.631395 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e6de-01af-42c0-8daf-cc5751e6efaf None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:38.631677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e6de-01af-42c0-8daf-cc5751e6efaf None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:38.631961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e6de-01af-42c0-8daf-cc5751e6efaf None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:38.632695 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973e6de-01af-42c0-8daf-cc5751e6efaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:38.633032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973e6de-01af-42c0-8daf-cc5751e6efaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:38.634515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973e6de-01af-42c0-8daf-cc5751e6efaf None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:38.657418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 401/793] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:38.658525 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e6de-01af-42c0-8daf-cc5751e6efaf None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:38.781278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:38.808101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aa95a-b272-4209-8bff-4c9f09ea7b3f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:38.816553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e6de-01af-42c0-8daf-cc5751e6efaf None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:38.855452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d30d85-f537-48a6-801c-dbdfc7069320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:38.856487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d30d85-f537-48a6-801c-dbdfc7069320 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:38.856995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d30d85-f537-48a6-801c-dbdfc7069320 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:38.857466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d30d85-f537-48a6-801c-dbdfc7069320 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:38.866041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d30d85-f537-48a6-801c-dbdfc7069320 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:38.867951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d30d85-f537-48a6-801c-dbdfc7069320 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:38.868060 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758e7d4-99c7-4c0f-840f-f9f4fc0b45ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:38.868694 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758e7d4-99c7-4c0f-840f-f9f4fc0b45ba None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:38.869000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758e7d4-99c7-4c0f-840f-f9f4fc0b45ba None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:38.869314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758e7d4-99c7-4c0f-840f-f9f4fc0b45ba None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:38.869997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758e7d4-99c7-4c0f-840f-f9f4fc0b45ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:38.870299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758e7d4-99c7-4c0f-840f-f9f4fc0b45ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:38.871657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758e7d4-99c7-4c0f-840f-f9f4fc0b45ba None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-b9d30d85-f537-48a6-801c-dbdfc7069320 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:38.882321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:38.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:38.884185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:38.884185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:38.884185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:38.884185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:38.884185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:38.884185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:38.884185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:38.884185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:38.886987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 402/794] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:38.894667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d30d85-f537-48a6-801c-dbdfc7069320 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:38.896490 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 393/795] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:38.903657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758e7d4-99c7-4c0f-840f-f9f4fc0b45ba None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:38.907700 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:39.085206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758e7d4-99c7-4c0f-840f-f9f4fc0b45ba None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:39.088545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d30d85-f537-48a6-801c-dbdfc7069320 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:39.151443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee4a1d-a3f2-41ed-a722-ae9496eb0df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:39.152124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4a1d-a3f2-41ed-a722-ae9496eb0df3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:39.152408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4a1d-a3f2-41ed-a722-ae9496eb0df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:39.152689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee4a1d-a3f2-41ed-a722-ae9496eb0df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:39.153946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73e6d4-4d77-49ad-bda3-94093fa3b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:39.154599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73e6d4-4d77-49ad-bda3-94093fa3b866 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:39.154877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73e6d4-4d77-49ad-bda3-94093fa3b866 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:39.155150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73e6d4-4d77-49ad-bda3-94093fa3b866 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:39.155924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73e6d4-4d77-49ad-bda3-94093fa3b866 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:39.156236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73e6d4-4d77-49ad-bda3-94093fa3b866 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:39.158094 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73e6d4-4d77-49ad-bda3-94093fa3b866 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:39.169307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:39.180418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee4a1d-a3f2-41ed-a722-ae9496eb0df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:39.181968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee4a1d-a3f2-41ed-a722-ae9496eb0df3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:39.196788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 403/796] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:39.197996 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73e6d4-4d77-49ad-bda3-94093fa3b866 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-5dee4a1d-a3f2-41ed-a722-ae9496eb0df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:39.218651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:39.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:39.220574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:39.220574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:39.220574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:39.220574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:39.221352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 394/797] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:39.228869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee4a1d-a3f2-41ed-a722-ae9496eb0df3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:39.331388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:39.399012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73e6d4-4d77-49ad-bda3-94093fa3b866 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:39.436806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee4a1d-a3f2-41ed-a722-ae9496eb0df3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:39.472062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bc82a-252c-472f-9707-cbb27a76e3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:39.472760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bc82a-252c-472f-9707-cbb27a76e3fc None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:39.473125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bc82a-252c-472f-9707-cbb27a76e3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:39.473343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bc82a-252c-472f-9707-cbb27a76e3fc None admin] PATH_INFO: `/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/0dc4cfe4a3ce4e34a1b664d99eb34d2a/roles/58b981aa32454837bd8eae9e804d811e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:39.500346 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bc82a-252c-472f-9707-cbb27a76e3fc None admin] RBAC: Authorizing `identity:create_grant(project_id=29b560f1bcf347f6b8b885cc02d52e33, user_id=0dc4cfe4a3ce4e34a1b664d99eb34d2a, role_id=58b981aa32454837bd8eae9e804d811e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:39.502374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bc82a-252c-472f-9707-cbb27a76e3fc None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:39.516106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dd24d-78d5-46aa-b0c7-0cd9643e3887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:39.518414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dd24d-78d5-46aa-b0c7-0cd9643e3887 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:39.526327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 404/798] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:01:39 2022] PUT /identity/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/0dc4cfe4a3ce4e34a1b664d99eb34d2a/roles/58b981aa32454837bd8eae9e804d811e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:01:39.527299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dd24d-78d5-46aa-b0c7-0cd9643e3887 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:39.527872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dd24d-78d5-46aa-b0c7-0cd9643e3887 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:39.529139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dd24d-78d5-46aa-b0c7-0cd9643e3887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:39.529857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dd24d-78d5-46aa-b0c7-0cd9643e3887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:39.531586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dd24d-78d5-46aa-b0c7-0cd9643e3887 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:39.552377 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 395/799] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:39.554376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bc82a-252c-472f-9707-cbb27a76e3fc None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:39.584327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61989a7e-24a5-43ef-9344-cdae443cff73 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:39.584667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61989a7e-24a5-43ef-9344-cdae443cff73 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:39.584963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61989a7e-24a5-43ef-9344-cdae443cff73 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:39.587350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 396/800] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:01:39.594731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62ca8f-ef1d-45c5-8283-df2b11e3a5a3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:39.595108 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62ca8f-ef1d-45c5-8283-df2b11e3a5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:39.595452 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62ca8f-ef1d-45c5-8283-df2b11e3a5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:39.620436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ea62ca8f-ef1d-45c5-8283-df2b11e3a5a3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:39.622455 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ea62ca8f-ef1d-45c5-8283-df2b11e3a5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:39.684847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:39.700954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bc82a-252c-472f-9707-cbb27a76e3fc None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:39.710071 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 397/801] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:39.716916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a9629-d71f-4e17-8cb7-7fdb4b877f6d None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:39.716916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a9629-d71f-4e17-8cb7-7fdb4b877f6d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:39.716916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a9629-d71f-4e17-8cb7-7fdb4b877f6d None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:39.716916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 398/802] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:39.719815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380deeb-1e95-4334-aff1-d90783205399 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:39.720352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380deeb-1e95-4334-aff1-d90783205399 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:39.720816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380deeb-1e95-4334-aff1-d90783205399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:39.729356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:39.748205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5380deeb-1e95-4334-aff1-d90783205399 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:39.749889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5380deeb-1e95-4334-aff1-d90783205399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:39.762784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e44b5b-fb37-45b2-9fc9-205ad21dc5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:39.763450 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e44b5b-fb37-45b2-9fc9-205ad21dc5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:39.763731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e44b5b-fb37-45b2-9fc9-205ad21dc5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:39.764005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e44b5b-fb37-45b2-9fc9-205ad21dc5c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:39.772721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e44b5b-fb37-45b2-9fc9-205ad21dc5c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:39.774221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e44b5b-fb37-45b2-9fc9-205ad21dc5c0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a9e44b5b-fb37-45b2-9fc9-205ad21dc5c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:39.789623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:39.790605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:39.791524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:39.791524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:39.791524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:39.791524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:39.791524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:39.791524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:39.791524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:39.791524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:39.791524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 07:01:39.791524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:39.791524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 405/803] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:39.792099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e44b5b-fb37-45b2-9fc9-205ad21dc5c0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:39.842542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 399/804] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:39.843464 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380deeb-1e95-4334-aff1-d90783205399 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:39.956004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e44b5b-fb37-45b2-9fc9-205ad21dc5c0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:39.959535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380deeb-1e95-4334-aff1-d90783205399 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:39.971626 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:39.997833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd3d9c-513c-43a9-9947-9eb4d4f859eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:39.999057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd3d9c-513c-43a9-9947-9eb4d4f859eb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:39.999716 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd3d9c-513c-43a9-9947-9eb4d4f859eb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:40.000134 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd3d9c-513c-43a9-9947-9eb4d4f859eb None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:40.001216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd3d9c-513c-43a9-9947-9eb4d4f859eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:40.001693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd3d9c-513c-43a9-9947-9eb4d4f859eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:40.003271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd3d9c-513c-43a9-9947-9eb4d4f859eb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:40.003731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e08fb5-3f93-4401-967e-c07c597385b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:40.004470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e08fb5-3f93-4401-967e-c07c597385b0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:40.004817 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e08fb5-3f93-4401-967e-c07c597385b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:40.005178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e08fb5-3f93-4401-967e-c07c597385b0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:40.006151 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e08fb5-3f93-4401-967e-c07c597385b0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:40.008485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e08fb5-3f93-4401-967e-c07c597385b0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-47e08fb5-3f93-4401-967e-c07c597385b0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:40.019456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:40.020608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 07:01:40.021680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:40.025043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 406/805] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Aug 5 07:01:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:40.026091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e08fb5-3f93-4401-967e-c07c597385b0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:40.030736 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 400/806] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Aug 5 07:01:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:40.033174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd3d9c-513c-43a9-9947-9eb4d4f859eb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:40.080930 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:40.146446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd3d9c-513c-43a9-9947-9eb4d4f859eb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:40.153388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e08fb5-3f93-4401-967e-c07c597385b0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:40.184232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa809f99-8cad-4f70-882e-0981054cdebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:40.184982 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa809f99-8cad-4f70-882e-0981054cdebb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:40.185268 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa809f99-8cad-4f70-882e-0981054cdebb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:40.185800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa809f99-8cad-4f70-882e-0981054cdebb None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:40.186616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa809f99-8cad-4f70-882e-0981054cdebb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:40.186937 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa809f99-8cad-4f70-882e-0981054cdebb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:40.188640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa809f99-8cad-4f70-882e-0981054cdebb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:40.194247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 401/807] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 5 07:01:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:40.195286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa809f99-8cad-4f70-882e-0981054cdebb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:40.198595 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b61136-3428-4854-a347-b544b94b5ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:40.200442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b61136-3428-4854-a347-b544b94b5ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:40.200995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b61136-3428-4854-a347-b544b94b5ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:40.201481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b61136-3428-4854-a347-b544b94b5ce2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:40.215264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b61136-3428-4854-a347-b544b94b5ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-11b61136-3428-4854-a347-b544b94b5ce2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:40.222083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:40.223023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:40.223854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:40.223854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:40.223854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:40.223854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:40.223854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:40.223854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:40.223854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:40.223854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:40.223854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:40.223854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:40.223854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:40.223854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:40.226373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 407/808] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:40.227923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b61136-3428-4854-a347-b544b94b5ce2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:40.235427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:40.336072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa809f99-8cad-4f70-882e-0981054cdebb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:40.358258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:40.365064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b61136-3428-4854-a347-b544b94b5ce2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:40.378625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084a3e3-4757-4d80-8179-86339ffb9d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:40.379432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084a3e3-4757-4d80-8179-86339ffb9d18 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:40.379834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084a3e3-4757-4d80-8179-86339ffb9d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:40.380249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084a3e3-4757-4d80-8179-86339ffb9d18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:40.391822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084a3e3-4757-4d80-8179-86339ffb9d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:40.393452 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084a3e3-4757-4d80-8179-86339ffb9d18 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b084a3e3-4757-4d80-8179-86339ffb9d18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:40.409496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:40.410863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:40.412103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:40.412103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:40.412103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:40.412103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:40.418460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 402/809] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:40.418460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084a3e3-4757-4d80-8179-86339ffb9d18 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:40.422905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f0e7f-5b87-4b0c-ad2d-adb9a024c6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:40.423553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f0e7f-5b87-4b0c-ad2d-adb9a024c6bc None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:40.423830 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f0e7f-5b87-4b0c-ad2d-adb9a024c6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:40.424101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f0e7f-5b87-4b0c-ad2d-adb9a024c6bc None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:40.424822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f0e7f-5b87-4b0c-ad2d-adb9a024c6bc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:40.425149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f0e7f-5b87-4b0c-ad2d-adb9a024c6bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:40.426564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f0e7f-5b87-4b0c-ad2d-adb9a024c6bc None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:40.434864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 408/810] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Aug 5 07:01:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:40.436801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f0e7f-5b87-4b0c-ad2d-adb9a024c6bc None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:40.530710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:40.551190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084a3e3-4757-4d80-8179-86339ffb9d18 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:40.569636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f0e7f-5b87-4b0c-ad2d-adb9a024c6bc None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:40.597433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5714-8392-4d6c-90a1-b2d7aa1f6296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:40.599067 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5714-8392-4d6c-90a1-b2d7aa1f6296 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:40.599558 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5714-8392-4d6c-90a1-b2d7aa1f6296 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:40.600279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a5714-8392-4d6c-90a1-b2d7aa1f6296 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:40.601629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a5714-8392-4d6c-90a1-b2d7aa1f6296 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:40.602328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a5714-8392-4d6c-90a1-b2d7aa1f6296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:40.603952 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a5714-8392-4d6c-90a1-b2d7aa1f6296 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:40.606202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a93b3c-00de-496e-86c7-c3a743f327b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:40.607115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a93b3c-00de-496e-86c7-c3a743f327b9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:40.607357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a93b3c-00de-496e-86c7-c3a743f327b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:40.607727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a93b3c-00de-496e-86c7-c3a743f327b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:40.608551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a93b3c-00de-496e-86c7-c3a743f327b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:40.608986 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a93b3c-00de-496e-86c7-c3a743f327b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:40.610543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a93b3c-00de-496e-86c7-c3a743f327b9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:40.615569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 403/811] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:40.616569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5714-8392-4d6c-90a1-b2d7aa1f6296 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:40.633367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 409/812] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:40.633367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a93b3c-00de-496e-86c7-c3a743f327b9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:40.669081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:40.735504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a5714-8392-4d6c-90a1-b2d7aa1f6296 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:40.764366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a93b3c-00de-496e-86c7-c3a743f327b9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:40.775326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da49875-3ca6-45a2-87b9-c72dd0d46e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:40.776320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da49875-3ca6-45a2-87b9-c72dd0d46e18 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:40.776792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da49875-3ca6-45a2-87b9-c72dd0d46e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:40.777279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da49875-3ca6-45a2-87b9-c72dd0d46e18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:40.778176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da49875-3ca6-45a2-87b9-c72dd0d46e18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:40.779712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da49875-3ca6-45a2-87b9-c72dd0d46e18 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:40.804737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1319f72-ef49-46dc-a76a-c5d12480a972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:40.805424 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 404/813] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:01:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:01:40.805892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1319f72-ef49-46dc-a76a-c5d12480a972 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:40.806267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da49875-3ca6-45a2-87b9-c72dd0d46e18 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:40.806492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1319f72-ef49-46dc-a76a-c5d12480a972 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:40.807826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1319f72-ef49-46dc-a76a-c5d12480a972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:40.811597 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:40.826559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1319f72-ef49-46dc-a76a-c5d12480a972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:40.828630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1319f72-ef49-46dc-a76a-c5d12480a972 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d1319f72-ef49-46dc-a76a-c5d12480a972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:40.847306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:40.848387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:40.849336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:40.849336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:40.849336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:40.849336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:40.856783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 410/814] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:40.858651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095007a-be27-4e0e-9362-518da5af04b5 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:40.859100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095007a-be27-4e0e-9362-518da5af04b5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:40.859555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095007a-be27-4e0e-9362-518da5af04b5 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:40.861867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 411/815] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:40.862729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095007a-be27-4e0e-9362-518da5af04b5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:40.954574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da49875-3ca6-45a2-87b9-c72dd0d46e18 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:40.981547 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:40.999185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5d29f-6c47-470a-8774-3ed9d88a0bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:40.999641 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d29f-6c47-470a-8774-3ed9d88a0bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:41.000018 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d29f-6c47-470a-8774-3ed9d88a0bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:41.000392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d29f-6c47-470a-8774-3ed9d88a0bb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:41.011288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5d29f-6c47-470a-8774-3ed9d88a0bb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:41.012811 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5d29f-6c47-470a-8774-3ed9d88a0bb2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:41.015050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095007a-be27-4e0e-9362-518da5af04b5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4ae5d29f-6c47-470a-8774-3ed9d88a0bb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:41.026682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:41.027651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:41.028521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:41.028521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:41.028521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:41.028521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:41.028521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:41.028521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:41.028521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:41.028521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:41.028521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 405/816] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:41.035317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf0761-5236-4e1e-be37-7c42352b2f43 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:41.035317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf0761-5236-4e1e-be37-7c42352b2f43 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:41.035317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf0761-5236-4e1e-be37-7c42352b2f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:41.052808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-52cf0761-5236-4e1e-be37-7c42352b2f43 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:41.054056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-52cf0761-5236-4e1e-be37-7c42352b2f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:41.072316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c107a88-8f43-4673-90f0-e85f84759c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:41.072870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c107a88-8f43-4673-90f0-e85f84759c81 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:41.073235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c107a88-8f43-4673-90f0-e85f84759c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:41.074389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c107a88-8f43-4673-90f0-e85f84759c81 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:41.074389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c107a88-8f43-4673-90f0-e85f84759c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:41.074678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c107a88-8f43-4673-90f0-e85f84759c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:41.077485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c107a88-8f43-4673-90f0-e85f84759c81 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:41.094605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 412/817] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:41.095560 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c107a88-8f43-4673-90f0-e85f84759c81 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:41.132830 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:41.144602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 406/818] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:41.145953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf0761-5236-4e1e-be37-7c42352b2f43 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:41.235338 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c107a88-8f43-4673-90f0-e85f84759c81 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:41.287107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d0d1b-e94c-416a-9aaa-d288a838b01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:41.288539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d0d1b-e94c-416a-9aaa-d288a838b01a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:41.289047 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d0d1b-e94c-416a-9aaa-d288a838b01a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:41.289590 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d0d1b-e94c-416a-9aaa-d288a838b01a None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:41.290672 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d0d1b-e94c-416a-9aaa-d288a838b01a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:41.291259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d0d1b-e94c-416a-9aaa-d288a838b01a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:41.293127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d0d1b-e94c-416a-9aaa-d288a838b01a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:41.297005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:41.309849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 413/819] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:41.310860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d0d1b-e94c-416a-9aaa-d288a838b01a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:41.316118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf0761-5236-4e1e-be37-7c42352b2f43 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:41.363102 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1713c1f-5d3f-4ae1-a3b1-67af66a72232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:41.363514 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1713c1f-5d3f-4ae1-a3b1-67af66a72232 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:41.363797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1713c1f-5d3f-4ae1-a3b1-67af66a72232 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:41.364070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1713c1f-5d3f-4ae1-a3b1-67af66a72232 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:41.373258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1713c1f-5d3f-4ae1-a3b1-67af66a72232 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:41.374777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1713c1f-5d3f-4ae1-a3b1-67af66a72232 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b1713c1f-5d3f-4ae1-a3b1-67af66a72232 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:41.389044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:41.390280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:41.391267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:41.391267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:41.391267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:41.391267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:41.391267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:41.391267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:41.391267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:41.391267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:41.391267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:01:41.391267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:41.395211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 407/820] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 07:01:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:41.396148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1713c1f-5d3f-4ae1-a3b1-67af66a72232 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:41.445032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d0d1b-e94c-416a-9aaa-d288a838b01a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:41.464786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:41.500308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29446cbd-564d-47b1-85d3-8dd1165d15f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:41.501502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446cbd-564d-47b1-85d3-8dd1165d15f8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:41.501502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446cbd-564d-47b1-85d3-8dd1165d15f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:41.501718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446cbd-564d-47b1-85d3-8dd1165d15f8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:41.502358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29446cbd-564d-47b1-85d3-8dd1165d15f8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:41.503753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29446cbd-564d-47b1-85d3-8dd1165d15f8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-29446cbd-564d-47b1-85d3-8dd1165d15f8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:41.514753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:41.515785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 07:01:41.516678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:41.521123 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 414/821] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:41 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:41.522108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29446cbd-564d-47b1-85d3-8dd1165d15f8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:41.535633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1713c1f-5d3f-4ae1-a3b1-67af66a72232 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:41.581672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0502ab-04fc-4838-b17e-71713a44ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:41.582720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0502ab-04fc-4838-b17e-71713a44ba25 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:41.583752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0502ab-04fc-4838-b17e-71713a44ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:41.584226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0502ab-04fc-4838-b17e-71713a44ba25 None admin] PATH_INFO: `/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/8d83b456cec84bc5ab02a190099c0baf/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:41.587101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0502ab-04fc-4838-b17e-71713a44ba25 None admin] RBAC: Authorizing `identity:create_grant(project_id=29b560f1bcf347f6b8b885cc02d52e33, user_id=8d83b456cec84bc5ab02a190099c0baf, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:41.589447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0502ab-04fc-4838-b17e-71713a44ba25 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:41.590985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:41.610713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 408/822] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:01:41 2022] PUT /identity/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/8d83b456cec84bc5ab02a190099c0baf/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:01:41.612010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0502ab-04fc-4838-b17e-71713a44ba25 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:41.647090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29446cbd-564d-47b1-85d3-8dd1165d15f8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:41.698502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea9bd4-8258-4c92-a856-8984ccca6721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:41.699445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea9bd4-8258-4c92-a856-8984ccca6721 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:41.699917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea9bd4-8258-4c92-a856-8984ccca6721 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:41.700358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea9bd4-8258-4c92-a856-8984ccca6721 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:41.701636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea9bd4-8258-4c92-a856-8984ccca6721 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:41.702124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea9bd4-8258-4c92-a856-8984ccca6721 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:41.704825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea9bd4-8258-4c92-a856-8984ccca6721 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:41.731258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 415/823] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 07:01:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:41.738297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea9bd4-8258-4c92-a856-8984ccca6721 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:41.747178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0502ab-04fc-4838-b17e-71713a44ba25 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:41.758605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:41.791263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379356d0-c806-4e3b-b3e3-40d65390fa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:41.791650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379356d0-c806-4e3b-b3e3-40d65390fa6a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:41.791907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379356d0-c806-4e3b-b3e3-40d65390fa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:41.792184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379356d0-c806-4e3b-b3e3-40d65390fa6a None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:41.792909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379356d0-c806-4e3b-b3e3-40d65390fa6a None admin] RBAC: Adding query filter params (name=network) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:41.793224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379356d0-c806-4e3b-b3e3-40d65390fa6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:41.794635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379356d0-c806-4e3b-b3e3-40d65390fa6a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:41.809841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 409/824] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:01:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:41.811817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd44ed-3134-46e8-b19a-6a2aeb2530cf None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:41.812104 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd44ed-3134-46e8-b19a-6a2aeb2530cf None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:41.812381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd44ed-3134-46e8-b19a-6a2aeb2530cf None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:41.816981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 410/825] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:41.818481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd44ed-3134-46e8-b19a-6a2aeb2530cf None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:41.885471 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea9bd4-8258-4c92-a856-8984ccca6721 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:41.906200 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:41.929449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26964e-1cc2-46ff-8461-e82e27f88085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:41.930089 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26964e-1cc2-46ff-8461-e82e27f88085 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:41.930371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26964e-1cc2-46ff-8461-e82e27f88085 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:41.930642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26964e-1cc2-46ff-8461-e82e27f88085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:41.958372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd44ed-3134-46e8-b19a-6a2aeb2530cf None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:42.005179 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca6f37-f9ed-44f5-be39-8630c6012571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:42.005829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca6f37-f9ed-44f5-be39-8630c6012571 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:42.006347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca6f37-f9ed-44f5-be39-8630c6012571 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:42.006633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca6f37-f9ed-44f5-be39-8630c6012571 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:42.007699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca6f37-f9ed-44f5-be39-8630c6012571 None admin] RBAC: Adding query filter params (type=network) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:42.008271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca6f37-f9ed-44f5-be39-8630c6012571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:42.009828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca6f37-f9ed-44f5-be39-8630c6012571 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:42.014388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26964e-1cc2-46ff-8461-e82e27f88085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:42.015858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26964e-1cc2-46ff-8461-e82e27f88085 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:42.017005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 411/826] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:01:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:42.018684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f42c1-e1fb-4401-bb1d-f46051160243 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:42.018972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f42c1-e1fb-4401-bb1d-f46051160243 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:42.020216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f42c1-e1fb-4401-bb1d-f46051160243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:42.043297 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-928f42c1-e1fb-4401-bb1d-f46051160243 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:42.045237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-928f42c1-e1fb-4401-bb1d-f46051160243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:42.088793 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:42.136554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 416/827] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:01:42.137485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26964e-1cc2-46ff-8461-e82e27f88085 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:42.137652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 412/828] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:42.146849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f42c1-e1fb-4401-bb1d-f46051160243 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:42.173975 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:42.269023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26964e-1cc2-46ff-8461-e82e27f88085 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:42.273385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f42c1-e1fb-4401-bb1d-f46051160243 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:42.305824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32b092-0660-4b93-a0a2-a8badd4b4e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:42.306458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b092-0660-4b93-a0a2-a8badd4b4e3f None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:42.306734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b092-0660-4b93-a0a2-a8badd4b4e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:42.307002 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b092-0660-4b93-a0a2-a8badd4b4e3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:42.307714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32b092-0660-4b93-a0a2-a8badd4b4e3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:42.309128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32b092-0660-4b93-a0a2-a8badd4b4e3f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:42.324235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9430a-5278-4aad-aa44-a6a0921e6131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:42.325593 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9430a-5278-4aad-aa44-a6a0921e6131 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:42.326045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9430a-5278-4aad-aa44-a6a0921e6131 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:42.326522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9430a-5278-4aad-aa44-a6a0921e6131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:42.334029 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 417/829] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:01:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:01:42.335158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32b092-0660-4b93-a0a2-a8badd4b4e3f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:42.341633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9430a-5278-4aad-aa44-a6a0921e6131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:42.343605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9430a-5278-4aad-aa44-a6a0921e6131 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-35b9430a-5278-4aad-aa44-a6a0921e6131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:42.365106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:42.366079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:42.366995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:42.366995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:42.366995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:42.366995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:42.369508 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 413/830] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:42.375323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9430a-5278-4aad-aa44-a6a0921e6131 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:42.408320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:42.498950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:42.536692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32b092-0660-4b93-a0a2-a8badd4b4e3f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:42.574173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979a340-de5b-44db-ae29-f17c521010e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:42.575261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979a340-de5b-44db-ae29-f17c521010e1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:42.575737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979a340-de5b-44db-ae29-f17c521010e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:42.576254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979a340-de5b-44db-ae29-f17c521010e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:42.582090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9430a-5278-4aad-aa44-a6a0921e6131 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:42.590843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979a340-de5b-44db-ae29-f17c521010e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9979a340-de5b-44db-ae29-f17c521010e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:42.596925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:42.597974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:42.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:42.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:42.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:42.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:42.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:42.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:42.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:42.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:42.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:42.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:42.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:01:42.598820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:42.601612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 418/831] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:01:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:42.608576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979a340-de5b-44db-ae29-f17c521010e1 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:42.625620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685f2bb-4ecf-4b71-a014-96cd7b5928ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:42.626263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685f2bb-4ecf-4b71-a014-96cd7b5928ea None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:42.626538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685f2bb-4ecf-4b71-a014-96cd7b5928ea None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:42.626808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685f2bb-4ecf-4b71-a014-96cd7b5928ea None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:42.627613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685f2bb-4ecf-4b71-a014-96cd7b5928ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:42.627919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685f2bb-4ecf-4b71-a014-96cd7b5928ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:42.629405 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685f2bb-4ecf-4b71-a014-96cd7b5928ea None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:42.644184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 414/832] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:42.649857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685f2bb-4ecf-4b71-a014-96cd7b5928ea None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:42.726744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979a340-de5b-44db-ae29-f17c521010e1 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:42.738229 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:42.760967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:42.766580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685f2bb-4ecf-4b71-a014-96cd7b5928ea None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:42.769160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf69f4-4dc7-4a59-8ad3-c1a12f5b62fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:42.770143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf69f4-4dc7-4a59-8ad3-c1a12f5b62fd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:42.770637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf69f4-4dc7-4a59-8ad3-c1a12f5b62fd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:42.771169 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf69f4-4dc7-4a59-8ad3-c1a12f5b62fd None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:42.772125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf69f4-4dc7-4a59-8ad3-c1a12f5b62fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:42.772634 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf69f4-4dc7-4a59-8ad3-c1a12f5b62fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:42.774284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf69f4-4dc7-4a59-8ad3-c1a12f5b62fd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:42.784631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 419/833] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:01:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:42.791252 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf69f4-4dc7-4a59-8ad3-c1a12f5b62fd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:42.807312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa055f00-5b5b-4fc9-ad0b-c846f5b7a442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:42.808014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa055f00-5b5b-4fc9-ad0b-c846f5b7a442 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:42.808298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa055f00-5b5b-4fc9-ad0b-c846f5b7a442 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:42.808623 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa055f00-5b5b-4fc9-ad0b-c846f5b7a442 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:42.816185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa055f00-5b5b-4fc9-ad0b-c846f5b7a442 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:42.817689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa055f00-5b5b-4fc9-ad0b-c846f5b7a442 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-fa055f00-5b5b-4fc9-ad0b-c846f5b7a442 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:42.829775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:42.830741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:42.831625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:42.831625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:42.831625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:42.831625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:42.831625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:42.831625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:42.831625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:42.831625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:42.831625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 415/834] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:42.837003 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa055f00-5b5b-4fc9-ad0b-c846f5b7a442 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:42.913818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf69f4-4dc7-4a59-8ad3-c1a12f5b62fd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:42.945379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa055f00-5b5b-4fc9-ad0b-c846f5b7a442 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:42.954219 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89461f01-b0fd-43b9-95ae-f16e0f56cfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:42.955308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89461f01-b0fd-43b9-95ae-f16e0f56cfbb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:42.955813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89461f01-b0fd-43b9-95ae-f16e0f56cfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:42.956298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89461f01-b0fd-43b9-95ae-f16e0f56cfbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:42.969365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89461f01-b0fd-43b9-95ae-f16e0f56cfbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:42.971328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89461f01-b0fd-43b9-95ae-f16e0f56cfbb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:42.981090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f986b-a928-4dcd-9f66-8dd8484c117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:42.981651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f986b-a928-4dcd-9f66-8dd8484c117a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:42.981921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f986b-a928-4dcd-9f66-8dd8484c117a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:42.982192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f986b-a928-4dcd-9f66-8dd8484c117a None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:42.982996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f986b-a928-4dcd-9f66-8dd8484c117a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:42.983303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f986b-a928-4dcd-9f66-8dd8484c117a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:42.984804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f986b-a928-4dcd-9f66-8dd8484c117a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-89461f01-b0fd-43b9-95ae-f16e0f56cfbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:42.989782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:42.990678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:42.991559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:42.991559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:42.991559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:42.991559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:42.992616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:42.996702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 420/835] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:43.002639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89461f01-b0fd-43b9-95ae-f16e0f56cfbb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:43.005870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 416/836] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:43.012008 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f986b-a928-4dcd-9f66-8dd8484c117a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:43.064399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:43.131195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89461f01-b0fd-43b9-95ae-f16e0f56cfbb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:43.144715 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f986b-a928-4dcd-9f66-8dd8484c117a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:43.170639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36724d-ed59-46eb-bc64-8e44a7e8958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:43.171418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36724d-ed59-46eb-bc64-8e44a7e8958e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:43.171809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36724d-ed59-46eb-bc64-8e44a7e8958e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:43.172125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36724d-ed59-46eb-bc64-8e44a7e8958e None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:43.180582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36724d-ed59-46eb-bc64-8e44a7e8958e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:43.180582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36724d-ed59-46eb-bc64-8e44a7e8958e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:43.180582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36724d-ed59-46eb-bc64-8e44a7e8958e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:43.182178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce96c5-9888-48ba-b01a-bc6e71cc0825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:43.182879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce96c5-9888-48ba-b01a-bc6e71cc0825 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:43.183155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce96c5-9888-48ba-b01a-bc6e71cc0825 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:43.183420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce96c5-9888-48ba-b01a-bc6e71cc0825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:43.184223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce96c5-9888-48ba-b01a-bc6e71cc0825 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=555de6e5c8c44f40a6433b3d2ffc52f3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:43.184528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce96c5-9888-48ba-b01a-bc6e71cc0825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:43.185986 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce96c5-9888-48ba-b01a-bc6e71cc0825 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:43.192249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 417/837] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:43 2022] GET /identity/v3/role_assignments?user.id=555de6e5c8c44f40a6433b3d2ffc52f3&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:43.193465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cdb09-0154-40e5-be83-4b37602ef717 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:43.193843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cdb09-0154-40e5-be83-4b37602ef717 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:43.194118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cdb09-0154-40e5-be83-4b37602ef717 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:43.199633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 418/838] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:43.201117 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c1a33-59fe-45f1-b7f2-9d61bed34740 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:43.201402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c1a33-59fe-45f1-b7f2-9d61bed34740 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:43.201677 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c1a33-59fe-45f1-b7f2-9d61bed34740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:43.211129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 421/839] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:43.216787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36724d-ed59-46eb-bc64-8e44a7e8958e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:43.221703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b81c1a33-59fe-45f1-b7f2-9d61bed34740 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:43.222941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b81c1a33-59fe-45f1-b7f2-9d61bed34740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:43.303329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:43.321311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 419/840] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:43.340728 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c1a33-59fe-45f1-b7f2-9d61bed34740 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:43.363159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36724d-ed59-46eb-bc64-8e44a7e8958e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:43.373377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:43.417552 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727c7d9-a870-48dd-8f7e-d5d7f31c8cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:43.418213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727c7d9-a870-48dd-8f7e-d5d7f31c8cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:43.418500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727c7d9-a870-48dd-8f7e-d5d7f31c8cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:43.418773 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727c7d9-a870-48dd-8f7e-d5d7f31c8cc3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:43.429840 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727c7d9-a870-48dd-8f7e-d5d7f31c8cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:43.430613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727c7d9-a870-48dd-8f7e-d5d7f31c8cc3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a727c7d9-a870-48dd-8f7e-d5d7f31c8cc3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:43.443842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:43.444845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:43.445892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:43.445892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:43.445892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:43.445892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:43.445892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:43.445892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:43.445892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:43.445892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:43.445892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 07:01:43.445892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:43.445892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 422/841] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 07:01:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:43.451141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727c7d9-a870-48dd-8f7e-d5d7f31c8cc3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:43.473447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c1a33-59fe-45f1-b7f2-9d61bed34740 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:43.511987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b18a93-4254-41d4-8c3e-37df54c56188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:43.512635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b18a93-4254-41d4-8c3e-37df54c56188 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:43.512944 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b18a93-4254-41d4-8c3e-37df54c56188 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:43.513209 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b18a93-4254-41d4-8c3e-37df54c56188 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:43.513843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b18a93-4254-41d4-8c3e-37df54c56188 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:43.515294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b18a93-4254-41d4-8c3e-37df54c56188 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-99b18a93-4254-41d4-8c3e-37df54c56188 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:43.524768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:43.525898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:43.526723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 420/842] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:01:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:43.532586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b18a93-4254-41d4-8c3e-37df54c56188 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:43.585065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727c7d9-a870-48dd-8f7e-d5d7f31c8cc3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:43.602461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:43.629632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4ce5e-6580-45c2-bcec-f25bd72655af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:43.630426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4ce5e-6580-45c2-bcec-f25bd72655af None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:43.630811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4ce5e-6580-45c2-bcec-f25bd72655af None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:43.631189 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4ce5e-6580-45c2-bcec-f25bd72655af None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:43.632466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4ce5e-6580-45c2-bcec-f25bd72655af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:43.632883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4ce5e-6580-45c2-bcec-f25bd72655af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:43.635044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4ce5e-6580-45c2-bcec-f25bd72655af None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:43.657384 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b18a93-4254-41d4-8c3e-37df54c56188 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:43.660940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 423/843] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Aug 5 07:01:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:43.664631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4ce5e-6580-45c2-bcec-f25bd72655af None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:43.697498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:43.700349 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38653a7-4fe0-4df1-9b7e-e580011084a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:43.700982 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38653a7-4fe0-4df1-9b7e-e580011084a7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:43.701278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38653a7-4fe0-4df1-9b7e-e580011084a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:43.701558 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38653a7-4fe0-4df1-9b7e-e580011084a7 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:43.702333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38653a7-4fe0-4df1-9b7e-e580011084a7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:43.702644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38653a7-4fe0-4df1-9b7e-e580011084a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:43.704064 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38653a7-4fe0-4df1-9b7e-e580011084a7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:43.709532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 421/844] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:01:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:43.714805 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38653a7-4fe0-4df1-9b7e-e580011084a7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:43.802538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4ce5e-6580-45c2-bcec-f25bd72655af None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:43.843242 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1809570-46ec-4a63-a531-70b58d9e20d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:43.843916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38653a7-4fe0-4df1-9b7e-e580011084a7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:43.844529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809570-46ec-4a63-a531-70b58d9e20d0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:43.845073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809570-46ec-4a63-a531-70b58d9e20d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:43.845821 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809570-46ec-4a63-a531-70b58d9e20d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:43.870899 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:43.887321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82dd19-2f2e-4dcf-b88c-09f425dc680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:43.888293 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82dd19-2f2e-4dcf-b88c-09f425dc680d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:43.888795 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82dd19-2f2e-4dcf-b88c-09f425dc680d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:43.889310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82dd19-2f2e-4dcf-b88c-09f425dc680d None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:43.890184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82dd19-2f2e-4dcf-b88c-09f425dc680d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:43.890681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82dd19-2f2e-4dcf-b88c-09f425dc680d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:43.892298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82dd19-2f2e-4dcf-b88c-09f425dc680d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:43.897583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 422/845] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:01:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:43.931329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1809570-46ec-4a63-a531-70b58d9e20d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:43.933285 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c29c5-6b66-4e3a-b373-aaaf207b9d14 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:43.933790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c29c5-6b66-4e3a-b373-aaaf207b9d14 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:43.934264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c29c5-6b66-4e3a-b373-aaaf207b9d14 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:43.934583 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1809570-46ec-4a63-a531-70b58d9e20d0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:43.936395 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 423/846] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:43.942298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ae819-9243-40a3-8ef2-2c6aa527ac40 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:43.942611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ae819-9243-40a3-8ef2-2c6aa527ac40 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:43.942850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ae819-9243-40a3-8ef2-2c6aa527ac40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:43.961910 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-922ae819-9243-40a3-8ef2-2c6aa527ac40 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:43.963150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-922ae819-9243-40a3-8ef2-2c6aa527ac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:43.969637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:44.052735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 424/847] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:44.069142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 424/848] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 07:01:44.074484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ae819-9243-40a3-8ef2-2c6aa527ac40 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:44.080528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1809570-46ec-4a63-a531-70b58d9e20d0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:44.212176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ae819-9243-40a3-8ef2-2c6aa527ac40 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:44.239710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:44.248127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1809570-46ec-4a63-a531-70b58d9e20d0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:44.277519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:44.289450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577992-b1e9-417f-a215-7362c6df05b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:44.290129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577992-b1e9-417f-a215-7362c6df05b2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:44.290409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577992-b1e9-417f-a215-7362c6df05b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:44.290682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577992-b1e9-417f-a215-7362c6df05b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:44.294243 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036b00a-32f2-4678-91b9-2dffb17937fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:44.295134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036b00a-32f2-4678-91b9-2dffb17937fd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:44.295639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036b00a-32f2-4678-91b9-2dffb17937fd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:44.296100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036b00a-32f2-4678-91b9-2dffb17937fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:44.302429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50577992-b1e9-417f-a215-7362c6df05b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:44.303898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50577992-b1e9-417f-a215-7362c6df05b2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:44.313297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036b00a-32f2-4678-91b9-2dffb17937fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-1036b00a-32f2-4678-91b9-2dffb17937fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:44.320781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:44.321766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:44.322744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:44.322744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:44.322744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:44.322744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:44.322744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:44.322744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:44.322744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:44.322744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:44.322744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:44.322744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:44.322744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:01:44.322744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-50577992-b1e9-417f-a215-7362c6df05b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:44.323554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:44.324470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:44.325545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:44.325545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:44.325545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:44.325545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:44.325545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 425/849] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:44.327789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 425/850] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:44.328010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577992-b1e9-417f-a215-7362c6df05b2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:44.334516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036b00a-32f2-4678-91b9-2dffb17937fd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:44.461973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036b00a-32f2-4678-91b9-2dffb17937fd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:44.484006 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577992-b1e9-417f-a215-7362c6df05b2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:44.499877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16784af5-96ac-48f8-95dc-74d7be4b552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:44.500479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784af5-96ac-48f8-95dc-74d7be4b552b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:44.500843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784af5-96ac-48f8-95dc-74d7be4b552b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:44.501197 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784af5-96ac-48f8-95dc-74d7be4b552b None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:44.501985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16784af5-96ac-48f8-95dc-74d7be4b552b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:44.502293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16784af5-96ac-48f8-95dc-74d7be4b552b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:44.503677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16784af5-96ac-48f8-95dc-74d7be4b552b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:44.517175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 426/851] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:44.518176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16784af5-96ac-48f8-95dc-74d7be4b552b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:44.528172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b5b86-f293-45f2-88b5-37948ff24405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:44.529158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b5b86-f293-45f2-88b5-37948ff24405 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:44.529963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b5b86-f293-45f2-88b5-37948ff24405 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:44.530410 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b5b86-f293-45f2-88b5-37948ff24405 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:44.531585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b5b86-f293-45f2-88b5-37948ff24405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:44.532434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b5b86-f293-45f2-88b5-37948ff24405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:44.534193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b5b86-f293-45f2-88b5-37948ff24405 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:44.551257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 426/852] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:44.557010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b5b86-f293-45f2-88b5-37948ff24405 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:44.570082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:44.589895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:44.642214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16784af5-96ac-48f8-95dc-74d7be4b552b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:44.673220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b5b86-f293-45f2-88b5-37948ff24405 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:44.684569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e9ba7-403e-452e-bb5c-de2d6a7dda25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:44.685259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e9ba7-403e-452e-bb5c-de2d6a7dda25 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:44.685546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e9ba7-403e-452e-bb5c-de2d6a7dda25 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:44.685823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e9ba7-403e-452e-bb5c-de2d6a7dda25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:44.699686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e9ba7-403e-452e-bb5c-de2d6a7dda25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:44.701687 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e9ba7-403e-452e-bb5c-de2d6a7dda25 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:44.713042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bf92f-9703-49cb-a625-598a276e87dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:44.714066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bf92f-9703-49cb-a625-598a276e87dd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:44.714571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bf92f-9703-49cb-a625-598a276e87dd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:44.715041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bf92f-9703-49cb-a625-598a276e87dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-717e9ba7-403e-452e-bb5c-de2d6a7dda25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:44.719442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:44.720331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:44.721265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:44.721265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:44.721265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:44.721265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:44.725047 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 427/853] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:44.726408 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e9ba7-403e-452e-bb5c-de2d6a7dda25 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:44.727310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bf92f-9703-49cb-a625-598a276e87dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:44.729427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bf92f-9703-49cb-a625-598a276e87dd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2a4bf92f-9703-49cb-a625-598a276e87dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:44.743078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:44.743998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:44.744931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:44.744931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:44.744931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:44.744931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:44.744931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:44.744931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:44.744931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:44.744931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:44.747599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 427/854] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:44.753201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bf92f-9703-49cb-a625-598a276e87dd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:44.849643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:44.852976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:44.860998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e9ba7-403e-452e-bb5c-de2d6a7dda25 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:44.871311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bf92f-9703-49cb-a625-598a276e87dd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:44.902375 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a36c65-f9f7-40d2-a188-cd9ec90ac031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:44.903608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a36c65-f9f7-40d2-a188-cd9ec90ac031 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:44.904162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a36c65-f9f7-40d2-a188-cd9ec90ac031 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:44.904652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a36c65-f9f7-40d2-a188-cd9ec90ac031 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:44.905680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a36c65-f9f7-40d2-a188-cd9ec90ac031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:44.906247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a36c65-f9f7-40d2-a188-cd9ec90ac031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:44.908147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a36c65-f9f7-40d2-a188-cd9ec90ac031 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:44.913043 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be026753-8c26-481e-b35f-a6a111f6ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:44.913716 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be026753-8c26-481e-b35f-a6a111f6ddfc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:44.913985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be026753-8c26-481e-b35f-a6a111f6ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:44.914286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be026753-8c26-481e-b35f-a6a111f6ddfc None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:44.915036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be026753-8c26-481e-b35f-a6a111f6ddfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:44.915347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be026753-8c26-481e-b35f-a6a111f6ddfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:44.916817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be026753-8c26-481e-b35f-a6a111f6ddfc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:44.926373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 428/855] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:44.933317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a36c65-f9f7-40d2-a188-cd9ec90ac031 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:44.945135 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 428/856] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:44.946981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be026753-8c26-481e-b35f-a6a111f6ddfc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:45.058792 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a36c65-f9f7-40d2-a188-cd9ec90ac031 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:45.062074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be026753-8c26-481e-b35f-a6a111f6ddfc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:45.106755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef53e1-6f58-4e26-9500-88d0e722db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:45.107001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408235ba-99be-45f3-a583-7619de71e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:45.107374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef53e1-6f58-4e26-9500-88d0e722db57 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:45.107653 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef53e1-6f58-4e26-9500-88d0e722db57 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:45.107752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408235ba-99be-45f3-a583-7619de71e70a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:45.107926 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef53e1-6f58-4e26-9500-88d0e722db57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:45.108034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408235ba-99be-45f3-a583-7619de71e70a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:45.108195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408235ba-99be-45f3-a583-7619de71e70a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:45.108753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef53e1-6f58-4e26-9500-88d0e722db57 None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=0dc4cfe4a3ce4e34a1b664d99eb34d2a) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:45.109037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef53e1-6f58-4e26-9500-88d0e722db57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:45.110888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef53e1-6f58-4e26-9500-88d0e722db57 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:45.117061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408235ba-99be-45f3-a583-7619de71e70a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:45.118517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 429/857] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:44 2022] GET /identity/v3/role_assignments?user.id=0dc4cfe4a3ce4e34a1b664d99eb34d2a&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:45.118657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408235ba-99be-45f3-a583-7619de71e70a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-408235ba-99be-45f3-a583-7619de71e70a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:45.136206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:45.137406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:45.138496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:45.138496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:45.138496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:45.138496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:45.138496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:45.138496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:45.138496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:45.138496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:45.138496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 07:01:45.138496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:45.138496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 429/858] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:01:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:45.144042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef53e1-6f58-4e26-9500-88d0e722db57 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:45.161347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:45.261515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef53e1-6f58-4e26-9500-88d0e722db57 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:45.299984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6311877-b0a3-4736-95d5-9b270a95b32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:45.300648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6311877-b0a3-4736-95d5-9b270a95b32b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:45.300922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6311877-b0a3-4736-95d5-9b270a95b32b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:45.301200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6311877-b0a3-4736-95d5-9b270a95b32b None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:45.302009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6311877-b0a3-4736-95d5-9b270a95b32b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:45.302317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6311877-b0a3-4736-95d5-9b270a95b32b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:45.303780 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6311877-b0a3-4736-95d5-9b270a95b32b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:45.322826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 430/859] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Aug 5 07:01:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:45.328418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408235ba-99be-45f3-a583-7619de71e70a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:45.351054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:45.374023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279dbe-1071-49bd-a334-bfcf08fd3f26 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:45.374355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279dbe-1071-49bd-a334-bfcf08fd3f26 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:45.374633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279dbe-1071-49bd-a334-bfcf08fd3f26 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:45.376237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 431/860] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:01:45.381635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf6cfe-7930-433b-82ae-59b1659cfa98 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:45.381838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf6cfe-7930-433b-82ae-59b1659cfa98 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:45.382110 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf6cfe-7930-433b-82ae-59b1659cfa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:45.403304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cecf6cfe-7930-433b-82ae-59b1659cfa98 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:45.404503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cecf6cfe-7930-433b-82ae-59b1659cfa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:45.453823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408235ba-99be-45f3-a583-7619de71e70a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:45.489228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:45.496252 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a3242-8604-436c-8ae6-50a4be38041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:45.497012 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 432/861] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:45.497370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a3242-8604-436c-8ae6-50a4be38041f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:45.497790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a3242-8604-436c-8ae6-50a4be38041f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:45.504915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a3242-8604-436c-8ae6-50a4be38041f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:45.521882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf6cfe-7930-433b-82ae-59b1659cfa98 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:45.606145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a3242-8604-436c-8ae6-50a4be38041f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:45.607212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a3242-8604-436c-8ae6-50a4be38041f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:45.625482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:45.638131 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf6cfe-7930-433b-82ae-59b1659cfa98 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:45.675758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4b80c-51af-4a85-952a-4853bb00ffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:45.676836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4b80c-51af-4a85-952a-4853bb00ffef None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:45.677341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4b80c-51af-4a85-952a-4853bb00ffef None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:45.677826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4b80c-51af-4a85-952a-4853bb00ffef None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:45.678655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4b80c-51af-4a85-952a-4853bb00ffef None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:45.680226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4b80c-51af-4a85-952a-4853bb00ffef None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-33c4b80c-51af-4a85-952a-4853bb00ffef None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:45.689992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:45.690940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 07:01:45.691810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:45.699704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 433/862] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Aug 5 07:01:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:45.700840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4b80c-51af-4a85-952a-4853bb00ffef None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:45.716377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 430/863] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:45 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:01:45.722405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a3242-8604-436c-8ae6-50a4be38041f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:45.767152 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:45.810912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4b80c-51af-4a85-952a-4853bb00ffef None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:45.849836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6e8d3-9117-4492-b9d1-e0d91cea88e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:45.850833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6e8d3-9117-4492-b9d1-e0d91cea88e7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:45.851259 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6e8d3-9117-4492-b9d1-e0d91cea88e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:45.851692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6e8d3-9117-4492-b9d1-e0d91cea88e7 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:45.852530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6e8d3-9117-4492-b9d1-e0d91cea88e7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:45.853002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6e8d3-9117-4492-b9d1-e0d91cea88e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:45.854565 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6e8d3-9117-4492-b9d1-e0d91cea88e7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:45.864978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 434/864] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 07:01:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:45.865737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a3242-8604-436c-8ae6-50a4be38041f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:45.866292 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6e8d3-9117-4492-b9d1-e0d91cea88e7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:45.885299 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:45.904436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71612042-01a1-42c6-8774-ff111ad867e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:45.905290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71612042-01a1-42c6-8774-ff111ad867e5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:45.905667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71612042-01a1-42c6-8774-ff111ad867e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:45.906042 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71612042-01a1-42c6-8774-ff111ad867e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:45.918158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71612042-01a1-42c6-8774-ff111ad867e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:45.919785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71612042-01a1-42c6-8774-ff111ad867e5 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-71612042-01a1-42c6-8774-ff111ad867e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:45.935987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:45.937895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:45.940064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:45.940064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:45.940064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:45.940064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:45.940064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 431/865] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:45.945530 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71612042-01a1-42c6-8774-ff111ad867e5 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:46.008861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6e8d3-9117-4492-b9d1-e0d91cea88e7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:46.036041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:46.046681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844986d2-029e-4e8e-be44-8f20ec264bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:46.047663 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844986d2-029e-4e8e-be44-8f20ec264bfd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:46.048004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844986d2-029e-4e8e-be44-8f20ec264bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:46.048340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844986d2-029e-4e8e-be44-8f20ec264bfd None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:46.049127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844986d2-029e-4e8e-be44-8f20ec264bfd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:46.049772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844986d2-029e-4e8e-be44-8f20ec264bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:46.051183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844986d2-029e-4e8e-be44-8f20ec264bfd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:46.056079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 435/866] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 07:01:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:46.057560 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71612042-01a1-42c6-8774-ff111ad867e5 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:46.066530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b855d85-dfc4-40a1-926b-afffff14d7d8 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:46.067090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b855d85-dfc4-40a1-926b-afffff14d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:46.067090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b855d85-dfc4-40a1-926b-afffff14d7d8 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:46.068666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 436/867] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:46.074218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4be405-5bd1-457b-9fb7-810c4b03312b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:46.074561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4be405-5bd1-457b-9fb7-810c4b03312b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:46.074768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4be405-5bd1-457b-9fb7-810c4b03312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:46.096856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ee4be405-5bd1-457b-9fb7-810c4b03312b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:46.098101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ee4be405-5bd1-457b-9fb7-810c4b03312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:46.109524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b92ed-4b65-4ded-b077-98a0b1786aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:46.111027 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b92ed-4b65-4ded-b077-98a0b1786aec None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:46.111670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b92ed-4b65-4ded-b077-98a0b1786aec None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:46.112225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b92ed-4b65-4ded-b077-98a0b1786aec None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:46.113141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b92ed-4b65-4ded-b077-98a0b1786aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:46.113642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b92ed-4b65-4ded-b077-98a0b1786aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:46.116281 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b92ed-4b65-4ded-b077-98a0b1786aec None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:46.135448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 432/868] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:46.141179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b92ed-4b65-4ded-b077-98a0b1786aec None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:46.175357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:46.204351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 437/869] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:46.224734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4be405-5bd1-457b-9fb7-810c4b03312b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:46.275144 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b92ed-4b65-4ded-b077-98a0b1786aec None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:46.316731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6afcea-11b8-490d-9c92-532180a7d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:46.317421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6afcea-11b8-490d-9c92-532180a7d421 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:46.317697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6afcea-11b8-490d-9c92-532180a7d421 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:46.317988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6afcea-11b8-490d-9c92-532180a7d421 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:46.325889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6afcea-11b8-490d-9c92-532180a7d421 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:46.327341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6afcea-11b8-490d-9c92-532180a7d421 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-8d6afcea-11b8-490d-9c92-532180a7d421 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:46.340003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:46.340966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:46.341877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:46.341877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:46.341877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:46.341877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:46.341877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:46.341877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:46.341877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:46.341877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:46.341877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 433/870] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:46.342897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4be405-5bd1-457b-9fb7-810c4b03312b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:46.352985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6afcea-11b8-490d-9c92-532180a7d421 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:46.369522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:46.390364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351abdb-0e5d-4ad5-aae0-8356cac66550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:46.391321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351abdb-0e5d-4ad5-aae0-8356cac66550 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:46.391780 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351abdb-0e5d-4ad5-aae0-8356cac66550 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:46.392197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351abdb-0e5d-4ad5-aae0-8356cac66550 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:46.393076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351abdb-0e5d-4ad5-aae0-8356cac66550 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:46.395299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351abdb-0e5d-4ad5-aae0-8356cac66550 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:46.419211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 438/871] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:01:46 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:01:46.458354 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:46.472716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6afcea-11b8-490d-9c92-532180a7d421 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:46.518838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e3c80-707f-4c34-b12a-3e018b5e6cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:46.519738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e3c80-707f-4c34-b12a-3e018b5e6cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:46.520162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e3c80-707f-4c34-b12a-3e018b5e6cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:46.520607 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e3c80-707f-4c34-b12a-3e018b5e6cb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:46.521578 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e3c80-707f-4c34-b12a-3e018b5e6cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:46.522039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e3c80-707f-4c34-b12a-3e018b5e6cb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:46.523685 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e3c80-707f-4c34-b12a-3e018b5e6cb8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:46.539218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 434/872] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:46.546010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351abdb-0e5d-4ad5-aae0-8356cac66550 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:46.661842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351abdb-0e5d-4ad5-aae0-8356cac66550 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:46.697290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ab3f0-f4b3-4702-a9b7-adc0321f0ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:46.697927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab3f0-f4b3-4702-a9b7-adc0321f0ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:46.698209 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab3f0-f4b3-4702-a9b7-adc0321f0ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:46.698482 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab3f0-f4b3-4702-a9b7-adc0321f0ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:46.699285 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ab3f0-f4b3-4702-a9b7-adc0321f0ee1 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=8d83b456cec84bc5ab02a190099c0baf) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:46.699595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ab3f0-f4b3-4702-a9b7-adc0321f0ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:46.701071 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ab3f0-f4b3-4702-a9b7-adc0321f0ee1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:46.707433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 439/873] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:46 2022] GET /identity/v3/role_assignments?user.id=8d83b456cec84bc5ab02a190099c0baf&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:47.439845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bd4ac-ea44-47c9-8d3f-c84afa10a3b9 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:47.440386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bd4ac-ea44-47c9-8d3f-c84afa10a3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:47.440386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bd4ac-ea44-47c9-8d3f-c84afa10a3b9 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:47.441996 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 435/874] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:47.447421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7b7b5-f4dc-4ecc-9290-70d9a52b3564 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:47.447819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7b7b5-f4dc-4ecc-9290-70d9a52b3564 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:47.447966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7b7b5-f4dc-4ecc-9290-70d9a52b3564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:47.468641 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3dd7b7b5-f4dc-4ecc-9290-70d9a52b3564 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:47.469929 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3dd7b7b5-f4dc-4ecc-9290-70d9a52b3564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:47.510945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:47.545089 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 440/875] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:47.564777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bd4ac-ea44-47c9-8d3f-c84afa10a3b9 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:47.688608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bd4ac-ea44-47c9-8d3f-c84afa10a3b9 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:47.726301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde567-2095-4440-b35b-01698d70fc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:47.726968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde567-2095-4440-b35b-01698d70fc6a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:47.727320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde567-2095-4440-b35b-01698d70fc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:47.727601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde567-2095-4440-b35b-01698d70fc6a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:47.739771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cde567-2095-4440-b35b-01698d70fc6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a1cde567-2095-4440-b35b-01698d70fc6a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:47.745098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:47.746106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:47.746927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 436/876] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Aug 5 07:01:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:47.753147 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7b7b5-f4dc-4ecc-9290-70d9a52b3564 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:47.866211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7b7b5-f4dc-4ecc-9290-70d9a52b3564 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:47.908592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f2bcd-e9c4-48c8-8c8c-ab03eda1ae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:47.909640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2bcd-e9c4-48c8-8c8c-ab03eda1ae00 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:47.909640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2bcd-e9c4-48c8-8c8c-ab03eda1ae00 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:47.909953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f2bcd-e9c4-48c8-8c8c-ab03eda1ae00 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:47.910519 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f2bcd-e9c4-48c8-8c8c-ab03eda1ae00 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:47.910826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f2bcd-e9c4-48c8-8c8c-ab03eda1ae00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:47.912222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f2bcd-e9c4-48c8-8c8c-ab03eda1ae00 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:47.922309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 441/877] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 07:01:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:47.930058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde567-2095-4440-b35b-01698d70fc6a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:47.934587 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:48.033896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde567-2095-4440-b35b-01698d70fc6a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:48.069598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37bb6d-52b7-460b-8875-478f10a410c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:48.070300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37bb6d-52b7-460b-8875-478f10a410c9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:48.070579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37bb6d-52b7-460b-8875-478f10a410c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:48.070847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37bb6d-52b7-460b-8875-478f10a410c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:48.081476 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37bb6d-52b7-460b-8875-478f10a410c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:48.082939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37bb6d-52b7-460b-8875-478f10a410c9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-db37bb6d-52b7-460b-8875-478f10a410c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:48.097945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:48.098886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:48.099782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:48.099782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:48.099782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:48.099782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:48.104009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 437/878] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:48.106088 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f2bcd-e9c4-48c8-8c8c-ab03eda1ae00 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:48.149055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:48.193436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb2926-e35f-4fe0-bd8d-be7fbf448cef None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:48.194031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb2926-e35f-4fe0-bd8d-be7fbf448cef None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:48.194452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb2926-e35f-4fe0-bd8d-be7fbf448cef None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:48.196394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 438/879] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:01:48.202456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a2c43-cb63-4954-ad29-781b50233f2b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:48.202784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a2c43-cb63-4954-ad29-781b50233f2b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:48.203013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a2c43-cb63-4954-ad29-781b50233f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:48.226115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-4c0a2c43-cb63-4954-ad29-781b50233f2b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:48.227099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4c0a2c43-cb63-4954-ad29-781b50233f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:48.234062 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f2bcd-e9c4-48c8-8c8c-ab03eda1ae00 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:48.280118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12cfa-1d6c-42ff-a4b6-d0d7b2eb28e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:48.281166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12cfa-1d6c-42ff-a4b6-d0d7b2eb28e0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:48.281746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12cfa-1d6c-42ff-a4b6-d0d7b2eb28e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:48.282231 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d12cfa-1d6c-42ff-a4b6-d0d7b2eb28e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:48.283462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d12cfa-1d6c-42ff-a4b6-d0d7b2eb28e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:48.283462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d12cfa-1d6c-42ff-a4b6-d0d7b2eb28e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:48.284987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d12cfa-1d6c-42ff-a4b6-d0d7b2eb28e0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:48.297327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:48.299721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 442/880] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:48.305164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12cfa-1d6c-42ff-a4b6-d0d7b2eb28e0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:48.325054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 439/881] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:48 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:48.343703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a2c43-cb63-4954-ad29-781b50233f2b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:48.429442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:48.439983 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d12cfa-1d6c-42ff-a4b6-d0d7b2eb28e0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:48.453369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a2c43-cb63-4954-ad29-781b50233f2b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:48.491845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfa376-adf8-4ec4-80b4-3b222e964bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:48.492920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfa376-adf8-4ec4-80b4-3b222e964bbc None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:48.492920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfa376-adf8-4ec4-80b4-3b222e964bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:48.496923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfa376-adf8-4ec4-80b4-3b222e964bbc None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:48.496923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfa376-adf8-4ec4-80b4-3b222e964bbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:48.497181 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b31dc-326b-4847-a21c-bf4c83038b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:48.497181 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b31dc-326b-4847-a21c-bf4c83038b15 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:48.497181 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b31dc-326b-4847-a21c-bf4c83038b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:48.497745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfa376-adf8-4ec4-80b4-3b222e964bbc None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:48.497825 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b31dc-326b-4847-a21c-bf4c83038b15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:48.506477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b31dc-326b-4847-a21c-bf4c83038b15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:48.508218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b31dc-326b-4847-a21c-bf4c83038b15 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:48.515475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 440/882] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:01:48 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-af8b31dc-326b-4847-a21c-bf4c83038b15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:48.522283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:48.523325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:48.524266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:48.524266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:48.524266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:48.524266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:48.524266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:48.524266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:48.524266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:48.524266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:48.524266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 07:01:48.524266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:48.528710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 443/883] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 07:01:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:48.529827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfa376-adf8-4ec4-80b4-3b222e964bbc None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:48.592337 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:48.660130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eab78-23b3-43c8-ba5f-18affd2868a5 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:48.660479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eab78-23b3-43c8-ba5f-18affd2868a5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:48.660687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eab78-23b3-43c8-ba5f-18affd2868a5 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:48.662945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 444/884] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:48.669035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3726b-a154-4834-89cf-fbc5d635a4d9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:48.669349 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3726b-a154-4834-89cf-fbc5d635a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:48.669593 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3726b-a154-4834-89cf-fbc5d635a4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:48.672865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfa376-adf8-4ec4-80b4-3b222e964bbc None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:48.689599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0af3726b-a154-4834-89cf-fbc5d635a4d9 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:48.690760 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0af3726b-a154-4834-89cf-fbc5d635a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:48.725935 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2716b3-8e96-43d9-8362-2d53b334405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:48.726582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2716b3-8e96-43d9-8362-2d53b334405d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:48.726867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2716b3-8e96-43d9-8362-2d53b334405d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:48.727129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2716b3-8e96-43d9-8362-2d53b334405d None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:48.727927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2716b3-8e96-43d9-8362-2d53b334405d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:48.728232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2716b3-8e96-43d9-8362-2d53b334405d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:48.729843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2716b3-8e96-43d9-8362-2d53b334405d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:48.754515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 441/885] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Aug 5 07:01:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:48.759620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2716b3-8e96-43d9-8362-2d53b334405d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:48.785391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 445/886] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:48.809755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3726b-a154-4834-89cf-fbc5d635a4d9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:48.877294 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:48.880690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2716b3-8e96-43d9-8362-2d53b334405d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:48.907234 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:48.920424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c05876-589e-471d-80f3-afa5928ea98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:48.921108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c05876-589e-471d-80f3-afa5928ea98d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:48.921375 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c05876-589e-471d-80f3-afa5928ea98d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:48.921653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c05876-589e-471d-80f3-afa5928ea98d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:48.927571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3726b-a154-4834-89cf-fbc5d635a4d9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:48.966155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b4868-7caa-480b-871d-df28b36a55ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:48.966761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b4868-7caa-480b-871d-df28b36a55ef None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:48.967318 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b4868-7caa-480b-871d-df28b36a55ef None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:48.967318 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b4868-7caa-480b-871d-df28b36a55ef None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:48.967939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b4868-7caa-480b-871d-df28b36a55ef None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:48.969519 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b4868-7caa-480b-871d-df28b36a55ef None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e93b4868-7caa-480b-871d-df28b36a55ef None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:48.979911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:48.980995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:48.981826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 446/887] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:01:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:48.982614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba45c8-d29d-40b5-8073-b3b1a9309ac2 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:48.982680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba45c8-d29d-40b5-8073-b3b1a9309ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:48.983418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba45c8-d29d-40b5-8073-b3b1a9309ac2 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:48.984306 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 447/888] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:48.987280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba45c8-d29d-40b5-8073-b3b1a9309ac2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:49.001717 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c05876-589e-471d-80f3-afa5928ea98d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:49.003285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c05876-589e-471d-80f3-afa5928ea98d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:49.098898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba45c8-d29d-40b5-8073-b3b1a9309ac2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:49.105820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:49.116306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 442/889] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:48 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:01:49.117768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6be220-cef6-4b4d-acd3-85f686960e58 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:49.118044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6be220-cef6-4b4d-acd3-85f686960e58 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:49.118323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6be220-cef6-4b4d-acd3-85f686960e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:49.135695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba745e55-077d-4141-8163-0d1123ed07ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:49.136645 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba745e55-077d-4141-8163-0d1123ed07ab None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:49.137144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba745e55-077d-4141-8163-0d1123ed07ab None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:49.137554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba745e55-077d-4141-8163-0d1123ed07ab None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:49.137786 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-dd6be220-cef6-4b4d-acd3-85f686960e58 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:49.138579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba745e55-077d-4141-8163-0d1123ed07ab None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:49.139005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-dd6be220-cef6-4b4d-acd3-85f686960e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:49.139166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba745e55-077d-4141-8163-0d1123ed07ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:49.140741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba745e55-077d-4141-8163-0d1123ed07ab None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:49.150995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 448/890] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:01:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:49.150995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba745e55-077d-4141-8163-0d1123ed07ab None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:49.168790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:49.213564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 443/891] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:49.214447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6be220-cef6-4b4d-acd3-85f686960e58 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:49.283834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba745e55-077d-4141-8163-0d1123ed07ab None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:49.318898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7554cd-b088-452d-be80-78cc73826abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:49.319551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7554cd-b088-452d-be80-78cc73826abb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:49.319825 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7554cd-b088-452d-be80-78cc73826abb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:49.320094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7554cd-b088-452d-be80-78cc73826abb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:49.327839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6be220-cef6-4b4d-acd3-85f686960e58 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:49.332865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7554cd-b088-452d-be80-78cc73826abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:49.334378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7554cd-b088-452d-be80-78cc73826abb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-0d7554cd-b088-452d-be80-78cc73826abb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:49.349810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:49.350747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:49.351654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:49.351654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:49.351654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:49.351654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:49.351654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 449/892] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:49.351949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7554cd-b088-452d-be80-78cc73826abb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:49.365228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:49.372718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accd5a3-c8ca-4eca-9827-21b77838469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:49.373707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accd5a3-c8ca-4eca-9827-21b77838469d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:49.374025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accd5a3-c8ca-4eca-9827-21b77838469d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:49.374328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accd5a3-c8ca-4eca-9827-21b77838469d None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:49.375045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accd5a3-c8ca-4eca-9827-21b77838469d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:49.375375 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accd5a3-c8ca-4eca-9827-21b77838469d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:49.377330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accd5a3-c8ca-4eca-9827-21b77838469d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:49.383813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 444/893] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:01:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:49.384458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accd5a3-c8ca-4eca-9827-21b77838469d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:49.424507 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:49.465449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7554cd-b088-452d-be80-78cc73826abb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:49.495117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accd5a3-c8ca-4eca-9827-21b77838469d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:49.502555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f30533-ea26-47bb-a160-7bf4a479e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:49.503677 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f30533-ea26-47bb-a160-7bf4a479e8ca None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:49.503950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f30533-ea26-47bb-a160-7bf4a479e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:49.504249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f30533-ea26-47bb-a160-7bf4a479e8ca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:49.504917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f30533-ea26-47bb-a160-7bf4a479e8ca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:49.507003 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f30533-ea26-47bb-a160-7bf4a479e8ca None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-27f30533-ea26-47bb-a160-7bf4a479e8ca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:49.516547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:49.517707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:49.518539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 450/894] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 07:01:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:49.519338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f30533-ea26-47bb-a160-7bf4a479e8ca None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:49.536822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a935f-2a0a-4d21-8d11-ada914add317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:49.537742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a935f-2a0a-4d21-8d11-ada914add317 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:49.538022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a935f-2a0a-4d21-8d11-ada914add317 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:49.538345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a935f-2a0a-4d21-8d11-ada914add317 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:49.539039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a935f-2a0a-4d21-8d11-ada914add317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:49.539394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a935f-2a0a-4d21-8d11-ada914add317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:49.540842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a935f-2a0a-4d21-8d11-ada914add317 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:49.553530 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 445/895] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:49.554406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a935f-2a0a-4d21-8d11-ada914add317 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:49.625566 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:49.640708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f30533-ea26-47bb-a160-7bf4a479e8ca None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:49.671811 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:49.676112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a935f-2a0a-4d21-8d11-ada914add317 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:49.679666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf540e-bf59-466b-89ff-0dfb7335a243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:49.680308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf540e-bf59-466b-89ff-0dfb7335a243 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:49.680587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf540e-bf59-466b-89ff-0dfb7335a243 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:49.680869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf540e-bf59-466b-89ff-0dfb7335a243 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:49.681662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf540e-bf59-466b-89ff-0dfb7335a243 None admin] RBAC: Adding query filter params (interface=public, service_id=9b92964f237f411b90d99c65666a576d, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:49.681970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf540e-bf59-466b-89ff-0dfb7335a243 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:49.683350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf540e-bf59-466b-89ff-0dfb7335a243 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:49.693347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 451/896] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 07:01:49 2022] GET /identity/v3/endpoints?service_id=9b92964f237f411b90d99c65666a576d&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:49.694588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf540e-bf59-466b-89ff-0dfb7335a243 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:49.724555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d134694-0b3c-4ae2-a687-1e3b57ee5cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:49.725576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134694-0b3c-4ae2-a687-1e3b57ee5cec None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:49.725866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134694-0b3c-4ae2-a687-1e3b57ee5cec None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:49.726609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d134694-0b3c-4ae2-a687-1e3b57ee5cec None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:49.727584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d134694-0b3c-4ae2-a687-1e3b57ee5cec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:49.727900 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d134694-0b3c-4ae2-a687-1e3b57ee5cec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:49.730247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d134694-0b3c-4ae2-a687-1e3b57ee5cec None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:49.741795 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 446/897] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 07:01:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:49.741795 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d134694-0b3c-4ae2-a687-1e3b57ee5cec None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:49.811609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf540e-bf59-466b-89ff-0dfb7335a243 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:49.847957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c27bb-9a4d-49f5-8fb6-20ca71b20de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:49.848612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c27bb-9a4d-49f5-8fb6-20ca71b20de4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:49.848936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c27bb-9a4d-49f5-8fb6-20ca71b20de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:49.849201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c27bb-9a4d-49f5-8fb6-20ca71b20de4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:49.856003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d134694-0b3c-4ae2-a687-1e3b57ee5cec None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:49.857173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c27bb-9a4d-49f5-8fb6-20ca71b20de4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:49.858802 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c27bb-9a4d-49f5-8fb6-20ca71b20de4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8f0c27bb-9a4d-49f5-8fb6-20ca71b20de4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:49.872534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:49.873510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:49.874443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:49.874443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:49.874443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:49.874443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:49.874443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:49.874443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:49.874443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:49.874443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:49.874443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 452/898] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:49.874981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c27bb-9a4d-49f5-8fb6-20ca71b20de4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:49.880401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:49.908670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf217b-85e8-438b-b68e-85fe35466fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:49.909326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf217b-85e8-438b-b68e-85fe35466fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:49.909864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf217b-85e8-438b-b68e-85fe35466fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:49.909864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf217b-85e8-438b-b68e-85fe35466fb3 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:49.910531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf217b-85e8-438b-b68e-85fe35466fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:49.911924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf217b-85e8-438b-b68e-85fe35466fb3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:49.918469 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 447/899] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 07:01:49 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:01:49.922465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf217b-85e8-438b-b68e-85fe35466fb3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:49.938456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:49.992624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c27bb-9a4d-49f5-8fb6-20ca71b20de4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:50.035190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dc3b4-26a9-45bf-b073-ecb2dda70927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:50.037916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dc3b4-26a9-45bf-b073-ecb2dda70927 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:50.038551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dc3b4-26a9-45bf-b073-ecb2dda70927 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:50.039027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dc3b4-26a9-45bf-b073-ecb2dda70927 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:50.039955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dc3b4-26a9-45bf-b073-ecb2dda70927 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:50.040494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dc3b4-26a9-45bf-b073-ecb2dda70927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:50.042178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dc3b4-26a9-45bf-b073-ecb2dda70927 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:50.050801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 453/900] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 07:01:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:50.080648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf217b-85e8-438b-b68e-85fe35466fb3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:50.122225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f229f-c5fe-4378-bf21-3e82e7781105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:50.122949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f229f-c5fe-4378-bf21-3e82e7781105 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:50.123228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f229f-c5fe-4378-bf21-3e82e7781105 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:50.123499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f229f-c5fe-4378-bf21-3e82e7781105 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:50.124321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f229f-c5fe-4378-bf21-3e82e7781105 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:50.124631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f229f-c5fe-4378-bf21-3e82e7781105 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:50.126269 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f229f-c5fe-4378-bf21-3e82e7781105 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:50.141249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 448/901] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:50.147660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dc3b4-26a9-45bf-b073-ecb2dda70927 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:50.271720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dc3b4-26a9-45bf-b073-ecb2dda70927 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:50.294811 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:50.310442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29f391-f34f-469c-876f-57cf9590566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:50.311079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29f391-f34f-469c-876f-57cf9590566a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:50.311359 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29f391-f34f-469c-876f-57cf9590566a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:50.311633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29f391-f34f-469c-876f-57cf9590566a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:50.312433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29f391-f34f-469c-876f-57cf9590566a None admin] RBAC: Adding query filter params (role.id=203154726d1340b6b60888f02c96c1e8, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=0dc4cfe4a3ce4e34a1b664d99eb34d2a) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:50.312746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29f391-f34f-469c-876f-57cf9590566a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:50.314260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29f391-f34f-469c-876f-57cf9590566a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:50.320941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 454/902] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:50 2022] GET /identity/v3/role_assignments?user.id=0dc4cfe4a3ce4e34a1b664d99eb34d2a&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=203154726d1340b6b60888f02c96c1e8 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:50.628509 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc6d95-2eb9-4e95-909e-895c8ae7a17f None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:50.629106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc6d95-2eb9-4e95-909e-895c8ae7a17f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:50.629106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc6d95-2eb9-4e95-909e-895c8ae7a17f None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:50.630760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 449/903] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:50.636569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee6b45-5e47-4c69-b347-91bbb5916b60 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:50.637072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee6b45-5e47-4c69-b347-91bbb5916b60 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:50.637219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee6b45-5e47-4c69-b347-91bbb5916b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:50.658656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-74ee6b45-5e47-4c69-b347-91bbb5916b60 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:50.659878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-74ee6b45-5e47-4c69-b347-91bbb5916b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:50.734171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 455/904] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:50.756577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc6d95-2eb9-4e95-909e-895c8ae7a17f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:50.806235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:50.872232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc6d95-2eb9-4e95-909e-895c8ae7a17f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:50.908451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d136c9a-cc51-4af1-911c-5cb32f028af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:50.909480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d136c9a-cc51-4af1-911c-5cb32f028af3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:50.909964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d136c9a-cc51-4af1-911c-5cb32f028af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:50.910434 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d136c9a-cc51-4af1-911c-5cb32f028af3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:50.911282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d136c9a-cc51-4af1-911c-5cb32f028af3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:50.913256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d136c9a-cc51-4af1-911c-5cb32f028af3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-7d136c9a-cc51-4af1-911c-5cb32f028af3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:50.923157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:50.924105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 07:01:50.925365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:50.927959 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 450/905] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Aug 5 07:01:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:50.933923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee6b45-5e47-4c69-b347-91bbb5916b60 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:51.042254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee6b45-5e47-4c69-b347-91bbb5916b60 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:51.057304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:51.080173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8ce10-7ca8-4d1b-9614-da1b9c76abb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:51.080810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8ce10-7ca8-4d1b-9614-da1b9c76abb6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:51.081122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8ce10-7ca8-4d1b-9614-da1b9c76abb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:51.081399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8ce10-7ca8-4d1b-9614-da1b9c76abb6 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:51.082094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8ce10-7ca8-4d1b-9614-da1b9c76abb6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:51.082460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8ce10-7ca8-4d1b-9614-da1b9c76abb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:51.083945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8ce10-7ca8-4d1b-9614-da1b9c76abb6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:51.089534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 456/906] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 07:01:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:51.095324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d136c9a-cc51-4af1-911c-5cb32f028af3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:51.211178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d136c9a-cc51-4af1-911c-5cb32f028af3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:51.219550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:51.256152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89c5f3-c3aa-484c-bbb5-d41c7490c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:51.257153 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89c5f3-c3aa-484c-bbb5-d41c7490c998 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:51.257582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89c5f3-c3aa-484c-bbb5-d41c7490c998 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:51.258020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89c5f3-c3aa-484c-bbb5-d41c7490c998 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:51.258866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89c5f3-c3aa-484c-bbb5-d41c7490c998 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:51.259342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89c5f3-c3aa-484c-bbb5-d41c7490c998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:51.260881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89c5f3-c3aa-484c-bbb5-d41c7490c998 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:51.269679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 451/907] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 07:01:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:51.275294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8ce10-7ca8-4d1b-9614-da1b9c76abb6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:51.388025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8ce10-7ca8-4d1b-9614-da1b9c76abb6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:51.424403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef4486-9f16-485b-b87f-fd07735abc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:51.425482 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef4486-9f16-485b-b87f-fd07735abc87 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:51.425969 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef4486-9f16-485b-b87f-fd07735abc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:51.426444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef4486-9f16-485b-b87f-fd07735abc87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:51.427430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef4486-9f16-485b-b87f-fd07735abc87 None admin] RBAC: Adding query filter params (interface=public, service_id=cdba8cdb001447a18db3bcbdd993f175, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:51.427939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef4486-9f16-485b-b87f-fd07735abc87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:51.429551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef4486-9f16-485b-b87f-fd07735abc87 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:51.435896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 457/908] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 07:01:51 2022] GET /identity/v3/endpoints?service_id=cdba8cdb001447a18db3bcbdd993f175&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:51.441890 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89c5f3-c3aa-484c-bbb5-d41c7490c998 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:51.557005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89c5f3-c3aa-484c-bbb5-d41c7490c998 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:51.593819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c74b9a-696d-4def-bb02-e47ab4aa0626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:51.594497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c74b9a-696d-4def-bb02-e47ab4aa0626 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:51.594776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c74b9a-696d-4def-bb02-e47ab4aa0626 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:51.595047 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c74b9a-696d-4def-bb02-e47ab4aa0626 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:51.595713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c74b9a-696d-4def-bb02-e47ab4aa0626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:51.597169 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c74b9a-696d-4def-bb02-e47ab4aa0626 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:51.603564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 452/909] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 07:01:51 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:01:52.032954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965dab6-869b-42dd-851e-3f0a4c31ccde None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:52.034019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965dab6-869b-42dd-851e-3f0a4c31ccde None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:52.034528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965dab6-869b-42dd-851e-3f0a4c31ccde None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:52.036398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 458/910] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:52.042392 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c8076-f95b-4f31-a22a-5575ce097caa None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:52.043242 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c8076-f95b-4f31-a22a-5575ce097caa None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:52.043720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c8076-f95b-4f31-a22a-5575ce097caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:52.063448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c46c8076-f95b-4f31-a22a-5575ce097caa None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:52.065194 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c46c8076-f95b-4f31-a22a-5575ce097caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:52.094543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:52.144220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 453/911] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:52.161865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965dab6-869b-42dd-851e-3f0a4c31ccde None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:52.165045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b184f-c56a-4dca-8c3b-650a186647f4 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:52.165581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b184f-c56a-4dca-8c3b-650a186647f4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:52.166007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b184f-c56a-4dca-8c3b-650a186647f4 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:52.167533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 454/912] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:52.174469 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75584f-4b54-4317-a946-ffc3d7ec2cf5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:52.174748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75584f-4b54-4317-a946-ffc3d7ec2cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:52.175024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75584f-4b54-4317-a946-ffc3d7ec2cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:52.196229 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-fe75584f-4b54-4317-a946-ffc3d7ec2cf5 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:52.198077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fe75584f-4b54-4317-a946-ffc3d7ec2cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:52.212012 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:52.280914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965dab6-869b-42dd-851e-3f0a4c31ccde None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:52.288970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 455/913] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:52.307611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75584f-4b54-4317-a946-ffc3d7ec2cf5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:52.329924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0191134-7419-49a4-9ca9-88cac8d893ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:52.331399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0191134-7419-49a4-9ca9-88cac8d893ca None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:52.332186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0191134-7419-49a4-9ca9-88cac8d893ca None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:52.332707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0191134-7419-49a4-9ca9-88cac8d893ca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:52.333803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0191134-7419-49a4-9ca9-88cac8d893ca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:52.336083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0191134-7419-49a4-9ca9-88cac8d893ca None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e0191134-7419-49a4-9ca9-88cac8d893ca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:52.348633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:52.349739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 07:01:52.350554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:52.353549 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 459/914] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:01:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:52.359821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0191134-7419-49a4-9ca9-88cac8d893ca None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:52.413757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:52.422307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75584f-4b54-4317-a946-ffc3d7ec2cf5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:52.458264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aee153-6022-4a27-bf96-92df869d7242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:52.459421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aee153-6022-4a27-bf96-92df869d7242 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:52.459847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aee153-6022-4a27-bf96-92df869d7242 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:52.460255 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aee153-6022-4a27-bf96-92df869d7242 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:52.461113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aee153-6022-4a27-bf96-92df869d7242 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:52.463370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aee153-6022-4a27-bf96-92df869d7242 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:52.473887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0191134-7419-49a4-9ca9-88cac8d893ca None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:52.476429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:52.486249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 456/915] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:01:52 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:01:52.486249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43bf2-6cdb-4516-a2a2-a3e50b193df1 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:52.486249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43bf2-6cdb-4516-a2a2-a3e50b193df1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:52.486249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43bf2-6cdb-4516-a2a2-a3e50b193df1 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:52.486249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 457/916] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:52.492246 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad37df1-3fd3-4d43-b77b-1de4638fcf69 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:52.492528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad37df1-3fd3-4d43-b77b-1de4638fcf69 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:52.492791 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad37df1-3fd3-4d43-b77b-1de4638fcf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:52.514723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0ad37df1-3fd3-4d43-b77b-1de4638fcf69 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:52.516387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0ad37df1-3fd3-4d43-b77b-1de4638fcf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:52.529246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea410ba-56c5-4d6f-a78d-0f5889c53ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:52.529881 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea410ba-56c5-4d6f-a78d-0f5889c53ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:52.530158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea410ba-56c5-4d6f-a78d-0f5889c53ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:52.530430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea410ba-56c5-4d6f-a78d-0f5889c53ae8 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:52.531108 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea410ba-56c5-4d6f-a78d-0f5889c53ae8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:52.531409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea410ba-56c5-4d6f-a78d-0f5889c53ae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:52.532839 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea410ba-56c5-4d6f-a78d-0f5889c53ae8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:52.538941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 460/917] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:01:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:52.544862 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea410ba-56c5-4d6f-a78d-0f5889c53ae8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:52.607954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 458/918] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:52.627527 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad37df1-3fd3-4d43-b77b-1de4638fcf69 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:52.697005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea410ba-56c5-4d6f-a78d-0f5889c53ae8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:52.739711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:52.739949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685b1e7-fb24-43bc-ab4a-86bba9f012bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:52.740569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685b1e7-fb24-43bc-ab4a-86bba9f012bd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:52.740847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685b1e7-fb24-43bc-ab4a-86bba9f012bd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:52.741603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685b1e7-fb24-43bc-ab4a-86bba9f012bd None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:52.742405 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685b1e7-fb24-43bc-ab4a-86bba9f012bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:52.742667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685b1e7-fb24-43bc-ab4a-86bba9f012bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:52.745050 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685b1e7-fb24-43bc-ab4a-86bba9f012bd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:52.751071 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 461/919] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Aug 5 07:01:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:52.758010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685b1e7-fb24-43bc-ab4a-86bba9f012bd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:52.766880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad37df1-3fd3-4d43-b77b-1de4638fcf69 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:52.792279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:52.817255 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fcd3f-ab9a-4e0d-a90e-037fbde41d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:52.818461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fcd3f-ab9a-4e0d-a90e-037fbde41d47 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:52.818890 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fcd3f-ab9a-4e0d-a90e-037fbde41d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:52.819565 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fcd3f-ab9a-4e0d-a90e-037fbde41d47 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:52.837793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fcd3f-ab9a-4e0d-a90e-037fbde41d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-339fcd3f-ab9a-4e0d-a90e-037fbde41d47 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:52.845415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:52.846533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:52.847572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:52.847572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:52.847572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:52.847572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:52.847572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:52.847572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:52.847572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:52.847572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:52.847572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:52.847572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:52.847572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 07:01:52.847572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:52.850435 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 459/920] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Aug 5 07:01:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:52.856177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fcd3f-ab9a-4e0d-a90e-037fbde41d47 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:52.878913 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685b1e7-fb24-43bc-ab4a-86bba9f012bd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:52.917224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fc480-85dd-45a7-85b5-38459ae8f818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:52.918105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fc480-85dd-45a7-85b5-38459ae8f818 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:52.918520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fc480-85dd-45a7-85b5-38459ae8f818 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:52.918927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fc480-85dd-45a7-85b5-38459ae8f818 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:52.919808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fc480-85dd-45a7-85b5-38459ae8f818 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:52.921347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fc480-85dd-45a7-85b5-38459ae8f818 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:52.953191 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 462/921] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:01:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:01:52.975253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fcd3f-ab9a-4e0d-a90e-037fbde41d47 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:53.022940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133c527-a099-4418-bf83-766acd2dedce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:53.023639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133c527-a099-4418-bf83-766acd2dedce None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:53.023928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133c527-a099-4418-bf83-766acd2dedce None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:53.024199 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133c527-a099-4418-bf83-766acd2dedce None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:53.024979 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133c527-a099-4418-bf83-766acd2dedce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:53.025401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133c527-a099-4418-bf83-766acd2dedce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:53.026847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133c527-a099-4418-bf83-766acd2dedce None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:53.037731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 460/922] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 07:01:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:53.043914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fc480-85dd-45a7-85b5-38459ae8f818 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:53.145525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:53.167496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fc480-85dd-45a7-85b5-38459ae8f818 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:53.204319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2260aae-5b54-4c30-a60a-840728218582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:53.205020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2260aae-5b54-4c30-a60a-840728218582 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:53.205303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2260aae-5b54-4c30-a60a-840728218582 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:53.205587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2260aae-5b54-4c30-a60a-840728218582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:53.217725 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2260aae-5b54-4c30-a60a-840728218582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:53.219239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2260aae-5b54-4c30-a60a-840728218582 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d2260aae-5b54-4c30-a60a-840728218582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:53.234992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:53.235971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:53.236877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:53.236877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:53.236877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:53.236877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:53.236877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 463/923] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:53.242955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133c527-a099-4418-bf83-766acd2dedce None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:53.247775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:53.358945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133c527-a099-4418-bf83-766acd2dedce None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:53.395086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf435d-c935-4b3b-9117-ded0195ee28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:53.396399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf435d-c935-4b3b-9117-ded0195ee28b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:53.397201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf435d-c935-4b3b-9117-ded0195ee28b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:53.397679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf435d-c935-4b3b-9117-ded0195ee28b None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:53.398588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf435d-c935-4b3b-9117-ded0195ee28b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:53.399091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf435d-c935-4b3b-9117-ded0195ee28b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:53.400681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf435d-c935-4b3b-9117-ded0195ee28b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:53.415722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 461/924] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:53.421657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2260aae-5b54-4c30-a60a-840728218582 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:53.534614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2260aae-5b54-4c30-a60a-840728218582 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:53.572424 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6740de-0e7e-41d8-94da-1a04f1110990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:53.573108 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6740de-0e7e-41d8-94da-1a04f1110990 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:53.573393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6740de-0e7e-41d8-94da-1a04f1110990 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:53.573670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6740de-0e7e-41d8-94da-1a04f1110990 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:53.576590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:53.583028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6740de-0e7e-41d8-94da-1a04f1110990 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:53.584490 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6740de-0e7e-41d8-94da-1a04f1110990 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ab6740de-0e7e-41d8-94da-1a04f1110990 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:53.596816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:53.597827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:53.598810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:53.598810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:53.598810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:53.598810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:53.598810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:53.598810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:53.598810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:53.598810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:53.598810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 07:01:53.598810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:53.598810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 464/925] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 07:01:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:53.604586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf435d-c935-4b3b-9117-ded0195ee28b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:53.677520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:53.686833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7d558-7b3f-46f0-b5f1-2d88879aab13 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:53.687138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7d558-7b3f-46f0-b5f1-2d88879aab13 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:53.687419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7d558-7b3f-46f0-b5f1-2d88879aab13 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:53.690131 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 465/926] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:01:53.696070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b805ba7-c62a-4099-8f2d-9609ef98b2aa None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:53.696716 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b805ba7-c62a-4099-8f2d-9609ef98b2aa None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:53.697028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b805ba7-c62a-4099-8f2d-9609ef98b2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:53.722019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9b805ba7-c62a-4099-8f2d-9609ef98b2aa None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:53.722965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf435d-c935-4b3b-9117-ded0195ee28b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:53.723268 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9b805ba7-c62a-4099-8f2d-9609ef98b2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:53.761689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e91d46-66ee-4363-8d96-1c8923f0bde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:53.762745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e91d46-66ee-4363-8d96-1c8923f0bde4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:53.763293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e91d46-66ee-4363-8d96-1c8923f0bde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:53.763856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e91d46-66ee-4363-8d96-1c8923f0bde4 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:53.764875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e91d46-66ee-4363-8d96-1c8923f0bde4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:53.765444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e91d46-66ee-4363-8d96-1c8923f0bde4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:53.767213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e91d46-66ee-4363-8d96-1c8923f0bde4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:53.788425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 462/927] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Aug 5 07:01:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:53.794979 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e91d46-66ee-4363-8d96-1c8923f0bde4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:53.816997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 466/928] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:53.845828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b805ba7-c62a-4099-8f2d-9609ef98b2aa None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:53.925263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e91d46-66ee-4363-8d96-1c8923f0bde4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:53.952055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:53.969540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734774a-1453-497e-91a5-982853fa46f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:53.970200 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734774a-1453-497e-91a5-982853fa46f6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:53.970480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734774a-1453-497e-91a5-982853fa46f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:53.970753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734774a-1453-497e-91a5-982853fa46f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:53.984136 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734774a-1453-497e-91a5-982853fa46f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:53.986244 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734774a-1453-497e-91a5-982853fa46f6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:53.994303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b805ba7-c62a-4099-8f2d-9609ef98b2aa None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-a734774a-1453-497e-91a5-982853fa46f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:54.004721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:54.005723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:54.006601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:54.006601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:54.006601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:54.006601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:54.009054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 463/929] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:54.012699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734774a-1453-497e-91a5-982853fa46f6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:54.033690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:54.044745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fa5ea-340b-487e-81b9-d00c4fa4a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:54.045548 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fa5ea-340b-487e-81b9-d00c4fa4a06f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:54.045745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fa5ea-340b-487e-81b9-d00c4fa4a06f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:54.046001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fa5ea-340b-487e-81b9-d00c4fa4a06f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:54.047011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fa5ea-340b-487e-81b9-d00c4fa4a06f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:54.048788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fa5ea-340b-487e-81b9-d00c4fa4a06f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-aa4fa5ea-340b-487e-81b9-d00c4fa4a06f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:54.060616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:54.061669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 07:01:54.062497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:54.067813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 467/930] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Aug 5 07:01:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:54.069240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fa5ea-340b-487e-81b9-d00c4fa4a06f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:54.149077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734774a-1453-497e-91a5-982853fa46f6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:54.186896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf39e7-e9b4-46fa-b6d4-72892c28e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:54.188003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf39e7-e9b4-46fa-b6d4-72892c28e613 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:54.188480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf39e7-e9b4-46fa-b6d4-72892c28e613 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:54.188990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf39e7-e9b4-46fa-b6d4-72892c28e613 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:54.189949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf39e7-e9b4-46fa-b6d4-72892c28e613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:54.190520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf39e7-e9b4-46fa-b6d4-72892c28e613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:54.192139 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf39e7-e9b4-46fa-b6d4-72892c28e613 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:54.196427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fa5ea-340b-487e-81b9-d00c4fa4a06f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:54.205559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 464/931] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:54.212069 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf39e7-e9b4-46fa-b6d4-72892c28e613 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:54.248166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa984f4-4bb9-468f-8959-74f020406904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:54.249338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa984f4-4bb9-468f-8959-74f020406904 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:54.249923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa984f4-4bb9-468f-8959-74f020406904 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:54.250516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa984f4-4bb9-468f-8959-74f020406904 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:54.251553 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa984f4-4bb9-468f-8959-74f020406904 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:54.252063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa984f4-4bb9-468f-8959-74f020406904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:54.253877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa984f4-4bb9-468f-8959-74f020406904 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:54.263481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:54.265641 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 468/932] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 07:01:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:54.271493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa984f4-4bb9-468f-8959-74f020406904 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:54.350132 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:54.367787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf39e7-e9b4-46fa-b6d4-72892c28e613 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:54.412030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa984f4-4bb9-468f-8959-74f020406904 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:54.414857 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bbd77-5f01-4128-8aa4-079eff331747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:54.416202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bbd77-5f01-4128-8aa4-079eff331747 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:54.416202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bbd77-5f01-4128-8aa4-079eff331747 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:54.416202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bbd77-5f01-4128-8aa4-079eff331747 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:54.423897 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bbd77-5f01-4128-8aa4-079eff331747 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:54.425575 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bbd77-5f01-4128-8aa4-079eff331747 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-556bbd77-5f01-4128-8aa4-079eff331747 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:54.439034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:54.440192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:54.441384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:54.441384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:54.441384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:54.441384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:54.441384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:54.441384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:54.441384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:54.441384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:54.443210 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 465/933] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:54.448802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bbd77-5f01-4128-8aa4-079eff331747 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:54.456873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cd11e-6196-4610-89a5-f6e90a26e369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:54.457811 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cd11e-6196-4610-89a5-f6e90a26e369 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:54.458242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cd11e-6196-4610-89a5-f6e90a26e369 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:54.459273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cd11e-6196-4610-89a5-f6e90a26e369 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:54.460123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cd11e-6196-4610-89a5-f6e90a26e369 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:54.460572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cd11e-6196-4610-89a5-f6e90a26e369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:54.462571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cd11e-6196-4610-89a5-f6e90a26e369 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:54.470788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 469/934] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 07:01:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:54.476769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cd11e-6196-4610-89a5-f6e90a26e369 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:54.568657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:54.582038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bbd77-5f01-4128-8aa4-079eff331747 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:54.588670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cd11e-6196-4610-89a5-f6e90a26e369 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:54.608469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:54.627857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd7be7-c3cb-46a8-9137-945e9901bd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:54.629011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd7be7-c3cb-46a8-9137-945e9901bd3f None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:54.629389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd7be7-c3cb-46a8-9137-945e9901bd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:54.629760 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd7be7-c3cb-46a8-9137-945e9901bd3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:54.630600 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd7be7-c3cb-46a8-9137-945e9901bd3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:54.631227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d4a7c-edc3-45c3-9a3c-86f4ef933a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:54.631857 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d4a7c-edc3-45c3-9a3c-86f4ef933a75 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:54.632134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d4a7c-edc3-45c3-9a3c-86f4ef933a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:54.632329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd7be7-c3cb-46a8-9137-945e9901bd3f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:54.632436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d4a7c-edc3-45c3-9a3c-86f4ef933a75 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:54.633181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d4a7c-edc3-45c3-9a3c-86f4ef933a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:54.633490 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d4a7c-edc3-45c3-9a3c-86f4ef933a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:54.634924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d4a7c-edc3-45c3-9a3c-86f4ef933a75 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:54.652961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 466/935] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:54.652961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8f68-a209-46d6-afea-845f8715f32b None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:54.652961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8f68-a209-46d6-afea-845f8715f32b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:54.652961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8f68-a209-46d6-afea-845f8715f32b None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:54.652961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 467/936] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:54.656272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e8f68-a209-46d6-afea-845f8715f32b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:54.663240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 470/937] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:01:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:01:54.664579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf993e4-c3b6-4baf-b290-5244d0fc6a69 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:54.664861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf993e4-c3b6-4baf-b290-5244d0fc6a69 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:54.665172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf993e4-c3b6-4baf-b290-5244d0fc6a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:54.687257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ecf993e4-c3b6-4baf-b290-5244d0fc6a69 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:54.689382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ecf993e4-c3b6-4baf-b290-5244d0fc6a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:54.789059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 471/938] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:54.814858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf993e4-c3b6-4baf-b290-5244d0fc6a69 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:54.842584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e8f68-a209-46d6-afea-845f8715f32b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:54.884099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de748f7a-c8c9-4654-9a12-49061773f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:54.884781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de748f7a-c8c9-4654-9a12-49061773f971 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:54.885112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de748f7a-c8c9-4654-9a12-49061773f971 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:54.885393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de748f7a-c8c9-4654-9a12-49061773f971 None admin] PATH_INFO: `/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/0dc4cfe4a3ce4e34a1b664d99eb34d2a/roles/203154726d1340b6b60888f02c96c1e8` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:54.889099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de748f7a-c8c9-4654-9a12-49061773f971 None admin] RBAC: Authorizing `identity:create_grant(project_id=29b560f1bcf347f6b8b885cc02d52e33, user_id=0dc4cfe4a3ce4e34a1b664d99eb34d2a, role_id=203154726d1340b6b60888f02c96c1e8)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:54.890563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de748f7a-c8c9-4654-9a12-49061773f971 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:54.907616 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 468/939] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:01:54 2022] PUT /identity/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/0dc4cfe4a3ce4e34a1b664d99eb34d2a/roles/203154726d1340b6b60888f02c96c1e8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:01:54.935963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:54.941166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf993e4-c3b6-4baf-b290-5244d0fc6a69 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:54.985995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd3999-cf9a-41bb-b502-41a0ab01b437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:54.986874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd3999-cf9a-41bb-b502-41a0ab01b437 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:54.987282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd3999-cf9a-41bb-b502-41a0ab01b437 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:54.987690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd3999-cf9a-41bb-b502-41a0ab01b437 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:54.988460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd3999-cf9a-41bb-b502-41a0ab01b437 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:54.990188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd3999-cf9a-41bb-b502-41a0ab01b437 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-79dd3999-cf9a-41bb-b502-41a0ab01b437 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:55.001146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:55.002500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:01:55.003552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:55.005859 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 472/940] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 07:01:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:55.011748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de748f7a-c8c9-4654-9a12-49061773f971 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:55.029617 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:55.128625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de748f7a-c8c9-4654-9a12-49061773f971 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:55.160356 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e6414-cbbb-4017-be70-1dfd6df5dad9 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:55.160951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e6414-cbbb-4017-be70-1dfd6df5dad9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:55.160951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e6414-cbbb-4017-be70-1dfd6df5dad9 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:55.162895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 473/941] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:01:55.168133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a9de8-827d-4886-955f-03c22ff3d1d7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:55.168419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a9de8-827d-4886-955f-03c22ff3d1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:55.168698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a9de8-827d-4886-955f-03c22ff3d1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:55.169837 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8b4d9-a480-4017-954f-a0a97d149e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:55.170701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8b4d9-a480-4017-954f-a0a97d149e48 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:55.171162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8b4d9-a480-4017-954f-a0a97d149e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:55.171611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8b4d9-a480-4017-954f-a0a97d149e48 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:55.172554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8b4d9-a480-4017-954f-a0a97d149e48 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:55.173096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8b4d9-a480-4017-954f-a0a97d149e48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:55.174668 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8b4d9-a480-4017-954f-a0a97d149e48 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:55.180536 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 469/942] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 07:01:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:55.186652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8b4d9-a480-4017-954f-a0a97d149e48 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:55.187914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-561a9de8-827d-4886-955f-03c22ff3d1d7 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:55.189164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-561a9de8-827d-4886-955f-03c22ff3d1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:55.266552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 474/943] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:55.271699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:55.300084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a9de8-827d-4886-955f-03c22ff3d1d7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:55.304147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8b4d9-a480-4017-954f-a0a97d149e48 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:55.348381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6fa72-3d4d-4754-83ee-d95eb54d2f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:55.349804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6fa72-3d4d-4754-83ee-d95eb54d2f45 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:55.350623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6fa72-3d4d-4754-83ee-d95eb54d2f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:55.351104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6fa72-3d4d-4754-83ee-d95eb54d2f45 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:55.352176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6fa72-3d4d-4754-83ee-d95eb54d2f45 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:55.352689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6fa72-3d4d-4754-83ee-d95eb54d2f45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:55.355382 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6fa72-3d4d-4754-83ee-d95eb54d2f45 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:55.370718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 470/944] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 07:01:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:55.371826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6fa72-3d4d-4754-83ee-d95eb54d2f45 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:55.416498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:55.424987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a9de8-827d-4886-955f-03c22ff3d1d7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:55.462971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af36900-c8d3-44b4-8d0b-0abec8d6044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:55.463611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af36900-c8d3-44b4-8d0b-0abec8d6044d None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:55.463890 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af36900-c8d3-44b4-8d0b-0abec8d6044d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:55.464164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af36900-c8d3-44b4-8d0b-0abec8d6044d None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:55.464884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af36900-c8d3-44b4-8d0b-0abec8d6044d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:55.466671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af36900-c8d3-44b4-8d0b-0abec8d6044d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:55.469298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: WARNING keystone.server.flask.common [None req-2af36900-c8d3-44b4-8d0b-0abec8d6044d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 05 07:01:55.489383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.sql.core [None req-2af36900-c8d3-44b4-8d0b-0abec8d6044d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 07:01:55.489383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 05 07:01:55.489383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [parameters: {'id': '1646d889f2504ade84a2db7883edc738', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 05 07:01:55.489383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80394) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 07:01:55.507289 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6fa72-3d4d-4754-83ee-d95eb54d2f45 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2af36900-c8d3-44b4-8d0b-0abec8d6044d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1646d889f2504ade84a2db7883edc738.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1646d889f2504ade84a2db7883edc738. Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application conn.query(q) Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 07:01:55.511891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result.read() Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 05 07:01:55.512756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application next(self.gen) Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application yield resource Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application next(self.gen) Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise self.value Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application session.commit() Aug 05 07:01:55.518585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.session.flush() Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application compat.raise_( Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 07:01:55.519481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 07:01:55.520750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application conn.query(q) Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result.read() Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 07:01:55.521568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [parameters: {'id': '1646d889f2504ade84a2db7883edc738', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:55.523320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:55.525896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:55.528125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:55.528125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 05 07:01:55.528125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 05 07:01:55.528125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:55.528125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:55.528125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 05 07:01:55.528125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 05 07:01:55.528125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1646d889f2504ade84a2db7883edc738. Aug 05 07:01:55.528125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:55.528125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 475/945] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Aug 5 07:01:55 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:55.528125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af36900-c8d3-44b4-8d0b-0abec8d6044d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:55.560089 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8804c7d-57bc-4e60-9995-14aa0205034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:55.561257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8804c7d-57bc-4e60-9995-14aa0205034a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:55.561794 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8804c7d-57bc-4e60-9995-14aa0205034a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:55.562264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8804c7d-57bc-4e60-9995-14aa0205034a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:55.563481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8804c7d-57bc-4e60-9995-14aa0205034a None admin] RBAC: Adding query filter params (interface=public, service_id=97559618fa064eb5abaa955a2ce422aa, region_id=RegionOne) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:55.564018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8804c7d-57bc-4e60-9995-14aa0205034a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:55.565869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8804c7d-57bc-4e60-9995-14aa0205034a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:55.580399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 471/946] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 07:01:55 2022] GET /identity/v3/endpoints?service_id=97559618fa064eb5abaa955a2ce422aa&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:55.581815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8804c7d-57bc-4e60-9995-14aa0205034a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:55.587088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:55.661560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af36900-c8d3-44b4-8d0b-0abec8d6044d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:55.699441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8804c7d-57bc-4e60-9995-14aa0205034a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:55.706671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a905062-84c1-4e91-9174-89accc280f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:55.707334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a905062-84c1-4e91-9174-89accc280f58 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:55.707614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a905062-84c1-4e91-9174-89accc280f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:55.707885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a905062-84c1-4e91-9174-89accc280f58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:55.717567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a905062-84c1-4e91-9174-89accc280f58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:55.719954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a905062-84c1-4e91-9174-89accc280f58 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2a905062-84c1-4e91-9174-89accc280f58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:55.736172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:55.737477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:55.738362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:55.738362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:55.738362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:55.738362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:55.738362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:55.738362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:55.738362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:55.738362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:55.741052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 476/947] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:55.743249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a905062-84c1-4e91-9174-89accc280f58 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:55.747996 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175fc5d-1aa6-4f70-9186-10553e13d21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:55.748945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175fc5d-1aa6-4f70-9186-10553e13d21b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:55.749391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175fc5d-1aa6-4f70-9186-10553e13d21b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:55.749790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175fc5d-1aa6-4f70-9186-10553e13d21b None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:55.750664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175fc5d-1aa6-4f70-9186-10553e13d21b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:55.752265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175fc5d-1aa6-4f70-9186-10553e13d21b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:55.768999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:55.769691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 472/948] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 07:01:55 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:01:55.861949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a905062-84c1-4e91-9174-89accc280f58 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:55.900782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80995417-271a-4261-a24f-d321510ba15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:55.901617 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80995417-271a-4261-a24f-d321510ba15e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:55.901992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80995417-271a-4261-a24f-d321510ba15e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:55.902363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80995417-271a-4261-a24f-d321510ba15e None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:55.903201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80995417-271a-4261-a24f-d321510ba15e None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:55.903674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80995417-271a-4261-a24f-d321510ba15e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:55.905256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80995417-271a-4261-a24f-d321510ba15e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:55.933177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 477/949] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:01:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:56.875331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5949f96-02bf-4215-a60b-f5b3e51fe753 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:56.875900 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5949f96-02bf-4215-a60b-f5b3e51fe753 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:56.875900 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5949f96-02bf-4215-a60b-f5b3e51fe753 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:56.877621 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 473/950] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:56.883291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7bb9-da2e-43f0-9eb3-094534dbe50f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:56.883814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7bb9-da2e-43f0-9eb3-094534dbe50f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:56.883814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7bb9-da2e-43f0-9eb3-094534dbe50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:56.903373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-331d7bb9-da2e-43f0-9eb3-094534dbe50f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:56.904920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-331d7bb9-da2e-43f0-9eb3-094534dbe50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:56.985564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:56.993895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 478/951] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:01:57.015936 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5949f96-02bf-4215-a60b-f5b3e51fe753 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:57.032203 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64a277-7db3-4b95-acb8-eca0157c87a8 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:57.032553 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64a277-7db3-4b95-acb8-eca0157c87a8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:57.032767 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64a277-7db3-4b95-acb8-eca0157c87a8 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:57.034355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 479/952] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:01:57.039742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb79bbc-9aa2-4b65-bbd1-eac71361d319 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:57.040111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb79bbc-9aa2-4b65-bbd1-eac71361d319 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:57.040273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb79bbc-9aa2-4b65-bbd1-eac71361d319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:57.058687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1cb79bbc-9aa2-4b65-bbd1-eac71361d319 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:57.059881 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1cb79bbc-9aa2-4b65-bbd1-eac71361d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:57.098981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:57.143501 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5949f96-02bf-4215-a60b-f5b3e51fe753 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:57.154229 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 480/953] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:57.177112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb79bbc-9aa2-4b65-bbd1-eac71361d319 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:57.191032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9712501-2613-4d10-a492-9732dca8252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:57.191751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9712501-2613-4d10-a492-9732dca8252d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:57.192137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9712501-2613-4d10-a492-9732dca8252d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:57.192416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9712501-2613-4d10-a492-9732dca8252d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:57.193229 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9712501-2613-4d10-a492-9732dca8252d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:57.194708 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9712501-2613-4d10-a492-9732dca8252d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e9712501-2613-4d10-a492-9732dca8252d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:57.205223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:57.206276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:57.207319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 474/954] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:57.214529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9712501-2613-4d10-a492-9732dca8252d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:57.292247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb79bbc-9aa2-4b65-bbd1-eac71361d319 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:57.324666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:57.331179 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92b93c-5b61-460c-b2a2-c640877213f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:57.332282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b93c-5b61-460c-b2a2-c640877213f3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:57.332562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b93c-5b61-460c-b2a2-c640877213f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:57.332835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b93c-5b61-460c-b2a2-c640877213f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:57.346404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92b93c-5b61-460c-b2a2-c640877213f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6c92b93c-5b61-460c-b2a2-c640877213f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:01:57.351525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:57.352745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:57.353651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 481/955] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Aug 5 07:01:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:01:57.359025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92b93c-5b61-460c-b2a2-c640877213f3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:57.361865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9712501-2613-4d10-a492-9732dca8252d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:57.401381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:57.418088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342c22-5662-495b-90c4-64850449857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:57.419334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342c22-5662-495b-90c4-64850449857c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:57.419811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342c22-5662-495b-90c4-64850449857c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:57.420533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7342c22-5662-495b-90c4-64850449857c None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:57.421992 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342c22-5662-495b-90c4-64850449857c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:57.422492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342c22-5662-495b-90c4-64850449857c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:57.424210 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7342c22-5662-495b-90c4-64850449857c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:57.436009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 475/956] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:01:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:57.437831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342c22-5662-495b-90c4-64850449857c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:57.492942 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92b93c-5b61-460c-b2a2-c640877213f3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:57.534046 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef149873-99ff-45dc-a5af-83dfc07d6843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:57.534302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef149873-99ff-45dc-a5af-83dfc07d6843 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:57.534685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef149873-99ff-45dc-a5af-83dfc07d6843 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:57.535027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef149873-99ff-45dc-a5af-83dfc07d6843 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:57.535828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef149873-99ff-45dc-a5af-83dfc07d6843 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:57.536195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef149873-99ff-45dc-a5af-83dfc07d6843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:57.538133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef149873-99ff-45dc-a5af-83dfc07d6843 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:57.552839 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 482/957] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 07:01:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:01:57.553951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef149873-99ff-45dc-a5af-83dfc07d6843 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:57.580604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7342c22-5662-495b-90c4-64850449857c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:57.621435 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:57.622981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdead122-9463-4476-ab1b-243be7379325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:57.623559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdead122-9463-4476-ab1b-243be7379325 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:57.623841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdead122-9463-4476-ab1b-243be7379325 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:57.624250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdead122-9463-4476-ab1b-243be7379325 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:57.625187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdead122-9463-4476-ab1b-243be7379325 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:57.625614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdead122-9463-4476-ab1b-243be7379325 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:57.627894 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdead122-9463-4476-ab1b-243be7379325 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:57.633586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 476/958] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:01:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:57.682644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef149873-99ff-45dc-a5af-83dfc07d6843 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:57.723303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b89696-a1f4-4575-9e1a-353984063b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:57.724338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b89696-a1f4-4575-9e1a-353984063b89 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:57.724824 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b89696-a1f4-4575-9e1a-353984063b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:57.725311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b89696-a1f4-4575-9e1a-353984063b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:57.738897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b89696-a1f4-4575-9e1a-353984063b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:57.740727 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b89696-a1f4-4575-9e1a-353984063b89 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-56b89696-a1f4-4575-9e1a-353984063b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:57.757761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:57.758940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:57.760053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:57.760053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:57.760053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:57.760053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:57.762055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 483/959] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:57.770561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdead122-9463-4476-ab1b-243be7379325 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:57.840107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:57.891150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdead122-9463-4476-ab1b-243be7379325 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:57.899748 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820be66-c5a2-40ac-9810-aa7a1229bc2f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:57.900267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820be66-c5a2-40ac-9810-aa7a1229bc2f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:57.900521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820be66-c5a2-40ac-9810-aa7a1229bc2f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:57.902333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 484/960] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:01:57.907960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3b1e9-2168-410e-9a33-d7fbe1072044 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:57.908352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3b1e9-2168-410e-9a33-d7fbe1072044 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:57.908722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3b1e9-2168-410e-9a33-d7fbe1072044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:57.929560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-90b3b1e9-2168-410e-9a33-d7fbe1072044 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:57.931225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-90b3b1e9-2168-410e-9a33-d7fbe1072044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:57.937750 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618d4dc-e73f-4a59-8b71-601154c275cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:57.938323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618d4dc-e73f-4a59-8b71-601154c275cf None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:57.938598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618d4dc-e73f-4a59-8b71-601154c275cf None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:57.938869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618d4dc-e73f-4a59-8b71-601154c275cf None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:57.939579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618d4dc-e73f-4a59-8b71-601154c275cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:57.939884 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618d4dc-e73f-4a59-8b71-601154c275cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:57.941304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618d4dc-e73f-4a59-8b71-601154c275cf None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:57.957194 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 477/961] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:57.964599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618d4dc-e73f-4a59-8b71-601154c275cf None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:58.037467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 485/962] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:58.048646 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59048850-e953-406c-99be-f47c8a59a443 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:58.049118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59048850-e953-406c-99be-f47c8a59a443 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:58.049399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59048850-e953-406c-99be-f47c8a59a443 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:58.051062 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 486/963] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:58.056689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd590a03-e0c7-46c1-9f8f-af21f2865d24 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:58.057014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd590a03-e0c7-46c1-9f8f-af21f2865d24 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:58.057295 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd590a03-e0c7-46c1-9f8f-af21f2865d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:58.076518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bd590a03-e0c7-46c1-9f8f-af21f2865d24 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:58.077731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bd590a03-e0c7-46c1-9f8f-af21f2865d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:58.099534 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618d4dc-e73f-4a59-8b71-601154c275cf None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:58.109788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:58.127056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:58.146130 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32594d4-dce2-4249-a733-bbc09bd71382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:58.146790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32594d4-dce2-4249-a733-bbc09bd71382 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:58.147066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32594d4-dce2-4249-a733-bbc09bd71382 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:58.147392 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32594d4-dce2-4249-a733-bbc09bd71382 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:58.156058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32594d4-dce2-4249-a733-bbc09bd71382 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:58.156813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 487/964] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:58.157719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32594d4-dce2-4249-a733-bbc09bd71382 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:58.171120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd590a03-e0c7-46c1-9f8f-af21f2865d24 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-f32594d4-dce2-4249-a733-bbc09bd71382 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:58.171311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:58.172251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:58.173236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:58.173236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:58.173236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:58.173236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:58.173236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:58.173236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:58.173236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:58.173236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:58.173236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 07:01:58.173236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:58.173236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 478/965] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 07:01:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:58.178530 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32594d4-dce2-4249-a733-bbc09bd71382 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:58.304188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd590a03-e0c7-46c1-9f8f-af21f2865d24 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:58.312783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32594d4-dce2-4249-a733-bbc09bd71382 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:58.346199 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926d8b3-d804-41e7-9500-749f9a12e29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:58.346864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926d8b3-d804-41e7-9500-749f9a12e29a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:58.347316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926d8b3-d804-41e7-9500-749f9a12e29a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:58.347603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926d8b3-d804-41e7-9500-749f9a12e29a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:58.348268 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926d8b3-d804-41e7-9500-749f9a12e29a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:58.350039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926d8b3-d804-41e7-9500-749f9a12e29a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:58.356917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230716d-2ecd-4513-97d7-5b03bd01d1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:58.357843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230716d-2ecd-4513-97d7-5b03bd01d1bd None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:58.358296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230716d-2ecd-4513-97d7-5b03bd01d1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:58.358772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230716d-2ecd-4513-97d7-5b03bd01d1bd None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2926d8b3-d804-41e7-9500-749f9a12e29a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:58.360025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:58.361080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:01:58.361908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:58.362660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230716d-2ecd-4513-97d7-5b03bd01d1bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:58.362660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230716d-2ecd-4513-97d7-5b03bd01d1bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:58.364529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230716d-2ecd-4513-97d7-5b03bd01d1bd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:58.366479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 488/966] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 07:01:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:58.367094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926d8b3-d804-41e7-9500-749f9a12e29a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:58.392640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 479/967] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Aug 5 07:01:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:58.393668 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230716d-2ecd-4513-97d7-5b03bd01d1bd None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:58.398991 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:58.442693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:58.474720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926d8b3-d804-41e7-9500-749f9a12e29a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:58.511256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230716d-2ecd-4513-97d7-5b03bd01d1bd None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:58.515039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533ca5-86f7-49bb-8046-cf77d835613c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:58.515442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533ca5-86f7-49bb-8046-cf77d835613c None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:58.515837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533ca5-86f7-49bb-8046-cf77d835613c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:58.516081 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533ca5-86f7-49bb-8046-cf77d835613c None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:58.516735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e533ca5-86f7-49bb-8046-cf77d835613c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:58.518245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e533ca5-86f7-49bb-8046-cf77d835613c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:58.533648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.sql.core [None req-1e533ca5-86f7-49bb-8046-cf77d835613c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 07:01:58.533648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 05 07:01:58.533648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [parameters: {'user_id': 'b28d5e6777c14e2aa708b3bc8a12b9bf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 05 07:01:58.533648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80394) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-1e533ca5-86f7-49bb-8046-cf77d835613c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application conn.query(q) Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result.read() Aug 05 07:01:58.542116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 07:01:58.543013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application next(self.gen) Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application yield resource Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application next(self.gen) Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise self.value Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application session.commit() Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 07:01:58.543975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.session.flush() Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application compat.raise_( Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 07:01:58.545943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 07:01:58.546849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application conn.query(q) Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result.read() Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 07:01:58.547829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b28d5e6777c14e2aa708b3bc8a12b9bf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:58.548667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 05 07:01:58.552324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 05 07:01:58.554614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 05 07:01:58.554614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 05 07:01:58.554614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 07:01:58.554614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 07:01:58.554614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 05 07:01:58.554614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:58.554614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 489/968] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Aug 5 07:01:58 2022] POST /identity/v3/users => generated 160 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:58.554614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533ca5-86f7-49bb-8046-cf77d835613c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:58.557458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91359a83-2625-49a8-ad0f-f631a564a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:58.558155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91359a83-2625-49a8-ad0f-f631a564a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:58.558431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91359a83-2625-49a8-ad0f-f631a564a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:58.558802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91359a83-2625-49a8-ad0f-f631a564a4b9 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:58.559377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91359a83-2625-49a8-ad0f-f631a564a4b9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:58.559677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91359a83-2625-49a8-ad0f-f631a564a4b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:58.561096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91359a83-2625-49a8-ad0f-f631a564a4b9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:58.566457 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 480/969] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 07:01:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:58.567222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91359a83-2625-49a8-ad0f-f631a564a4b9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:58.677527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:58.695283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533ca5-86f7-49bb-8046-cf77d835613c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:58.707234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91359a83-2625-49a8-ad0f-f631a564a4b9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:58.709613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:58.741709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7a351-f332-47b9-9f24-9f928aa5ab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:58.742343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7a351-f332-47b9-9f24-9f928aa5ab1d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:58.742617 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7a351-f332-47b9-9f24-9f928aa5ab1d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:58.742883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7a351-f332-47b9-9f24-9f928aa5ab1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:58.751763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137abae2-7420-42f9-990f-4d5a255ce3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:58.752979 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137abae2-7420-42f9-990f-4d5a255ce3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:58.753264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137abae2-7420-42f9-990f-4d5a255ce3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:58.753547 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137abae2-7420-42f9-990f-4d5a255ce3b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:58.763506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137abae2-7420-42f9-990f-4d5a255ce3b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:58.765364 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137abae2-7420-42f9-990f-4d5a255ce3b4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-137abae2-7420-42f9-990f-4d5a255ce3b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:01:58.779939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:58.781645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:58.782596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:58.782596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:58.782596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:01:58.782596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:01:58.782596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:01:58.782596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:01:58.782596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:01:58.782596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:01:58.782596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 07:01:58.782596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:01:58.782596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 481/970] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:01:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:58.782596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137abae2-7420-42f9-990f-4d5a255ce3b4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:58.833136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7a351-f332-47b9-9f24-9f928aa5ab1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:58.834731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7a351-f332-47b9-9f24-9f928aa5ab1d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:58.914209 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137abae2-7420-42f9-990f-4d5a255ce3b4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:58.961139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:58.966074 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d3ff2-55b1-48ba-b481-e18940b96c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:58.966720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d3ff2-55b1-48ba-b481-e18940b96c81 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:58.966971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d3ff2-55b1-48ba-b481-e18940b96c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:58.967236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d3ff2-55b1-48ba-b481-e18940b96c81 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:58.967905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d3ff2-55b1-48ba-b481-e18940b96c81 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:58.968204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d3ff2-55b1-48ba-b481-e18940b96c81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:58.969699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d3ff2-55b1-48ba-b481-e18940b96c81 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:58.975417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 482/971] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 07:01:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:58.976168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d3ff2-55b1-48ba-b481-e18940b96c81 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:58.988594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 490/972] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:01:58 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:01:58.988594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7a351-f332-47b9-9f24-9f928aa5ab1d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:59.012204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:59.108824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d3ff2-55b1-48ba-b481-e18940b96c81 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:59.112936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7a351-f332-47b9-9f24-9f928aa5ab1d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:59.147092 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f0c78-65ae-426f-b5d5-97039549a741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:59.147707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0c78-65ae-426f-b5d5-97039549a741 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:59.147946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0c78-65ae-426f-b5d5-97039549a741 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:59.148227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0c78-65ae-426f-b5d5-97039549a741 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:59.149001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f0c78-65ae-426f-b5d5-97039549a741 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:59.149442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f0c78-65ae-426f-b5d5-97039549a741 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:59.150891 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f0c78-65ae-426f-b5d5-97039549a741 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:59.155255 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa4986-64ff-453d-99ab-329649278b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:59.156154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa4986-64ff-453d-99ab-329649278b95 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:59.156655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa4986-64ff-453d-99ab-329649278b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:59.157133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa4986-64ff-453d-99ab-329649278b95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:59.158029 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa4986-64ff-453d-99ab-329649278b95 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:59.159582 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa4986-64ff-453d-99ab-329649278b95 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:59.188592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 491/973] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:01:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:01:59.189339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 483/974] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Aug 5 07:01:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:59.189469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa4986-64ff-453d-99ab-329649278b95 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:59.261971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:59.351252 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa4986-64ff-453d-99ab-329649278b95 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:59.396293 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b0871-4086-4873-943a-8001fec8e3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:59.397327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0871-4086-4873-943a-8001fec8e3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:59.397803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0871-4086-4873-943a-8001fec8e3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:59.398260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0871-4086-4873-943a-8001fec8e3f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:59.411234 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b0871-4086-4873-943a-8001fec8e3f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:59.413390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b0871-4086-4873-943a-8001fec8e3f8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f01b0871-4086-4873-943a-8001fec8e3f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:01:59.429712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:59.430672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:59.431684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:01:59.431684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:01:59.431684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:01:59.431684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:59.431684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 492/975] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:59.438133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f0c78-65ae-426f-b5d5-97039549a741 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:59.530059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:59.548207 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f0c78-65ae-426f-b5d5-97039549a741 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:59.582073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda1a80-42e2-43e3-b5dc-4c3291d842fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:59.582763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1a80-42e2-43e3-b5dc-4c3291d842fb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:59.583038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1a80-42e2-43e3-b5dc-4c3291d842fb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:59.583306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1a80-42e2-43e3-b5dc-4c3291d842fb None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:59.584024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda1a80-42e2-43e3-b5dc-4c3291d842fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:59.584323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda1a80-42e2-43e3-b5dc-4c3291d842fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:59.585754 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda1a80-42e2-43e3-b5dc-4c3291d842fb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:59.602394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 484/976] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:59.603584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b0871-4086-4873-943a-8001fec8e3f8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:59.701951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:59.709736 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b0871-4086-4873-943a-8001fec8e3f8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:59.744134 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc829236-0d9f-42cc-9c08-5a930f10514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:59.744782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc829236-0d9f-42cc-9c08-5a930f10514a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:59.745089 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc829236-0d9f-42cc-9c08-5a930f10514a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:59.745359 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc829236-0d9f-42cc-9c08-5a930f10514a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:59.752621 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc829236-0d9f-42cc-9c08-5a930f10514a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:59.754101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc829236-0d9f-42cc-9c08-5a930f10514a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:59.758738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9baf1-cb8f-4864-b02d-6f8c22068061 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:59.759028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9baf1-cb8f-4864-b02d-6f8c22068061 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:59.759301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9baf1-cb8f-4864-b02d-6f8c22068061 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:59.760676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 485/977] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:01:59.765500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14c6d8-66ab-4520-b7ed-6e7d3282363e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:59.765828 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14c6d8-66ab-4520-b7ed-6e7d3282363e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-bc829236-0d9f-42cc-9c08-5a930f10514a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:01:59.765985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:01:59.766919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:01:59.772875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:01:59.772875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:01:59.772875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:01:59.772875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:01:59.772875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:01:59.772875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:01:59.772875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:01:59.772875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:01:59.773359 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14c6d8-66ab-4520-b7ed-6e7d3282363e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:59.773434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 493/978] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:01:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:01:59.773434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc829236-0d9f-42cc-9c08-5a930f10514a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:59.786220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ca14c6d8-66ab-4520-b7ed-6e7d3282363e None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:01:59.787883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ca14c6d8-66ab-4520-b7ed-6e7d3282363e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:01:59.858632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 486/979] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:01:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:01:59.878512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc829236-0d9f-42cc-9c08-5a930f10514a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:01:59.880765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14c6d8-66ab-4520-b7ed-6e7d3282363e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:59.917587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7fc10-d230-4850-9cb6-c9f5ea01d9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:01:59.918210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7fc10-d230-4850-9cb6-c9f5ea01d9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:01:59.918489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7fc10-d230-4850-9cb6-c9f5ea01d9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:01:59.918760 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7fc10-d230-4850-9cb6-c9f5ea01d9f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:01:59.919510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7fc10-d230-4850-9cb6-c9f5ea01d9f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:01:59.919815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7fc10-d230-4850-9cb6-c9f5ea01d9f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:01:59.921266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7fc10-d230-4850-9cb6-c9f5ea01d9f6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:01:59.934785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 494/980] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:01:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:01:59.940615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7fc10-d230-4850-9cb6-c9f5ea01d9f6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:01:59.956337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:59.961253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:01:59.990701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14c6d8-66ab-4520-b7ed-6e7d3282363e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:00.026914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74a3bb-a022-425e-9f2b-a4a441f62c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:00.027648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74a3bb-a022-425e-9f2b-a4a441f62c59 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:00.027954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74a3bb-a022-425e-9f2b-a4a441f62c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:00.028222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74a3bb-a022-425e-9f2b-a4a441f62c59 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:00.028987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74a3bb-a022-425e-9f2b-a4a441f62c59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:00.030388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74a3bb-a022-425e-9f2b-a4a441f62c59 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:00.046004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7fc10-d230-4850-9cb6-c9f5ea01d9f6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:00.057032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 487/981] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:01:59 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:02:00.100530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92845ba4-f068-4776-ab27-fb7107489f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:00.101200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92845ba4-f068-4776-ab27-fb7107489f51 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:00.101481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92845ba4-f068-4776-ab27-fb7107489f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:00.101756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92845ba4-f068-4776-ab27-fb7107489f51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:00.102561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92845ba4-f068-4776-ab27-fb7107489f51 None admin] RBAC: Adding query filter params (role.id=203154726d1340b6b60888f02c96c1e8, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=0dc4cfe4a3ce4e34a1b664d99eb34d2a) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:00.102876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92845ba4-f068-4776-ab27-fb7107489f51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:00.104340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92845ba4-f068-4776-ab27-fb7107489f51 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:00.111877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 495/982] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:01:59 2022] GET /identity/v3/role_assignments?user.id=0dc4cfe4a3ce4e34a1b664d99eb34d2a&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=203154726d1340b6b60888f02c96c1e8 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:01.299458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef5a33-0eb3-4fb5-8924-1b26ff16a319 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:01.299986 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef5a33-0eb3-4fb5-8924-1b26ff16a319 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:01.299986 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef5a33-0eb3-4fb5-8924-1b26ff16a319 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:01.301415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 488/983] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:01.307033 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe19fac-019f-4a73-b988-a4dd646419a3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:01.307493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe19fac-019f-4a73-b988-a4dd646419a3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:01.307577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe19fac-019f-4a73-b988-a4dd646419a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:01.327580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bfe19fac-019f-4a73-b988-a4dd646419a3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:01.329231 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bfe19fac-019f-4a73-b988-a4dd646419a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:01.404286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 496/984] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:01.427080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef5a33-0eb3-4fb5-8924-1b26ff16a319 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:01.531966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef5a33-0eb3-4fb5-8924-1b26ff16a319 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:01.566478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7d048-2f75-475f-a238-0ccaf883defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:01.567125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7d048-2f75-475f-a238-0ccaf883defa None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:01.567404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7d048-2f75-475f-a238-0ccaf883defa None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:01.567677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7d048-2f75-475f-a238-0ccaf883defa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:01.568311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7d048-2f75-475f-a238-0ccaf883defa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:01.569717 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7d048-2f75-475f-a238-0ccaf883defa None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:01.571544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-29c7d048-2f75-475f-a238-0ccaf883defa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:01.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:01.582196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:01.583059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 489/985] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 07:02:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:02:01.590663 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe19fac-019f-4a73-b988-a4dd646419a3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:01.594057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:01.700470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe19fac-019f-4a73-b988-a4dd646419a3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:01.735933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9902b-307b-4e29-b19f-5a83253bdb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:01.736566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9902b-307b-4e29-b19f-5a83253bdb68 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:01.736846 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9902b-307b-4e29-b19f-5a83253bdb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:01.737149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9902b-307b-4e29-b19f-5a83253bdb68 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:01.737840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9902b-307b-4e29-b19f-5a83253bdb68 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:01.738142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9902b-307b-4e29-b19f-5a83253bdb68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:01.739509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9902b-307b-4e29-b19f-5a83253bdb68 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:01.744922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 497/986] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 07:02:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:01.750790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7d048-2f75-475f-a238-0ccaf883defa None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:01.855620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7d048-2f75-475f-a238-0ccaf883defa None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:01.890796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8fa83-79f4-4426-bb9e-4b002ab4a350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:01.891431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8fa83-79f4-4426-bb9e-4b002ab4a350 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:01.891711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8fa83-79f4-4426-bb9e-4b002ab4a350 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:01.891985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8fa83-79f4-4426-bb9e-4b002ab4a350 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:01.892668 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8fa83-79f4-4426-bb9e-4b002ab4a350 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:01.893012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8fa83-79f4-4426-bb9e-4b002ab4a350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:01.894393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8fa83-79f4-4426-bb9e-4b002ab4a350 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:01.904343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 490/987] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 07:02:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:01.905646 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9902b-307b-4e29-b19f-5a83253bdb68 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:01.983225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:02.023740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9902b-307b-4e29-b19f-5a83253bdb68 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:02.060884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817202eb-9a04-4ae5-a142-6e9e5d7cb107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:02.061549 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817202eb-9a04-4ae5-a142-6e9e5d7cb107 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.061826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817202eb-9a04-4ae5-a142-6e9e5d7cb107 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.062094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817202eb-9a04-4ae5-a142-6e9e5d7cb107 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.063047 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817202eb-9a04-4ae5-a142-6e9e5d7cb107 None admin] RBAC: Adding query filter params (interface=admin, service_id=97559618fa064eb5abaa955a2ce422aa, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:02.063356 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817202eb-9a04-4ae5-a142-6e9e5d7cb107 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:02.064770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817202eb-9a04-4ae5-a142-6e9e5d7cb107 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:02.071164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 498/988] 10.222.0.27 () {56 vars in 1249 bytes} [Fri Aug 5 07:02:01 2022] GET /identity/v3/endpoints?service_id=97559618fa064eb5abaa955a2ce422aa&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:02.076879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8fa83-79f4-4426-bb9e-4b002ab4a350 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:02.080604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b557a56-709c-4060-ba49-0185e5b33f6f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.080909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b557a56-709c-4060-ba49-0185e5b33f6f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.081211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b557a56-709c-4060-ba49-0185e5b33f6f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.082852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 499/989] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:02.088007 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d8118-bd88-4603-a56d-f895383bc305 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.088416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d8118-bd88-4603-a56d-f895383bc305 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.088697 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d8118-bd88-4603-a56d-f895383bc305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.108817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c29d8118-bd88-4603-a56d-f895383bc305 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:02.110713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c29d8118-bd88-4603-a56d-f895383bc305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:02.147637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:02.187035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 500/990] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:02.187460 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8fa83-79f4-4426-bb9e-4b002ab4a350 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:02.188378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d75b71-4559-4715-990a-e5babc2c91b1 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.188662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d75b71-4559-4715-990a-e5babc2c91b1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.188967 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d75b71-4559-4715-990a-e5babc2c91b1 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.190525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 501/991] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:02.195698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6a8aa-358a-431d-8862-955526a56a2e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.195972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6a8aa-358a-431d-8862-955526a56a2e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.196242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6a8aa-358a-431d-8862-955526a56a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.215626 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7eb6a8aa-358a-431d-8862-955526a56a2e None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:02.216834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7eb6a8aa-358a-431d-8862-955526a56a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:02.224619 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb0313-5309-48ea-9053-ec894c027a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:02.225449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb0313-5309-48ea-9053-ec894c027a0f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.225735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb0313-5309-48ea-9053-ec894c027a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.226011 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb0313-5309-48ea-9053-ec894c027a0f None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.226672 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb0313-5309-48ea-9053-ec894c027a0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:02.228057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb0313-5309-48ea-9053-ec894c027a0f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:02.234824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 491/992] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 07:02:02 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:02:02.235448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb0313-5309-48ea-9053-ec894c027a0f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:02.295255 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:02.313079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 502/993] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:02:02.336390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6a8aa-358a-431d-8862-955526a56a2e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:02.366688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb0313-5309-48ea-9053-ec894c027a0f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:02.396788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:02.409069 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967da8ca-c6ce-4701-9b95-eaa8fda46483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:02.409740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967da8ca-c6ce-4701-9b95-eaa8fda46483 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.410033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967da8ca-c6ce-4701-9b95-eaa8fda46483 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.410317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967da8ca-c6ce-4701-9b95-eaa8fda46483 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.410914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967da8ca-c6ce-4701-9b95-eaa8fda46483 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:02.412638 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967da8ca-c6ce-4701-9b95-eaa8fda46483 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-967da8ca-c6ce-4701-9b95-eaa8fda46483 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:02.423867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:02.425046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 07:02:02.425896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:02.426643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 492/994] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:02:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:02.434988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967da8ca-c6ce-4701-9b95-eaa8fda46483 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:02.484729 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6a8aa-358a-431d-8862-955526a56a2e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:02.520852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888382a-6d2f-4301-a233-e2476624b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:02.521526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888382a-6d2f-4301-a233-e2476624b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.521808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888382a-6d2f-4301-a233-e2476624b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.522083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888382a-6d2f-4301-a233-e2476624b4c2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.522712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888382a-6d2f-4301-a233-e2476624b4c2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:02.524083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888382a-6d2f-4301-a233-e2476624b4c2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-3888382a-6d2f-4301-a233-e2476624b4c2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:02.534141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:02.535156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:02.538042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 503/995] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Aug 5 07:02:02 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:02:02.541720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888382a-6d2f-4301-a233-e2476624b4c2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:02.552437 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967da8ca-c6ce-4701-9b95-eaa8fda46483 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:02.590411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c6622-2b0f-41a8-9a53-83ef09516269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:02.591061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c6622-2b0f-41a8-9a53-83ef09516269 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.591339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c6622-2b0f-41a8-9a53-83ef09516269 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.591611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c6622-2b0f-41a8-9a53-83ef09516269 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.592320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c6622-2b0f-41a8-9a53-83ef09516269 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:02.592624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c6622-2b0f-41a8-9a53-83ef09516269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:02.594149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c6622-2b0f-41a8-9a53-83ef09516269 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:02.603894 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 493/996] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:02:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:02.604973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c6622-2b0f-41a8-9a53-83ef09516269 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:02.609932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:02.657427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888382a-6d2f-4301-a233-e2476624b4c2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:02.670584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:02.693506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab165116-0999-4b72-b35f-237f914d0a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:02.694134 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab165116-0999-4b72-b35f-237f914d0a23 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.694414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab165116-0999-4b72-b35f-237f914d0a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.694687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab165116-0999-4b72-b35f-237f914d0a23 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.695369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab165116-0999-4b72-b35f-237f914d0a23 None admin] RBAC: Adding query filter params (name=image) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:02.695673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab165116-0999-4b72-b35f-237f914d0a23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:02.697116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab165116-0999-4b72-b35f-237f914d0a23 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:02.706896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 504/997] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:02.707936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab165116-0999-4b72-b35f-237f914d0a23 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:02.730436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c6622-2b0f-41a8-9a53-83ef09516269 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:02.765556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939867a-1679-4523-b3a3-e15f44dd62a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:02.766632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939867a-1679-4523-b3a3-e15f44dd62a7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.766632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939867a-1679-4523-b3a3-e15f44dd62a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.766834 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939867a-1679-4523-b3a3-e15f44dd62a7 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.767467 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939867a-1679-4523-b3a3-e15f44dd62a7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:02.767766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939867a-1679-4523-b3a3-e15f44dd62a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:02.769218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939867a-1679-4523-b3a3-e15f44dd62a7 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:02.774983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 494/998] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:02:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:02.780694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939867a-1679-4523-b3a3-e15f44dd62a7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:02.825635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab165116-0999-4b72-b35f-237f914d0a23 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:02.847488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:02.863535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2700f-2110-48ef-91d0-6dcbbd09cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:02.864168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2700f-2110-48ef-91d0-6dcbbd09cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.864512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2700f-2110-48ef-91d0-6dcbbd09cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.864785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2700f-2110-48ef-91d0-6dcbbd09cfa4 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.865602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2700f-2110-48ef-91d0-6dcbbd09cfa4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:02.865911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2700f-2110-48ef-91d0-6dcbbd09cfa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:02.867389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2700f-2110-48ef-91d0-6dcbbd09cfa4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:02.872618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 505/999] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:02.896536 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939867a-1679-4523-b3a3-e15f44dd62a7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:02.917679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:02.942072 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454151c5-ee67-4cc7-9de0-6449e69b16e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:02.942744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454151c5-ee67-4cc7-9de0-6449e69b16e6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:02.943055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454151c5-ee67-4cc7-9de0-6449e69b16e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:02.943313 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454151c5-ee67-4cc7-9de0-6449e69b16e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:02.944091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454151c5-ee67-4cc7-9de0-6449e69b16e6 None admin] RBAC: Adding query filter params (interface=public, service_id=90cbf91c1c6b483da3f75db61b03adf3, region_id=RegionOne) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:02.944401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454151c5-ee67-4cc7-9de0-6449e69b16e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:02.946010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454151c5-ee67-4cc7-9de0-6449e69b16e6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:02.952719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 495/1000] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 07:02:02 2022] GET /identity/v3/endpoints?service_id=90cbf91c1c6b483da3f75db61b03adf3&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:02.958955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2700f-2110-48ef-91d0-6dcbbd09cfa4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:03.093566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2700f-2110-48ef-91d0-6dcbbd09cfa4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:03.148875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779981e6-bb0d-4ab5-9dd1-707efea188d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:03.149855 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779981e6-bb0d-4ab5-9dd1-707efea188d7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:03.150322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779981e6-bb0d-4ab5-9dd1-707efea188d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:03.150757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779981e6-bb0d-4ab5-9dd1-707efea188d7 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:03.151808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779981e6-bb0d-4ab5-9dd1-707efea188d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:03.153740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779981e6-bb0d-4ab5-9dd1-707efea188d7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:03.163736 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 506/1001] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 07:02:02 2022] GET /identity/v3/services => generated 1727 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:02:04.254275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe88fd-adde-4821-b655-1a77f5dcda1c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:04.254816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe88fd-adde-4821-b655-1a77f5dcda1c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:04.254816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe88fd-adde-4821-b655-1a77f5dcda1c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:04.256149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 496/1002] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:04.262196 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251afeeb-4459-4323-b1d0-86954a83b76a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:04.262650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251afeeb-4459-4323-b1d0-86954a83b76a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:04.262750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251afeeb-4459-4323-b1d0-86954a83b76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:04.285064 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-251afeeb-4459-4323-b1d0-86954a83b76a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:04.286406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-251afeeb-4459-4323-b1d0-86954a83b76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:04.336698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:04.364279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 507/1003] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:04.387045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe88fd-adde-4821-b655-1a77f5dcda1c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:04.525561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe88fd-adde-4821-b655-1a77f5dcda1c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:04.564990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56275033-1c6a-4de9-9847-56da02f179fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:04.565691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56275033-1c6a-4de9-9847-56da02f179fb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:04.565966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56275033-1c6a-4de9-9847-56da02f179fb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:04.566238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56275033-1c6a-4de9-9847-56da02f179fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:04.566863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56275033-1c6a-4de9-9847-56da02f179fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:04.568230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56275033-1c6a-4de9-9847-56da02f179fb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-56275033-1c6a-4de9-9847-56da02f179fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:04.577722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:04.579021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 07:02:04.579881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:04.584317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 497/1004] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Aug 5 07:02:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:04.585226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251afeeb-4459-4323-b1d0-86954a83b76a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:04.689192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251afeeb-4459-4323-b1d0-86954a83b76a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:04.724328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b86cc-d74b-4c22-8d44-6937902d8acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:04.724992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b86cc-d74b-4c22-8d44-6937902d8acf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:04.725273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b86cc-d74b-4c22-8d44-6937902d8acf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:04.725547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b86cc-d74b-4c22-8d44-6937902d8acf None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:04.726222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b86cc-d74b-4c22-8d44-6937902d8acf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:04.726525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b86cc-d74b-4c22-8d44-6937902d8acf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:04.727891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b86cc-d74b-4c22-8d44-6937902d8acf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:04.733138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 508/1005] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 07:02:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:04.738702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56275033-1c6a-4de9-9847-56da02f179fb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:04.787714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:04.845660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56275033-1c6a-4de9-9847-56da02f179fb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:04.881117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfd4f6-f652-44d1-a034-9a9a958ae2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:04.881746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfd4f6-f652-44d1-a034-9a9a958ae2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:04.882026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfd4f6-f652-44d1-a034-9a9a958ae2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:04.882302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfd4f6-f652-44d1-a034-9a9a958ae2a5 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:04.882980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfd4f6-f652-44d1-a034-9a9a958ae2a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:04.883287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfd4f6-f652-44d1-a034-9a9a958ae2a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:04.884655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfd4f6-f652-44d1-a034-9a9a958ae2a5 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:04.894498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 498/1006] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Aug 5 07:02:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:04.896382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b86cc-d74b-4c22-8d44-6937902d8acf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:04.905105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb2d1-74d6-40f9-87ac-c75bc5edb294 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:04.905407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb2d1-74d6-40f9-87ac-c75bc5edb294 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:04.905681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb2d1-74d6-40f9-87ac-c75bc5edb294 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:04.907164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 499/1007] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:04.912924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8640f-271b-4b42-ad2d-efc2929d50b5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:04.913246 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8640f-271b-4b42-ad2d-efc2929d50b5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:04.913520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8640f-271b-4b42-ad2d-efc2929d50b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:04.932310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-05a8640f-271b-4b42-ad2d-efc2929d50b5 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:04.933525 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-05a8640f-271b-4b42-ad2d-efc2929d50b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:04.945602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:05.014150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b86cc-d74b-4c22-8d44-6937902d8acf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:05.020709 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 500/1008] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:02:05.036164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8640f-271b-4b42-ad2d-efc2929d50b5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:05.052214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75008490-c773-4d00-bf91-669cdd1b1759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:05.052755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75008490-c773-4d00-bf91-669cdd1b1759 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:05.053138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75008490-c773-4d00-bf91-669cdd1b1759 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:05.053419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75008490-c773-4d00-bf91-669cdd1b1759 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:05.054114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75008490-c773-4d00-bf91-669cdd1b1759 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:05.055482 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75008490-c773-4d00-bf91-669cdd1b1759 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:05.080922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 509/1009] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:02:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:02:05.084451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:05.148429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8640f-271b-4b42-ad2d-efc2929d50b5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:05.197182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216741b6-d838-47bb-9ffb-97dca57da1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:05.197815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216741b6-d838-47bb-9ffb-97dca57da1dd None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:05.198058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216741b6-d838-47bb-9ffb-97dca57da1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:05.198351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216741b6-d838-47bb-9ffb-97dca57da1dd None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:05.199056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216741b6-d838-47bb-9ffb-97dca57da1dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:05.200431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216741b6-d838-47bb-9ffb-97dca57da1dd None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:05.225164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 501/1010] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:02:05 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:02:05.227010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1f34-01f8-4416-ae8c-fa62db408bc0 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:05.227299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1f34-01f8-4416-ae8c-fa62db408bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:05.227571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1f34-01f8-4416-ae8c-fa62db408bc0 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:05.229601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 510/1011] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:02:05.235754 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f9b89-7027-4597-96ae-8b39db28d3dc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:05.236152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f9b89-7027-4597-96ae-8b39db28d3dc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:05.236302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f9b89-7027-4597-96ae-8b39db28d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:05.255947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-150f9b89-7027-4597-96ae-8b39db28d3dc None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:05.260334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-150f9b89-7027-4597-96ae-8b39db28d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:05.343376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 502/1012] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:05 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:05.366286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb1f34-01f8-4416-ae8c-fa62db408bc0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:05.482177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb1f34-01f8-4416-ae8c-fa62db408bc0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:05.483926 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:05.521968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959851ed-3359-4452-ac56-d540d8dfd95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:05.522606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959851ed-3359-4452-ac56-d540d8dfd95c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:05.522916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959851ed-3359-4452-ac56-d540d8dfd95c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:05.523174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959851ed-3359-4452-ac56-d540d8dfd95c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:05.523867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959851ed-3359-4452-ac56-d540d8dfd95c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:05.525307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959851ed-3359-4452-ac56-d540d8dfd95c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-959851ed-3359-4452-ac56-d540d8dfd95c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:05.534933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:05.535923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:05.537204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 511/1013] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:02:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:05.544455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f9b89-7027-4597-96ae-8b39db28d3dc None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:05.570823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:05.652998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f9b89-7027-4597-96ae-8b39db28d3dc None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:05.688358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13252b15-3267-4ecb-a610-7c14f54e666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:05.689041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13252b15-3267-4ecb-a610-7c14f54e666b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:05.689330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13252b15-3267-4ecb-a610-7c14f54e666b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:05.689655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13252b15-3267-4ecb-a610-7c14f54e666b None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:05.690347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13252b15-3267-4ecb-a610-7c14f54e666b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:05.690647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13252b15-3267-4ecb-a610-7c14f54e666b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:05.692016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13252b15-3267-4ecb-a610-7c14f54e666b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:05.697439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 503/1014] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:02:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:05.702972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959851ed-3359-4452-ac56-d540d8dfd95c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:05.807791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959851ed-3359-4452-ac56-d540d8dfd95c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:05.843945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de6121-ed23-4936-af04-85ef0935d198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:05.844624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de6121-ed23-4936-af04-85ef0935d198 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:05.844916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de6121-ed23-4936-af04-85ef0935d198 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:05.845206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de6121-ed23-4936-af04-85ef0935d198 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:05.845896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de6121-ed23-4936-af04-85ef0935d198 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:05.846263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de6121-ed23-4936-af04-85ef0935d198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:05.847667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de6121-ed23-4936-af04-85ef0935d198 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:05.858150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 512/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Aug 5 07:02:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:05.860394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13252b15-3267-4ecb-a610-7c14f54e666b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:05.951208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:05.966831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13252b15-3267-4ecb-a610-7c14f54e666b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:06.001138 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bd5ff-63db-41d6-a4f3-6cfe6b624128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:06.001763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bd5ff-63db-41d6-a4f3-6cfe6b624128 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:06.002044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bd5ff-63db-41d6-a4f3-6cfe6b624128 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:06.002318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bd5ff-63db-41d6-a4f3-6cfe6b624128 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:06.003028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bd5ff-63db-41d6-a4f3-6cfe6b624128 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:06.004404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bd5ff-63db-41d6-a4f3-6cfe6b624128 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:06.024806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 504/1016] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:02:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:02:07.143461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bd322-7135-4867-996e-825ca3b62313 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:07.144048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bd322-7135-4867-996e-825ca3b62313 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:07.144048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bd322-7135-4867-996e-825ca3b62313 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:07.145375 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 513/1017] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:07.151105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407b323-c304-4a27-a5a7-7415b9a49559 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:07.151538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407b323-c304-4a27-a5a7-7415b9a49559 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:07.151639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407b323-c304-4a27-a5a7-7415b9a49559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:07.171376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6407b323-c304-4a27-a5a7-7415b9a49559 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:07.172622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6407b323-c304-4a27-a5a7-7415b9a49559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:07.228045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b26ab-5736-4710-9f36-e8557a0e0834 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:07.228390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b26ab-5736-4710-9f36-e8557a0e0834 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:07.228592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b26ab-5736-4710-9f36-e8557a0e0834 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:07.230123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 514/1018] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:02:07.235015 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b17688-6a38-4e74-8e8d-9c2140229f53 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:07.235337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b17688-6a38-4e74-8e8d-9c2140229f53 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:07.235575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b17688-6a38-4e74-8e8d-9c2140229f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:07.253742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-06b17688-6a38-4e74-8e8d-9c2140229f53 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:07.254940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-06b17688-6a38-4e74-8e8d-9c2140229f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:07.272746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 505/1019] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:07.288285 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:07.296213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407b323-c304-4a27-a5a7-7415b9a49559 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:07.336722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 515/1020] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:07.358550 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b17688-6a38-4e74-8e8d-9c2140229f53 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:07.364067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:07.404294 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407b323-c304-4a27-a5a7-7415b9a49559 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:07.441704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017fc54-f26e-46fc-a2c5-770e399e82d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:07.442365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017fc54-f26e-46fc-a2c5-770e399e82d3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:07.442651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017fc54-f26e-46fc-a2c5-770e399e82d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:07.442928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017fc54-f26e-46fc-a2c5-770e399e82d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:07.444084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017fc54-f26e-46fc-a2c5-770e399e82d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:07.445612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017fc54-f26e-46fc-a2c5-770e399e82d3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:07.447222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 506/1021] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:07.453602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017fc54-f26e-46fc-a2c5-770e399e82d3 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:07.468717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b17688-6a38-4e74-8e8d-9c2140229f53 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:07.505959 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82539e17-b867-40eb-8e8b-b08e009c9b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:07.506601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82539e17-b867-40eb-8e8b-b08e009c9b67 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:07.506862 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82539e17-b867-40eb-8e8b-b08e009c9b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:07.507142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82539e17-b867-40eb-8e8b-b08e009c9b67 None admin] PATH_INFO: `/v3/services/image` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:07.507750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82539e17-b867-40eb-8e8b-b08e009c9b67 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:07.509123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82539e17-b867-40eb-8e8b-b08e009c9b67 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-82539e17-b867-40eb-8e8b-b08e009c9b67 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:07.518178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:07.519220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:07.520097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 516/1022] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Aug 5 07:02:07 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:02:07.525264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82539e17-b867-40eb-8e8b-b08e009c9b67 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:07.552542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:07.562316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017fc54-f26e-46fc-a2c5-770e399e82d3 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:07.597482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f8308-d47c-480a-b90a-a93f0bc7e686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:07.598083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f8308-d47c-480a-b90a-a93f0bc7e686 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:07.598360 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f8308-d47c-480a-b90a-a93f0bc7e686 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:07.598632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f8308-d47c-480a-b90a-a93f0bc7e686 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:07.599352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f8308-d47c-480a-b90a-a93f0bc7e686 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:07.600796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f8308-d47c-480a-b90a-a93f0bc7e686 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:07.607221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:07.630731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82539e17-b867-40eb-8e8b-b08e009c9b67 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:07.632168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 507/1023] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:02:07 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:02:07.670251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12740d6-b41a-4c50-b4c2-7d9333301bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:07.670813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12740d6-b41a-4c50-b4c2-7d9333301bdb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:07.671086 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12740d6-b41a-4c50-b4c2-7d9333301bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:07.671354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12740d6-b41a-4c50-b4c2-7d9333301bdb None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:07.672128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12740d6-b41a-4c50-b4c2-7d9333301bdb None admin] RBAC: Adding query filter params (name=image) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:07.672429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12740d6-b41a-4c50-b4c2-7d9333301bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:07.674129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12740d6-b41a-4c50-b4c2-7d9333301bdb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:07.685198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 517/1024] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:07.687047 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f8308-d47c-480a-b90a-a93f0bc7e686 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:07.799179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f8308-d47c-480a-b90a-a93f0bc7e686 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:07.832628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7c055-a041-4c5e-ba59-88af7ba0ace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:07.833283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7c055-a041-4c5e-ba59-88af7ba0ace5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:07.833556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7c055-a041-4c5e-ba59-88af7ba0ace5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:07.833825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7c055-a041-4c5e-ba59-88af7ba0ace5 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:07.834502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7c055-a041-4c5e-ba59-88af7ba0ace5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:07.834811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7c055-a041-4c5e-ba59-88af7ba0ace5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:07.836168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7c055-a041-4c5e-ba59-88af7ba0ace5 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:07.841676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 508/1025] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:07.848224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12740d6-b41a-4c50-b4c2-7d9333301bdb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:07.942651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:07.957293 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12740d6-b41a-4c50-b4c2-7d9333301bdb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:07.992074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357ba00-c83a-42d2-a72f-37772de30e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:07.992704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357ba00-c83a-42d2-a72f-37772de30e20 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:07.993037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357ba00-c83a-42d2-a72f-37772de30e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:07.993315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357ba00-c83a-42d2-a72f-37772de30e20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:07.994080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357ba00-c83a-42d2-a72f-37772de30e20 None admin] RBAC: Adding query filter params (interface=public, service_id=0a6ba76b40174c6286b78a8d571f044a, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:07.994390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357ba00-c83a-42d2-a72f-37772de30e20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:07.995757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357ba00-c83a-42d2-a72f-37772de30e20 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:08.001555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 518/1026] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 07:02:07 2022] GET /identity/v3/endpoints?service_id=0a6ba76b40174c6286b78a8d571f044a&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:08.007299 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7c055-a041-4c5e-ba59-88af7ba0ace5 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:08.063584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:08.100868 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceebddd-f978-43a8-83bc-f20da6128504 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:08.101246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceebddd-f978-43a8-83bc-f20da6128504 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:08.101463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceebddd-f978-43a8-83bc-f20da6128504 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:08.103064 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 519/1027] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:02:08.107832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebf11b-0645-4857-8255-87ba37a44db6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:08.108337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebf11b-0645-4857-8255-87ba37a44db6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:08.108618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebf11b-0645-4857-8255-87ba37a44db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:08.115672 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7c055-a041-4c5e-ba59-88af7ba0ace5 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:08.127656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2aebf11b-0645-4857-8255-87ba37a44db6 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:08.128940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2aebf11b-0645-4857-8255-87ba37a44db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:08.153502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aed734-46f9-4dd9-b3d5-98fb9e9f04ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:08.154760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aed734-46f9-4dd9-b3d5-98fb9e9f04ab None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:08.155044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aed734-46f9-4dd9-b3d5-98fb9e9f04ab None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:08.155313 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aed734-46f9-4dd9-b3d5-98fb9e9f04ab None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:08.155996 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aed734-46f9-4dd9-b3d5-98fb9e9f04ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:08.157405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aed734-46f9-4dd9-b3d5-98fb9e9f04ab None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:08.164705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 509/1028] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 07:02:08 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:02:08.209049 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 520/1029] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:08.230722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aed734-46f9-4dd9-b3d5-98fb9e9f04ab None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:08.350193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aed734-46f9-4dd9-b3d5-98fb9e9f04ab None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:08.368733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:08.388622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73121f4b-fcf2-4933-90e1-709d24de590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:08.389555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121f4b-fcf2-4933-90e1-709d24de590f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:08.390032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121f4b-fcf2-4933-90e1-709d24de590f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:08.390587 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121f4b-fcf2-4933-90e1-709d24de590f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:08.402373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73121f4b-fcf2-4933-90e1-709d24de590f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-73121f4b-fcf2-4933-90e1-709d24de590f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:02:08.407669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:08.408682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:08.409573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:08.409573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:08.409573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:08.409573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:08.409573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:02:08.409573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:02:08.409573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:02:08.409573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:02:08.409573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:02:08.409573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:02:08.409573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 07:02:08.409573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:08.410207 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 510/1030] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Aug 5 07:02:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:08.416949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebf11b-0645-4857-8255-87ba37a44db6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:08.503099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:08.522818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebf11b-0645-4857-8255-87ba37a44db6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:08.558331 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27b136-1554-43fb-96b1-cbd498e494f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:08.558948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27b136-1554-43fb-96b1-cbd498e494f6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:08.559223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27b136-1554-43fb-96b1-cbd498e494f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:08.559491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27b136-1554-43fb-96b1-cbd498e494f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:08.560211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27b136-1554-43fb-96b1-cbd498e494f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:08.560509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27b136-1554-43fb-96b1-cbd498e494f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:08.561886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27b136-1554-43fb-96b1-cbd498e494f6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:08.570483 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 521/1031] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 07:02:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:08.576092 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73121f4b-fcf2-4933-90e1-709d24de590f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:08.689438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73121f4b-fcf2-4933-90e1-709d24de590f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:08.725170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d9321-6614-4eac-9c92-a93631953d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:08.725793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9321-6614-4eac-9c92-a93631953d54 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:08.726102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9321-6614-4eac-9c92-a93631953d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:08.726374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9321-6614-4eac-9c92-a93631953d54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:08.737619 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d9321-6614-4eac-9c92-a93631953d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:08.739075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d9321-6614-4eac-9c92-a93631953d54 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-ef3d9321-6614-4eac-9c92-a93631953d54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:02:08.754208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:08.755096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:08.761010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:02:08.761010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:02:08.761010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:08.761010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:08.761010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 511/1032] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:08.761378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27b136-1554-43fb-96b1-cbd498e494f6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:08.874452 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27b136-1554-43fb-96b1-cbd498e494f6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:08.912315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617c045-66c3-4b95-b36b-e752eadee0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:08.912976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c045-66c3-4b95-b36b-e752eadee0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:08.913260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c045-66c3-4b95-b36b-e752eadee0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:08.913533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c045-66c3-4b95-b36b-e752eadee0d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:08.914230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617c045-66c3-4b95-b36b-e752eadee0d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:08.914532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617c045-66c3-4b95-b36b-e752eadee0d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:08.915899 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617c045-66c3-4b95-b36b-e752eadee0d8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:08.928775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 522/1033] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:08.934334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d9321-6614-4eac-9c92-a93631953d54 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:08.965134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:09.039435 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d9321-6614-4eac-9c92-a93631953d54 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:09.072460 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218f1fb-f0d6-44c0-b7b4-6165e7f8c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:09.073135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218f1fb-f0d6-44c0-b7b4-6165e7f8c1cf None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:09.073413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218f1fb-f0d6-44c0-b7b4-6165e7f8c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:09.073681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218f1fb-f0d6-44c0-b7b4-6165e7f8c1cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:09.081252 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218f1fb-f0d6-44c0-b7b4-6165e7f8c1cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:09.082694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218f1fb-f0d6-44c0-b7b4-6165e7f8c1cf None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-1218f1fb-f0d6-44c0-b7b4-6165e7f8c1cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:02:09.094033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:09.095041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:09.096025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:09.096025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:09.096025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:02:09.096025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:02:09.096025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:02:09.096025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:02:09.096025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:02:09.096025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:02:09.096025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:02:09.096025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:09.099945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 512/1034] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 07:02:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:09.101245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617c045-66c3-4b95-b36b-e752eadee0d8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:09.105517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:09.208380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617c045-66c3-4b95-b36b-e752eadee0d8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:09.243916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bd445-b77b-474a-8f1b-fa09cd5deac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:09.244541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bd445-b77b-474a-8f1b-fa09cd5deac4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:09.244813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bd445-b77b-474a-8f1b-fa09cd5deac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:09.245110 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bd445-b77b-474a-8f1b-fa09cd5deac4 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:09.245902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bd445-b77b-474a-8f1b-fa09cd5deac4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:09.246208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bd445-b77b-474a-8f1b-fa09cd5deac4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:09.247624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bd445-b77b-474a-8f1b-fa09cd5deac4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:09.275729 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 523/1035] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 07:02:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:09.277453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218f1fb-f0d6-44c0-b7b4-6165e7f8c1cf None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:09.376078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:09.389567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218f1fb-f0d6-44c0-b7b4-6165e7f8c1cf None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:09.424319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc265898-7bc7-4a1c-8565-8244214a7333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:09.424998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc265898-7bc7-4a1c-8565-8244214a7333 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:09.425264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc265898-7bc7-4a1c-8565-8244214a7333 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:09.425537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc265898-7bc7-4a1c-8565-8244214a7333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:09.494823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc265898-7bc7-4a1c-8565-8244214a7333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:09.496283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc265898-7bc7-4a1c-8565-8244214a7333 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:09.581779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:09.596139 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 513/1036] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:02:09 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:02:09.601934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bd445-b77b-474a-8f1b-fa09cd5deac4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:09.666956 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:09.712402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bd445-b77b-474a-8f1b-fa09cd5deac4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:09.718810 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb928d-fead-4de3-be6a-6a7cdb7e2639 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:09.719074 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb928d-fead-4de3-be6a-6a7cdb7e2639 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:09.719365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb928d-fead-4de3-be6a-6a7cdb7e2639 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:09.720854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 514/1037] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:02:09.725917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add74f22-8b9d-4895-81cc-51516214aef8 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:09.726218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add74f22-8b9d-4895-81cc-51516214aef8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:09.726479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add74f22-8b9d-4895-81cc-51516214aef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:09.745113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-add74f22-8b9d-4895-81cc-51516214aef8 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:09.746284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-add74f22-8b9d-4895-81cc-51516214aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:09.750706 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dde0b-baf7-4129-a58a-9a831c84ecbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:09.751360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dde0b-baf7-4129-a58a-9a831c84ecbb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:09.751637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dde0b-baf7-4129-a58a-9a831c84ecbb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:09.751911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dde0b-baf7-4129-a58a-9a831c84ecbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:09.762300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3dde0b-baf7-4129-a58a-9a831c84ecbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:09.763749 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3dde0b-baf7-4129-a58a-9a831c84ecbb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ba3dde0b-baf7-4129-a58a-9a831c84ecbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:02:09.781208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:09.782347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:09.790916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:02:09.790916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:02:09.790916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:09.790916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:09.790916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 524/1038] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:02:09.794106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dde0b-baf7-4129-a58a-9a831c84ecbb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:09.827384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 515/1039] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:09.851308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add74f22-8b9d-4895-81cc-51516214aef8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:09.903543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dde0b-baf7-4129-a58a-9a831c84ecbb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:09.919953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:09.942295 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67305c4-ad02-479f-91ac-61c2a881930e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:09.942923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67305c4-ad02-479f-91ac-61c2a881930e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:09.943201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67305c4-ad02-479f-91ac-61c2a881930e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:09.943473 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67305c4-ad02-479f-91ac-61c2a881930e None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:09.944159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67305c4-ad02-479f-91ac-61c2a881930e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:09.944460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67305c4-ad02-479f-91ac-61c2a881930e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:09.945863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67305c4-ad02-479f-91ac-61c2a881930e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:09.955918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add74f22-8b9d-4895-81cc-51516214aef8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:09.958275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 525/1040] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:09.963633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67305c4-ad02-479f-91ac-61c2a881930e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:09.981021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:10.001845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3c3e3-80d5-4f4b-a211-75361e19a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:10.002805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3c3e3-80d5-4f4b-a211-75361e19a002 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:10.003096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3c3e3-80d5-4f4b-a211-75361e19a002 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:10.003376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3c3e3-80d5-4f4b-a211-75361e19a002 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:10.004555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3c3e3-80d5-4f4b-a211-75361e19a002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:10.007062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3c3e3-80d5-4f4b-a211-75361e19a002 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:10.013422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 516/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:10.014370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3c3e3-80d5-4f4b-a211-75361e19a002 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:10.075907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67305c4-ad02-479f-91ac-61c2a881930e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:10.111908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5a3e4-d313-4545-9794-9bf70b4f088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:10.112556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5a3e4-d313-4545-9794-9bf70b4f088a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:10.112832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5a3e4-d313-4545-9794-9bf70b4f088a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:10.113128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5a3e4-d313-4545-9794-9bf70b4f088a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:10.120002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5a3e4-d313-4545-9794-9bf70b4f088a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:10.121466 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5a3e4-d313-4545-9794-9bf70b4f088a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:10.122034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3c3e3-80d5-4f4b-a211-75361e19a002 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a4b5a3e4-d313-4545-9794-9bf70b4f088a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:02:10.133070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:10.134013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:10.134918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:02:10.134918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:02:10.134918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:02:10.134918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:02:10.134918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:02:10.134918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:02:10.134918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:02:10.134918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:10.134918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 526/1042] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:02:10.139970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5a3e4-d313-4545-9794-9bf70b4f088a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:10.161269 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d4d58-567d-4e63-9ab5-392f2f1fc70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:10.162677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d4d58-567d-4e63-9ab5-392f2f1fc70d None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:10.162960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d4d58-567d-4e63-9ab5-392f2f1fc70d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:10.163234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d4d58-567d-4e63-9ab5-392f2f1fc70d None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:10.163917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d4d58-567d-4e63-9ab5-392f2f1fc70d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:10.165489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d4d58-567d-4e63-9ab5-392f2f1fc70d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:10.174570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:10.190002 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 517/1043] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:02:10 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:02:10.191269 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9af6e-6b6a-4011-aef7-79897969e8e0 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:10.191567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9af6e-6b6a-4011-aef7-79897969e8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:10.191831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9af6e-6b6a-4011-aef7-79897969e8e0 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:10.193209 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 518/1044] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:10.198584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798abd20-d20d-4cef-8dda-b72d6debafbc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:10.198898 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798abd20-d20d-4cef-8dda-b72d6debafbc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:10.199141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798abd20-d20d-4cef-8dda-b72d6debafbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:10.219549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-798abd20-d20d-4cef-8dda-b72d6debafbc None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:10.220803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-798abd20-d20d-4cef-8dda-b72d6debafbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:10.249631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5a3e4-d313-4545-9794-9bf70b4f088a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:10.264254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:10.295509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8d07-12ce-4562-a21e-194f5ebbc7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:10.296165 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8d07-12ce-4562-a21e-194f5ebbc7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:10.297741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8d07-12ce-4562-a21e-194f5ebbc7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:10.297864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8d07-12ce-4562-a21e-194f5ebbc7e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:10.298639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d8d07-12ce-4562-a21e-194f5ebbc7e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:10.298951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d8d07-12ce-4562-a21e-194f5ebbc7e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:10.300429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d8d07-12ce-4562-a21e-194f5ebbc7e0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:10.313365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 519/1045] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:02:10.319627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 527/1046] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:10.322119 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798abd20-d20d-4cef-8dda-b72d6debafbc None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:10.336284 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8d07-12ce-4562-a21e-194f5ebbc7e0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:10.438871 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798abd20-d20d-4cef-8dda-b72d6debafbc None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:10.453141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:10.462190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8d07-12ce-4562-a21e-194f5ebbc7e0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:10.473778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dfc48-765e-416d-9812-a57ea68203c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:10.474398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dfc48-765e-416d-9812-a57ea68203c0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:10.474679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dfc48-765e-416d-9812-a57ea68203c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:10.474947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04dfc48-765e-416d-9812-a57ea68203c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:10.475727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dfc48-765e-416d-9812-a57ea68203c0 None admin] RBAC: Adding query filter params (role.id=203154726d1340b6b60888f02c96c1e8, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=555de6e5c8c44f40a6433b3d2ffc52f3) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:10.476035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dfc48-765e-416d-9812-a57ea68203c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:10.477503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04dfc48-765e-416d-9812-a57ea68203c0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:10.488939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 520/1047] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:02:10 2022] GET /identity/v3/role_assignments?user.id=555de6e5c8c44f40a6433b3d2ffc52f3&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=203154726d1340b6b60888f02c96c1e8 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:10.506310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf0623-29d7-4bf3-9772-5bb1941f64cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:10.506980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0623-29d7-4bf3-9772-5bb1941f64cc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:10.507253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0623-29d7-4bf3-9772-5bb1941f64cc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:10.507519 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0623-29d7-4bf3-9772-5bb1941f64cc None admin] PATH_INFO: `/v3/services/image` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:10.508159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf0623-29d7-4bf3-9772-5bb1941f64cc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:10.509619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf0623-29d7-4bf3-9772-5bb1941f64cc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2aaf0623-29d7-4bf3-9772-5bb1941f64cc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:10.519822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:10.520879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:10.521769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 528/1048] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Aug 5 07:02:10 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:10.528958 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dfc48-765e-416d-9812-a57ea68203c0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:10.571947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:10.647845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04dfc48-765e-416d-9812-a57ea68203c0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:10.686712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dc5f4-9fb9-4928-a8df-71bda4a4ad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:10.687468 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dc5f4-9fb9-4928-a8df-71bda4a4ad1a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:10.687743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dc5f4-9fb9-4928-a8df-71bda4a4ad1a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:10.688013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dc5f4-9fb9-4928-a8df-71bda4a4ad1a None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:10.688687 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dc5f4-9fb9-4928-a8df-71bda4a4ad1a None admin] RBAC: Adding query filter params (name=image) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:10.689073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dc5f4-9fb9-4928-a8df-71bda4a4ad1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:10.690391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dc5f4-9fb9-4928-a8df-71bda4a4ad1a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:10.700106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 521/1049] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:10.701616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf0623-29d7-4bf3-9772-5bb1941f64cc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:10.807096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf0623-29d7-4bf3-9772-5bb1941f64cc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:10.841758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b42b9d-dac3-418c-aeaf-062c465273e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:10.842374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42b9d-dac3-418c-aeaf-062c465273e8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:10.842648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42b9d-dac3-418c-aeaf-062c465273e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:10.842911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42b9d-dac3-418c-aeaf-062c465273e8 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:10.843688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b42b9d-dac3-418c-aeaf-062c465273e8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:10.843986 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b42b9d-dac3-418c-aeaf-062c465273e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:10.845389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b42b9d-dac3-418c-aeaf-062c465273e8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:10.850446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 529/1050] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:10.856056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dc5f4-9fb9-4928-a8df-71bda4a4ad1a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:10.957597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:10.961225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dc5f4-9fb9-4928-a8df-71bda4a4ad1a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:10.995929 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730df5bd-6fa7-408f-81c3-b9392818a93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:10.996558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730df5bd-6fa7-408f-81c3-b9392818a93e None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:10.996829 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730df5bd-6fa7-408f-81c3-b9392818a93e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:10.997126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730df5bd-6fa7-408f-81c3-b9392818a93e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:10.997845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730df5bd-6fa7-408f-81c3-b9392818a93e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:10.999274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730df5bd-6fa7-408f-81c3-b9392818a93e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:11.022188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 522/1051] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:02:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:02:12.242927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cfeba-bde9-4330-a5f1-c8dacdd1d694 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:12.243485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cfeba-bde9-4330-a5f1-c8dacdd1d694 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:12.243485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cfeba-bde9-4330-a5f1-c8dacdd1d694 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:12.245039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 530/1052] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:12.250406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704dc26-f837-4fa5-967b-0e2502d6ee49 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:12.250867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704dc26-f837-4fa5-967b-0e2502d6ee49 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:12.250945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704dc26-f837-4fa5-967b-0e2502d6ee49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:12.272346 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f704dc26-f837-4fa5-967b-0e2502d6ee49 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:12.273567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f704dc26-f837-4fa5-967b-0e2502d6ee49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:12.349396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 523/1053] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:12.371968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cfeba-bde9-4330-a5f1-c8dacdd1d694 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:12.397680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:12.461423 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1515d-6a56-4824-a705-8f784564d202 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:12.461764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1515d-6a56-4824-a705-8f784564d202 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:12.462016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1515d-6a56-4824-a705-8f784564d202 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:12.463416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 524/1054] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:12.468513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b735f-864a-4639-a7e3-407126450eba None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:12.468804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b735f-864a-4639-a7e3-407126450eba None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:12.469113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b735f-864a-4639-a7e3-407126450eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:12.479354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cfeba-bde9-4330-a5f1-c8dacdd1d694 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:12.487506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6a9b735f-864a-4639-a7e3-407126450eba None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:12.488701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6a9b735f-864a-4639-a7e3-407126450eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:12.518541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cd50a-61eb-4b93-b396-ab564bf517e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:12.519101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd50a-61eb-4b93-b396-ab564bf517e9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:12.519393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd50a-61eb-4b93-b396-ab564bf517e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:12.519613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd50a-61eb-4b93-b396-ab564bf517e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:12.530590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cd50a-61eb-4b93-b396-ab564bf517e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d43cd50a-61eb-4b93-b396-ab564bf517e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:02:12.535667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:12.537258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:12.538097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:12.538097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:12.538097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:12.538097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:12.538097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:02:12.538097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:02:12.538097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:02:12.538097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:02:12.538097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:02:12.538097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:02:12.538097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:12.538097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:12.541258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 531/1055] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:02:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:12.543241 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cd50a-61eb-4b93-b396-ab564bf517e9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:12.577307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 525/1056] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:12.590004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b735f-864a-4639-a7e3-407126450eba None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:12.604609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:12.632967 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:12.653193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cd50a-61eb-4b93-b396-ab564bf517e9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:12.688550 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050e2aa-f71c-46f1-8926-6ab71d84b217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:12.689200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050e2aa-f71c-46f1-8926-6ab71d84b217 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:12.689482 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050e2aa-f71c-46f1-8926-6ab71d84b217 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:12.689754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050e2aa-f71c-46f1-8926-6ab71d84b217 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:12.690470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050e2aa-f71c-46f1-8926-6ab71d84b217 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:12.690777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050e2aa-f71c-46f1-8926-6ab71d84b217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:12.692472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050e2aa-f71c-46f1-8926-6ab71d84b217 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:12.703661 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 532/1057] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:02:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:12.705509 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b735f-864a-4639-a7e3-407126450eba None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:12.709035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050e2aa-f71c-46f1-8926-6ab71d84b217 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:12.746055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2edacd-e7aa-4dda-9f20-1c681f82193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:12.746713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2edacd-e7aa-4dda-9f20-1c681f82193e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:12.746992 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2edacd-e7aa-4dda-9f20-1c681f82193e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:12.747276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2edacd-e7aa-4dda-9f20-1c681f82193e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:12.758052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2edacd-e7aa-4dda-9f20-1c681f82193e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-cd2edacd-e7aa-4dda-9f20-1c681f82193e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:02:12.763075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:12.764012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:12.764847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 526/1058] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Aug 5 07:02:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:02:12.770470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2edacd-e7aa-4dda-9f20-1c681f82193e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:12.818238 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050e2aa-f71c-46f1-8926-6ab71d84b217 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:12.847032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:12.853717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa525-ca08-412f-8db7-244fc4a6121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:12.854920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa525-ca08-412f-8db7-244fc4a6121a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:12.855159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa525-ca08-412f-8db7-244fc4a6121a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:12.855403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa525-ca08-412f-8db7-244fc4a6121a None admin] PATH_INFO: `/v3/users/d7ee15468aa145edb838c6f84d262223` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:12.871520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afa525-ca08-412f-8db7-244fc4a6121a None admin] RBAC: Authorizing `identity:get_user(user_id=d7ee15468aa145edb838c6f84d262223)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:12.873008 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afa525-ca08-412f-8db7-244fc4a6121a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:12.874965 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 533/1059] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:12 2022] GET /identity/v3/users/d7ee15468aa145edb838c6f84d262223 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:12.880519 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa525-ca08-412f-8db7-244fc4a6121a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:12.881221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2edacd-e7aa-4dda-9f20-1c681f82193e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:12.883359 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:12.921826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76b31a-6f9d-4a3f-836b-32e92a94f70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:12.922450 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76b31a-6f9d-4a3f-836b-32e92a94f70e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:12.922730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76b31a-6f9d-4a3f-836b-32e92a94f70e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:12.923004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76b31a-6f9d-4a3f-836b-32e92a94f70e None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:12.923747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76b31a-6f9d-4a3f-836b-32e92a94f70e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:12.924048 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76b31a-6f9d-4a3f-836b-32e92a94f70e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:12.925470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76b31a-6f9d-4a3f-836b-32e92a94f70e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:12.938695 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 527/1060] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 07:02:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:12.939843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76b31a-6f9d-4a3f-836b-32e92a94f70e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:12.993335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa525-ca08-412f-8db7-244fc4a6121a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:13.028872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dbd85-6041-4a67-a874-206e32d08c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:13.029441 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dbd85-6041-4a67-a874-206e32d08c38 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:13.029725 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dbd85-6041-4a67-a874-206e32d08c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:13.030001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dbd85-6041-4a67-a874-206e32d08c38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:13.047908 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76b31a-6f9d-4a3f-836b-32e92a94f70e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:13.081177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d91259-00d1-44ed-8b5a-3fb57fa98f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:13.081823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91259-00d1-44ed-8b5a-3fb57fa98f51 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:13.082104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91259-00d1-44ed-8b5a-3fb57fa98f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:13.082383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91259-00d1-44ed-8b5a-3fb57fa98f51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:13.084301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:13.094468 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d91259-00d1-44ed-8b5a-3fb57fa98f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:13.095929 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d91259-00d1-44ed-8b5a-3fb57fa98f51 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:13.098626 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dbd85-6041-4a67-a874-206e32d08c38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:13.100101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dbd85-6041-4a67-a874-206e32d08c38 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:13.101978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-c2d91259-00d1-44ed-8b5a-3fb57fa98f51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:02:13.110384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:13.111440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:13.112331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:02:13.112331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:02:13.112331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:13.112331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:13.112331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 528/1061] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:13.112863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c09c64-ab53-43ff-8fac-4b56ac51e132 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:13.113176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c09c64-ab53-43ff-8fac-4b56ac51e132 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:13.113455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c09c64-ab53-43ff-8fac-4b56ac51e132 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:13.114814 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 529/1062] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:13.117873 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c09c64-ab53-43ff-8fac-4b56ac51e132 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:13.203829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 534/1063] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:02:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:02:13.205525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372bd4d-7ca7-4a99-8099-919d391c4d2a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:13.205788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372bd4d-7ca7-4a99-8099-919d391c4d2a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:13.206069 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372bd4d-7ca7-4a99-8099-919d391c4d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:13.219356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c09c64-ab53-43ff-8fac-4b56ac51e132 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:13.223824 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f372bd4d-7ca7-4a99-8099-919d391c4d2a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:13.225048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f372bd4d-7ca7-4a99-8099-919d391c4d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:13.253362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62a420-1375-44d5-b8b2-84b5cbb75f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:13.253984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62a420-1375-44d5-b8b2-84b5cbb75f5b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:13.254261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62a420-1375-44d5-b8b2-84b5cbb75f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:13.254531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62a420-1375-44d5-b8b2-84b5cbb75f5b None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:13.255219 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62a420-1375-44d5-b8b2-84b5cbb75f5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:13.255519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62a420-1375-44d5-b8b2-84b5cbb75f5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:13.259837 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62a420-1375-44d5-b8b2-84b5cbb75f5b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:13.268573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 530/1064] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:13.269447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62a420-1375-44d5-b8b2-84b5cbb75f5b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:13.297666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 535/1065] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:13.299034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372bd4d-7ca7-4a99-8099-919d391c4d2a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:13.331092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:13.335970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:13.389740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62a420-1375-44d5-b8b2-84b5cbb75f5b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:13.407154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372bd4d-7ca7-4a99-8099-919d391c4d2a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:13.425033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc7be-b5d4-4925-840a-f5237f97f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:13.425683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc7be-b5d4-4925-840a-f5237f97f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:13.425963 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc7be-b5d4-4925-840a-f5237f97f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:13.426238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc7be-b5d4-4925-840a-f5237f97f9b0 None admin] PATH_INFO: `/v3/projects/c4849fb6886a4dc68092306f5fdf9e89` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:13.427459 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cc7be-b5d4-4925-840a-f5237f97f9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=c4849fb6886a4dc68092306f5fdf9e89)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:13.428888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cc7be-b5d4-4925-840a-f5237f97f9b0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:13.430617 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 531/1066] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:02:13 2022] GET /identity/v3/projects/c4849fb6886a4dc68092306f5fdf9e89 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:13.431387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc7be-b5d4-4925-840a-f5237f97f9b0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:13.446578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd86ef-b2a0-4376-8197-90c72ca89a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:13.447250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd86ef-b2a0-4376-8197-90c72ca89a72 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:13.447528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd86ef-b2a0-4376-8197-90c72ca89a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:13.447804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd86ef-b2a0-4376-8197-90c72ca89a72 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:13.455187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd86ef-b2a0-4376-8197-90c72ca89a72 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:13.456617 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd86ef-b2a0-4376-8197-90c72ca89a72 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-95dd86ef-b2a0-4376-8197-90c72ca89a72 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:02:13.468342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:13.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:13.470351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:13.470351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:13.470351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:02:13.470351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:02:13.470351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:02:13.470351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:02:13.470351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:02:13.470351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:02:13.470351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:02:13.470351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:13.470351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 536/1067] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 07:02:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:13.470351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd86ef-b2a0-4376-8197-90c72ca89a72 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:13.533147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc7be-b5d4-4925-840a-f5237f97f9b0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:13.547947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:13.562268 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:13.568502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e422d-1c88-4c7e-babf-10947ccfbfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:13.569198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e422d-1c88-4c7e-babf-10947ccfbfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:13.569478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e422d-1c88-4c7e-babf-10947ccfbfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:13.569835 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e422d-1c88-4c7e-babf-10947ccfbfc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:13.571875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd86ef-b2a0-4376-8197-90c72ca89a72 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:13.606797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38ed51-09cc-44c0-a3d1-f9a67e7bc9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:13.607416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38ed51-09cc-44c0-a3d1-f9a67e7bc9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:13.607697 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38ed51-09cc-44c0-a3d1-f9a67e7bc9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:13.607968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38ed51-09cc-44c0-a3d1-f9a67e7bc9e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:13.608759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38ed51-09cc-44c0-a3d1-f9a67e7bc9e6 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=c4849fb6886a4dc68092306f5fdf9e89, user.id=d7ee15468aa145edb838c6f84d262223) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:13.609168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38ed51-09cc-44c0-a3d1-f9a67e7bc9e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:13.610612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38ed51-09cc-44c0-a3d1-f9a67e7bc9e6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:13.616062 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 537/1068] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:02:13 2022] GET /identity/v3/role_assignments?user.id=d7ee15468aa145edb838c6f84d262223&scope.project.id=c4849fb6886a4dc68092306f5fdf9e89&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:13.616851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38ed51-09cc-44c0-a3d1-f9a67e7bc9e6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:13.642126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e422d-1c88-4c7e-babf-10947ccfbfc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:13.643775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e422d-1c88-4c7e-babf-10947ccfbfc4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:13.740696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38ed51-09cc-44c0-a3d1-f9a67e7bc9e6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:13.759138 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 532/1069] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:02:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:02:13.765659 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e422d-1c88-4c7e-babf-10947ccfbfc4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:13.783942 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:13.785598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd08d6-50f5-4b3b-8067-9f5e9c6f29ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:13.786240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd08d6-50f5-4b3b-8067-9f5e9c6f29ee None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:13.786922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd08d6-50f5-4b3b-8067-9f5e9c6f29ee None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:13.787113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd08d6-50f5-4b3b-8067-9f5e9c6f29ee None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:13.787917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd08d6-50f5-4b3b-8067-9f5e9c6f29ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:13.788223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd08d6-50f5-4b3b-8067-9f5e9c6f29ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:13.789686 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd08d6-50f5-4b3b-8067-9f5e9c6f29ee None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:13.809572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 538/1070] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 07:02:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:13.814985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd08d6-50f5-4b3b-8067-9f5e9c6f29ee None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:13.832697 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:13.887725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e422d-1c88-4c7e-babf-10947ccfbfc4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:13.923136 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac427fb-9472-48d1-93b5-02309cd97d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:13.923802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac427fb-9472-48d1-93b5-02309cd97d2e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:13.924050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac427fb-9472-48d1-93b5-02309cd97d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:13.924318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac427fb-9472-48d1-93b5-02309cd97d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:13.927402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd08d6-50f5-4b3b-8067-9f5e9c6f29ee None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:13.935228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac427fb-9472-48d1-93b5-02309cd97d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:13.936778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac427fb-9472-48d1-93b5-02309cd97d2e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-fac427fb-9472-48d1-93b5-02309cd97d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:02:13.954870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:13.955870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:13.956825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:02:13.956825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:02:13.956825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:13.956825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:13.956825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 533/1071] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:13.961968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac427fb-9472-48d1-93b5-02309cd97d2e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:13.967101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402f4cf-4833-4403-98b6-487ede2cd403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:13.967810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402f4cf-4833-4403-98b6-487ede2cd403 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:13.968155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402f4cf-4833-4403-98b6-487ede2cd403 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:13.968515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402f4cf-4833-4403-98b6-487ede2cd403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:13.979181 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402f4cf-4833-4403-98b6-487ede2cd403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:13.980791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402f4cf-4833-4403-98b6-487ede2cd403 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4402f4cf-4833-4403-98b6-487ede2cd403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:02:13.997188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:13.998296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:13.999437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:02:13.999437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:02:13.999437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:13.999437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:13.999437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 539/1072] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:02:14.004234 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402f4cf-4833-4403-98b6-487ede2cd403 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:14.035246 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:14.076702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac427fb-9472-48d1-93b5-02309cd97d2e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:14.079817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:14.113266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8aaa24-096c-4cda-a0a0-815a2a7fda6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:14.114178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8aaa24-096c-4cda-a0a0-815a2a7fda6b None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:14.114461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8aaa24-096c-4cda-a0a0-815a2a7fda6b None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:14.114734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8aaa24-096c-4cda-a0a0-815a2a7fda6b None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:14.115428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8aaa24-096c-4cda-a0a0-815a2a7fda6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:14.115730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8aaa24-096c-4cda-a0a0-815a2a7fda6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:14.117128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8aaa24-096c-4cda-a0a0-815a2a7fda6b None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:14.119110 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402f4cf-4833-4403-98b6-487ede2cd403 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:14.140923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 534/1073] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:14.163148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497b521-097b-4683-b74b-3b0d2570337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:14.163797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497b521-097b-4683-b74b-3b0d2570337c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:14.164077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497b521-097b-4683-b74b-3b0d2570337c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:14.164410 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497b521-097b-4683-b74b-3b0d2570337c None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:14.165153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497b521-097b-4683-b74b-3b0d2570337c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:14.165506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497b521-097b-4683-b74b-3b0d2570337c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:14.166919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497b521-097b-4683-b74b-3b0d2570337c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:14.185978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 540/1074] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:14.187406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8aaa24-096c-4cda-a0a0-815a2a7fda6b None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:14.310960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8aaa24-096c-4cda-a0a0-815a2a7fda6b None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:14.340669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:14.350541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0feda-848a-4f93-993b-b7ffd25ac103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:14.351265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0feda-848a-4f93-993b-b7ffd25ac103 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:14.351544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0feda-848a-4f93-993b-b7ffd25ac103 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:14.351811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0feda-848a-4f93-993b-b7ffd25ac103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:14.359112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0feda-848a-4f93-993b-b7ffd25ac103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:14.360567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0feda-848a-4f93-993b-b7ffd25ac103 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e9c0feda-848a-4f93-993b-b7ffd25ac103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:02:14.372937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:14.373917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:14.374864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:02:14.374864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:02:14.374864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:02:14.374864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:02:14.374864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:02:14.374864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:02:14.374864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:02:14.374864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:14.376646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 535/1075] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:14.382777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497b521-097b-4683-b74b-3b0d2570337c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:14.493326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497b521-097b-4683-b74b-3b0d2570337c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:14.519438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:14.528566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc227c59-5243-4a09-8565-3271354442aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:14.529217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc227c59-5243-4a09-8565-3271354442aa None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:14.529494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc227c59-5243-4a09-8565-3271354442aa None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:14.529769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc227c59-5243-4a09-8565-3271354442aa None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:14.530519 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc227c59-5243-4a09-8565-3271354442aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:14.530886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc227c59-5243-4a09-8565-3271354442aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:14.532307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc227c59-5243-4a09-8565-3271354442aa None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:14.544376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 541/1076] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:14.550624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0feda-848a-4f93-993b-b7ffd25ac103 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:14.657428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0feda-848a-4f93-993b-b7ffd25ac103 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:14.692603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bbe0a-e2bb-4399-9fd3-f18adb7746df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:14.693326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bbe0a-e2bb-4399-9fd3-f18adb7746df None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:14.693604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bbe0a-e2bb-4399-9fd3-f18adb7746df None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:14.693882 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bbe0a-e2bb-4399-9fd3-f18adb7746df None admin] PATH_INFO: `/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/555de6e5c8c44f40a6433b3d2ffc52f3/roles/203154726d1340b6b60888f02c96c1e8` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:14.696208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bbe0a-e2bb-4399-9fd3-f18adb7746df None admin] RBAC: Authorizing `identity:create_grant(project_id=29b560f1bcf347f6b8b885cc02d52e33, user_id=555de6e5c8c44f40a6433b3d2ffc52f3, role_id=203154726d1340b6b60888f02c96c1e8)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:14.697704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bbe0a-e2bb-4399-9fd3-f18adb7746df None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:14.713251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 536/1077] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:02:14 2022] PUT /identity/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/555de6e5c8c44f40a6433b3d2ffc52f3/roles/203154726d1340b6b60888f02c96c1e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:02:15.595301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb60e6-0de6-45e7-9329-d9f7e234b1c1 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:15.595854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb60e6-0de6-45e7-9329-d9f7e234b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:15.595854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb60e6-0de6-45e7-9329-d9f7e234b1c1 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:15.597252 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 542/1078] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:15.602594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752a33a-c3cf-47c2-96e3-ee72ca6700b3 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:15.602987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752a33a-c3cf-47c2-96e3-ee72ca6700b3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:15.603134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752a33a-c3cf-47c2-96e3-ee72ca6700b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:15.621971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5752a33a-c3cf-47c2-96e3-ee72ca6700b3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:15.623161 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5752a33a-c3cf-47c2-96e3-ee72ca6700b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:15.670085 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:15.696784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 537/1079] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:15.718729 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb60e6-0de6-45e7-9329-d9f7e234b1c1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:15.831389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb60e6-0de6-45e7-9329-d9f7e234b1c1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:15.866015 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68222c-7550-41af-9da1-3059f0529e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:15.866571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68222c-7550-41af-9da1-3059f0529e07 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:15.866842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68222c-7550-41af-9da1-3059f0529e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:15.867112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68222c-7550-41af-9da1-3059f0529e07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:15.877855 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68222c-7550-41af-9da1-3059f0529e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2e68222c-7550-41af-9da1-3059f0529e07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:02:15.882752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:15.883704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:15.884532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:15.884532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:15.884532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:15.884532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:15.884532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:02:15.884532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:02:15.884532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:02:15.884532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:02:15.884532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:02:15.884532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:02:15.884532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:15.884532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:15.888964 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 543/1080] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:02:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:15.889919 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752a33a-c3cf-47c2-96e3-ee72ca6700b3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:15.992639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752a33a-c3cf-47c2-96e3-ee72ca6700b3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:16.027525 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f7aaa-81d9-4aba-a06c-a2fd7927dc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:16.028139 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7aaa-81d9-4aba-a06c-a2fd7927dc62 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:16.028412 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7aaa-81d9-4aba-a06c-a2fd7927dc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:16.028690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7aaa-81d9-4aba-a06c-a2fd7927dc62 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:16.029424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f7aaa-81d9-4aba-a06c-a2fd7927dc62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:16.029726 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f7aaa-81d9-4aba-a06c-a2fd7927dc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:16.031175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f7aaa-81d9-4aba-a06c-a2fd7927dc62 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:16.039530 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 538/1081] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:02:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:16.045585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68222c-7550-41af-9da1-3059f0529e07 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:16.098161 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:16.156974 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68222c-7550-41af-9da1-3059f0529e07 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:16.191952 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3c2bd-a6e8-4161-a485-9dfa0ac4545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:16.192590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3c2bd-a6e8-4161-a485-9dfa0ac4545d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:16.192867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3c2bd-a6e8-4161-a485-9dfa0ac4545d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:16.193169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3c2bd-a6e8-4161-a485-9dfa0ac4545d None admin] PATH_INFO: `/v3/users/d7ee15468aa145edb838c6f84d262223` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:16.194361 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3c2bd-a6e8-4161-a485-9dfa0ac4545d None admin] RBAC: Authorizing `identity:get_user(user_id=d7ee15468aa145edb838c6f84d262223)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:16.195787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3c2bd-a6e8-4161-a485-9dfa0ac4545d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:16.197434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 544/1082] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:16 2022] GET /identity/v3/users/d7ee15468aa145edb838c6f84d262223 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:16.203473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f7aaa-81d9-4aba-a06c-a2fd7927dc62 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:16.245456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:16.322844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f7aaa-81d9-4aba-a06c-a2fd7927dc62 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:16.358493 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd4a80-4832-4a12-9a4a-f797f9884010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:16.359259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd4a80-4832-4a12-9a4a-f797f9884010 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:16.359533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd4a80-4832-4a12-9a4a-f797f9884010 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:16.359788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd4a80-4832-4a12-9a4a-f797f9884010 None admin] PATH_INFO: `/v3/projects/c4849fb6886a4dc68092306f5fdf9e89` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:16.361000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd4a80-4832-4a12-9a4a-f797f9884010 None admin] RBAC: Authorizing `identity:get_project(project_id=c4849fb6886a4dc68092306f5fdf9e89)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:16.362431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd4a80-4832-4a12-9a4a-f797f9884010 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:16.364273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 539/1083] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:02:16 2022] GET /identity/v3/projects/c4849fb6886a4dc68092306f5fdf9e89 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:16.370142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3c2bd-a6e8-4161-a485-9dfa0ac4545d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:16.474335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3c2bd-a6e8-4161-a485-9dfa0ac4545d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:16.488714 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:16.510741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f9b0e-e9a9-46f9-97d8-acaab3edb6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:16.511419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f9b0e-e9a9-46f9-97d8-acaab3edb6a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:16.511733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f9b0e-e9a9-46f9-97d8-acaab3edb6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:16.512003 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f9b0e-e9a9-46f9-97d8-acaab3edb6a6 None admin] PATH_INFO: `/v3/projects/c4849fb6886a4dc68092306f5fdf9e89/users/d7ee15468aa145edb838c6f84d262223/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:16.514127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f9b0e-e9a9-46f9-97d8-acaab3edb6a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4849fb6886a4dc68092306f5fdf9e89, user_id=d7ee15468aa145edb838c6f84d262223, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:16.515629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f9b0e-e9a9-46f9-97d8-acaab3edb6a6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:16.529380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 545/1084] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:02:16 2022] PUT /identity/v3/projects/c4849fb6886a4dc68092306f5fdf9e89/users/d7ee15468aa145edb838c6f84d262223/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:02:16.707551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abb629-0efe-46c7-a0aa-3f51959e5e2c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:16.708082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abb629-0efe-46c7-a0aa-3f51959e5e2c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:16.708082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abb629-0efe-46c7-a0aa-3f51959e5e2c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:16.709760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 540/1085] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:16.715607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60223d86-0795-4032-b496-3ed4f2c31315 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:16.716142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60223d86-0795-4032-b496-3ed4f2c31315 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:16.716142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60223d86-0795-4032-b496-3ed4f2c31315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:16.741071 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-60223d86-0795-4032-b496-3ed4f2c31315 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:16.741071 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-60223d86-0795-4032-b496-3ed4f2c31315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:16.817184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 546/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:16.839771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abb629-0efe-46c7-a0aa-3f51959e5e2c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:16.979700 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abb629-0efe-46c7-a0aa-3f51959e5e2c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:16.989213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:17.025386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d366e9-6f04-4d8c-b5a1-a2f218dccc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:17.026240 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d366e9-6f04-4d8c-b5a1-a2f218dccc04 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:17.026636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d366e9-6f04-4d8c-b5a1-a2f218dccc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:17.027272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d366e9-6f04-4d8c-b5a1-a2f218dccc04 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:17.039226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d366e9-6f04-4d8c-b5a1-a2f218dccc04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e7d366e9-6f04-4d8c-b5a1-a2f218dccc04 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:02:17.044241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:17.045369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:17.046224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 541/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Aug 5 07:02:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:17.052144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60223d86-0795-4032-b496-3ed4f2c31315 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:17.167802 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60223d86-0795-4032-b496-3ed4f2c31315 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:17.170287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:17.208251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094346d-3203-48c3-ab4a-831e0e12bac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:17.208884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094346d-3203-48c3-ab4a-831e0e12bac0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:17.209224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094346d-3203-48c3-ab4a-831e0e12bac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:17.209485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094346d-3203-48c3-ab4a-831e0e12bac0 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:17.210207 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094346d-3203-48c3-ab4a-831e0e12bac0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:17.210515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094346d-3203-48c3-ab4a-831e0e12bac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:17.211917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094346d-3203-48c3-ab4a-831e0e12bac0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:17.220535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 547/1088] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 07:02:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:17.226428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d366e9-6f04-4d8c-b5a1-a2f218dccc04 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:17.330774 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d366e9-6f04-4d8c-b5a1-a2f218dccc04 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:17.365328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdaa92-1abd-4cb4-a0fb-b80a9bc7f1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:17.365954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdaa92-1abd-4cb4-a0fb-b80a9bc7f1ee None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:17.366230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdaa92-1abd-4cb4-a0fb-b80a9bc7f1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:17.366495 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdaa92-1abd-4cb4-a0fb-b80a9bc7f1ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:17.376881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdaa92-1abd-4cb4-a0fb-b80a9bc7f1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:17.378349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdaa92-1abd-4cb4-a0fb-b80a9bc7f1ee None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d7cdaa92-1abd-4cb4-a0fb-b80a9bc7f1ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:02:17.393351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:17.394318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:17.395268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:02:17.395268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:02:17.395268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:17.395268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:17.397067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 542/1089] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:02:17.400441 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094346d-3203-48c3-ab4a-831e0e12bac0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:17.502140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094346d-3203-48c3-ab4a-831e0e12bac0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:17.537387 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d04a10-7ebc-4f6d-b20c-881d42721d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:17.537924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d04a10-7ebc-4f6d-b20c-881d42721d30 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:17.538194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d04a10-7ebc-4f6d-b20c-881d42721d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:17.538462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d04a10-7ebc-4f6d-b20c-881d42721d30 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:17.539143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d04a10-7ebc-4f6d-b20c-881d42721d30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:17.539424 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d04a10-7ebc-4f6d-b20c-881d42721d30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:17.540762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d04a10-7ebc-4f6d-b20c-881d42721d30 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:17.553424 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 548/1090] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:17.559409 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdaa92-1abd-4cb4-a0fb-b80a9bc7f1ee None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:17.580726 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:17.669809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdaa92-1abd-4cb4-a0fb-b80a9bc7f1ee None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:17.706333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de1a85-34a6-469e-99d5-9708f9712506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:17.706984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de1a85-34a6-469e-99d5-9708f9712506 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:17.707237 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de1a85-34a6-469e-99d5-9708f9712506 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:17.707514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de1a85-34a6-469e-99d5-9708f9712506 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:17.715819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de1a85-34a6-469e-99d5-9708f9712506 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:17.717312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de1a85-34a6-469e-99d5-9708f9712506 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d6de1a85-34a6-469e-99d5-9708f9712506 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:02:17.729691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:17.730716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:17.732186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:17.732186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:17.732186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:02:17.732186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:02:17.732186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:02:17.732186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:02:17.732186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:02:17.732186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:02:17.732186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 07:02:17.732186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:17.732186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 543/1091] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Aug 5 07:02:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:17.737040 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d04a10-7ebc-4f6d-b20c-881d42721d30 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:17.767786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:17.856683 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d04a10-7ebc-4f6d-b20c-881d42721d30 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:17.893963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbffe6f-844f-4b37-9bf3-c14a5f019168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:17.894587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbffe6f-844f-4b37-9bf3-c14a5f019168 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:17.894867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbffe6f-844f-4b37-9bf3-c14a5f019168 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:17.895141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbffe6f-844f-4b37-9bf3-c14a5f019168 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:17.895939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbffe6f-844f-4b37-9bf3-c14a5f019168 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:17.896246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbffe6f-844f-4b37-9bf3-c14a5f019168 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:17.897711 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbffe6f-844f-4b37-9bf3-c14a5f019168 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:17.915608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 549/1092] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Aug 5 07:02:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:17.921730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de1a85-34a6-469e-99d5-9708f9712506 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:18.004641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:18.028015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de1a85-34a6-469e-99d5-9708f9712506 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:18.063630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4da781-4994-49dd-8c89-6b452a54a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:18.064266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4da781-4994-49dd-8c89-6b452a54a6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:18.064545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4da781-4994-49dd-8c89-6b452a54a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:18.064826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4da781-4994-49dd-8c89-6b452a54a6c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:18.138479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4da781-4994-49dd-8c89-6b452a54a6c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:18.139963 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4da781-4994-49dd-8c89-6b452a54a6c4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:18.222736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:18.247618 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 544/1093] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:02:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:02:18.253732 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbffe6f-844f-4b37-9bf3-c14a5f019168 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:18.348324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:18.365376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbffe6f-844f-4b37-9bf3-c14a5f019168 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:18.401520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6db0e-6910-4a02-b86f-83078ae31912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:18.402082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6db0e-6910-4a02-b86f-83078ae31912 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:18.402364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6db0e-6910-4a02-b86f-83078ae31912 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:18.402636 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6db0e-6910-4a02-b86f-83078ae31912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:18.414291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6db0e-6910-4a02-b86f-83078ae31912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:18.415757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6db0e-6910-4a02-b86f-83078ae31912 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d8a6db0e-6910-4a02-b86f-83078ae31912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:02:18.431340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:18.432275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:18.433291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:02:18.433291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:02:18.433291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:02:18.433291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:18.433291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 550/1094] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:18.439874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4da781-4994-49dd-8c89-6b452a54a6c4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:18.541957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4da781-4994-49dd-8c89-6b452a54a6c4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:18.547064 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23497ec2-03cc-4ca6-a539-eb485a3e1def None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:18.547352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23497ec2-03cc-4ca6-a539-eb485a3e1def None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:18.547628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23497ec2-03cc-4ca6-a539-eb485a3e1def None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:18.549005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 551/1095] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:18.554358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2acef9-d054-4f04-9361-6d57923a8a04 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:18.554648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2acef9-d054-4f04-9361-6d57923a8a04 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:18.554923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2acef9-d054-4f04-9361-6d57923a8a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:18.573766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1f2acef9-d054-4f04-9361-6d57923a8a04 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:18.574946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1f2acef9-d054-4f04-9361-6d57923a8a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:18.578234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4de4-e998-4dbb-865c-73e3edf569ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:18.578874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4de4-e998-4dbb-865c-73e3edf569ff None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:18.579153 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4de4-e998-4dbb-865c-73e3edf569ff None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:18.579435 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4de4-e998-4dbb-865c-73e3edf569ff None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:18.580121 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4de4-e998-4dbb-865c-73e3edf569ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:18.580422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4de4-e998-4dbb-865c-73e3edf569ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:18.581841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4de4-e998-4dbb-865c-73e3edf569ff None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:18.593515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 545/1096] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:18.599288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4de4-e998-4dbb-865c-73e3edf569ff None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:18.639394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:18.645768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 552/1097] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:18.669161 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2acef9-d054-4f04-9361-6d57923a8a04 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:18.700462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4de4-e998-4dbb-865c-73e3edf569ff None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:18.734302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:18.735592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0b9c9-05a5-42d7-a14e-277d19830c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:18.736448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0b9c9-05a5-42d7-a14e-277d19830c77 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:18.736684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0b9c9-05a5-42d7-a14e-277d19830c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:18.736988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0b9c9-05a5-42d7-a14e-277d19830c77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:18.744314 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0b9c9-05a5-42d7-a14e-277d19830c77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:18.745820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0b9c9-05a5-42d7-a14e-277d19830c77 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-9ef0b9c9-05a5-42d7-a14e-277d19830c77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:02:18.758345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:18.759447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:18.760728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:02:18.760728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:02:18.760728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:02:18.760728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:02:18.760728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:02:18.760728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:02:18.760728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:02:18.760728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:18.760728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 546/1098] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:02:18.765613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0b9c9-05a5-42d7-a14e-277d19830c77 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:18.773392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2acef9-d054-4f04-9361-6d57923a8a04 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:18.809447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c97e3-a5af-44e5-a0c8-0942b0dcd68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:18.810084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c97e3-a5af-44e5-a0c8-0942b0dcd68d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:18.810365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c97e3-a5af-44e5-a0c8-0942b0dcd68d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:18.810646 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c97e3-a5af-44e5-a0c8-0942b0dcd68d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:18.821192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c97e3-a5af-44e5-a0c8-0942b0dcd68d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ff0c97e3-a5af-44e5-a0c8-0942b0dcd68d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:02:18.826107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:18.827160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:18.828115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 553/1099] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:02:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:02:18.833767 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c97e3-a5af-44e5-a0c8-0942b0dcd68d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:18.874449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:18.878342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0b9c9-05a5-42d7-a14e-277d19830c77 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:18.913478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5510933-18ce-4845-8af1-d98df14cfdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:18.914104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5510933-18ce-4845-8af1-d98df14cfdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:18.914377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5510933-18ce-4845-8af1-d98df14cfdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:18.914639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5510933-18ce-4845-8af1-d98df14cfdc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:18.915385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5510933-18ce-4845-8af1-d98df14cfdc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:18.915687 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5510933-18ce-4845-8af1-d98df14cfdc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:18.917155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5510933-18ce-4845-8af1-d98df14cfdc8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:18.929519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 547/1100] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:02:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:18.935637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5510933-18ce-4845-8af1-d98df14cfdc8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:18.937469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c97e3-a5af-44e5-a0c8-0942b0dcd68d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:18.963164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:18.972998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91231e55-2b17-4a5d-8313-1e68bac16662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:18.973633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91231e55-2b17-4a5d-8313-1e68bac16662 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:18.973909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91231e55-2b17-4a5d-8313-1e68bac16662 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:18.974183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91231e55-2b17-4a5d-8313-1e68bac16662 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:18.974907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91231e55-2b17-4a5d-8313-1e68bac16662 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:18.975213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91231e55-2b17-4a5d-8313-1e68bac16662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:18.976609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91231e55-2b17-4a5d-8313-1e68bac16662 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:18.985360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 554/1101] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:02:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:18.991286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91231e55-2b17-4a5d-8313-1e68bac16662 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:19.043698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5510933-18ce-4845-8af1-d98df14cfdc8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:19.077426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a838-7357-425a-8c5b-ddb73e63f5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:19.078075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a838-7357-425a-8c5b-ddb73e63f5ba None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:19.078355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a838-7357-425a-8c5b-ddb73e63f5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:19.078622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413a838-7357-425a-8c5b-ddb73e63f5ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:19.079407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a838-7357-425a-8c5b-ddb73e63f5ba None admin] RBAC: Adding query filter params (role.id=203154726d1340b6b60888f02c96c1e8, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=555de6e5c8c44f40a6433b3d2ffc52f3) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:19.079713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a838-7357-425a-8c5b-ddb73e63f5ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:19.081302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413a838-7357-425a-8c5b-ddb73e63f5ba None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:19.096997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 548/1102] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:02:18 2022] GET /identity/v3/role_assignments?user.id=555de6e5c8c44f40a6433b3d2ffc52f3&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=203154726d1340b6b60888f02c96c1e8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:19.097273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91231e55-2b17-4a5d-8313-1e68bac16662 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:19.133784 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82675e5-4bc0-4a73-a3ed-6efac61c7952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:19.134441 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82675e5-4bc0-4a73-a3ed-6efac61c7952 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:19.134723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82675e5-4bc0-4a73-a3ed-6efac61c7952 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:19.134996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82675e5-4bc0-4a73-a3ed-6efac61c7952 None admin] PATH_INFO: `/v3/users/d7ee15468aa145edb838c6f84d262223` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:19.136236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82675e5-4bc0-4a73-a3ed-6efac61c7952 None admin] RBAC: Authorizing `identity:get_user(user_id=d7ee15468aa145edb838c6f84d262223)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:19.137738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82675e5-4bc0-4a73-a3ed-6efac61c7952 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:19.139450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 555/1103] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:18 2022] GET /identity/v3/users/d7ee15468aa145edb838c6f84d262223 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:02:19.145880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a838-7357-425a-8c5b-ddb73e63f5ba None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:19.174212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:19.254389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413a838-7357-425a-8c5b-ddb73e63f5ba None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:19.294324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069aa7b-80de-428c-a008-75e26221619c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:19.294962 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069aa7b-80de-428c-a008-75e26221619c None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:19.295244 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069aa7b-80de-428c-a008-75e26221619c None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:19.295539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069aa7b-80de-428c-a008-75e26221619c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:19.363192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069aa7b-80de-428c-a008-75e26221619c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:19.364645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069aa7b-80de-428c-a008-75e26221619c None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:19.388648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:19.481670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 549/1104] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:02:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:02:19.489690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82675e5-4bc0-4a73-a3ed-6efac61c7952 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:19.554298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:19.602682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82675e5-4bc0-4a73-a3ed-6efac61c7952 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:19.637539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909fc2e-655f-45bc-8ac6-5412d2d516bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:19.638189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909fc2e-655f-45bc-8ac6-5412d2d516bc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:19.638463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909fc2e-655f-45bc-8ac6-5412d2d516bc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:19.638734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909fc2e-655f-45bc-8ac6-5412d2d516bc None admin] PATH_INFO: `/v3/projects/c4849fb6886a4dc68092306f5fdf9e89` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:19.639947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909fc2e-655f-45bc-8ac6-5412d2d516bc None admin] RBAC: Authorizing `identity:get_project(project_id=c4849fb6886a4dc68092306f5fdf9e89)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:19.641639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909fc2e-655f-45bc-8ac6-5412d2d516bc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:19.643641 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 556/1105] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:02:19 2022] GET /identity/v3/projects/c4849fb6886a4dc68092306f5fdf9e89 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:19.649820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069aa7b-80de-428c-a008-75e26221619c None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:19.757924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069aa7b-80de-428c-a008-75e26221619c None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:19.784561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:19.797524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc455d-2679-4d57-9cd2-75ec97d3ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:19.798153 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc455d-2679-4d57-9cd2-75ec97d3ad92 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:19.798430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc455d-2679-4d57-9cd2-75ec97d3ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:19.798698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc455d-2679-4d57-9cd2-75ec97d3ad92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:19.799479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc455d-2679-4d57-9cd2-75ec97d3ad92 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=c4849fb6886a4dc68092306f5fdf9e89, user.id=d7ee15468aa145edb838c6f84d262223) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:19.799780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc455d-2679-4d57-9cd2-75ec97d3ad92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:19.801247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc455d-2679-4d57-9cd2-75ec97d3ad92 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:19.808044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 550/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:02:19 2022] GET /identity/v3/role_assignments?user.id=d7ee15468aa145edb838c6f84d262223&scope.project.id=c4849fb6886a4dc68092306f5fdf9e89&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:21.803975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8389d-cc6a-4412-8199-4ed4b2998ab8 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:21.804555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8389d-cc6a-4412-8199-4ed4b2998ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:21.804555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8389d-cc6a-4412-8199-4ed4b2998ab8 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:21.805958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 557/1107] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:21.811350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be36f-414c-47d2-a0d4-37a0f9d8cdda None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:21.811807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be36f-414c-47d2-a0d4-37a0f9d8cdda None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:21.811903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be36f-414c-47d2-a0d4-37a0f9d8cdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:21.830898 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-618be36f-414c-47d2-a0d4-37a0f9d8cdda None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:21.832104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-618be36f-414c-47d2-a0d4-37a0f9d8cdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:21.904827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 551/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:21.930342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8389d-cc6a-4412-8199-4ed4b2998ab8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:22.034051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8389d-cc6a-4412-8199-4ed4b2998ab8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:22.058341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:22.076729 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed690f3-5f5a-400e-876e-6d47717f52e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:22.077420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed690f3-5f5a-400e-876e-6d47717f52e3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:22.077701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed690f3-5f5a-400e-876e-6d47717f52e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:22.077972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed690f3-5f5a-400e-876e-6d47717f52e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:22.079223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed690f3-5f5a-400e-876e-6d47717f52e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:22.080657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed690f3-5f5a-400e-876e-6d47717f52e3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:22.082304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 558/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:22.088415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be36f-414c-47d2-a0d4-37a0f9d8cdda None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:22.190136 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be36f-414c-47d2-a0d4-37a0f9d8cdda None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:22.206613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:22.226325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ddaee-9213-4964-865c-c687373dd92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:22.226944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ddaee-9213-4964-865c-c687373dd92d None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:22.227223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ddaee-9213-4964-865c-c687373dd92d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:22.227493 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ddaee-9213-4964-865c-c687373dd92d None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:22.228232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ddaee-9213-4964-865c-c687373dd92d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:22.229773 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ddaee-9213-4964-865c-c687373dd92d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:22.252145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 552/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:02:22 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:02:24.267867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424b1e3-be8b-403a-8af6-50168c105300 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:24.268429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424b1e3-be8b-403a-8af6-50168c105300 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:24.268429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424b1e3-be8b-403a-8af6-50168c105300 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:24.269827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 559/1111] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:24.275333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754b6a3-c444-4176-a973-7b08ad25269c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:24.275799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754b6a3-c444-4176-a973-7b08ad25269c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:24.275887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754b6a3-c444-4176-a973-7b08ad25269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:24.295625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c754b6a3-c444-4176-a973-7b08ad25269c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:24.296876 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c754b6a3-c444-4176-a973-7b08ad25269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:24.366805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 553/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:24.390093 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424b1e3-be8b-403a-8af6-50168c105300 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:24.495086 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424b1e3-be8b-403a-8af6-50168c105300 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:24.530705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d26ba-3c22-476b-956d-36164eaa45a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:24.531261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d26ba-3c22-476b-956d-36164eaa45a1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:24.531545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d26ba-3c22-476b-956d-36164eaa45a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:24.531821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d26ba-3c22-476b-956d-36164eaa45a1 None admin] PATH_INFO: `/v3/roles/04a9c139ed6d44d4bcd37b614aeb009e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:24.533347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d26ba-3c22-476b-956d-36164eaa45a1 None admin] RBAC: Authorizing `identity:get_role(role_id=04a9c139ed6d44d4bcd37b614aeb009e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:24.534786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d26ba-3c22-476b-956d-36164eaa45a1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:24.536478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 560/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:24 2022] GET /identity/v3/roles/04a9c139ed6d44d4bcd37b614aeb009e => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:24.542694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754b6a3-c444-4176-a973-7b08ad25269c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:24.639282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754b6a3-c444-4176-a973-7b08ad25269c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:24.640920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:24.676799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f8ed9-8764-4014-9dc6-0d20c02cf124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:24.677492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f8ed9-8764-4014-9dc6-0d20c02cf124 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:24.677774 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f8ed9-8764-4014-9dc6-0d20c02cf124 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:24.678039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f8ed9-8764-4014-9dc6-0d20c02cf124 None admin] PATH_INFO: `/v3/users/69a1351982de4299a3dc7d67e7711c99` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:24.691698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f8ed9-8764-4014-9dc6-0d20c02cf124 None admin] RBAC: Authorizing `identity:get_user(user_id=69a1351982de4299a3dc7d67e7711c99)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:24.693188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f8ed9-8764-4014-9dc6-0d20c02cf124 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:24.694791 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 554/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:24 2022] GET /identity/v3/users/69a1351982de4299a3dc7d67e7711c99 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:24.700826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d26ba-3c22-476b-956d-36164eaa45a1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:24.761669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:24.803857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d26ba-3c22-476b-956d-36164eaa45a1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:24.839476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb08e91-0b58-4677-83f8-9b4e614bc38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:24.840087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb08e91-0b58-4677-83f8-9b4e614bc38a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:24.840365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb08e91-0b58-4677-83f8-9b4e614bc38a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:24.840632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb08e91-0b58-4677-83f8-9b4e614bc38a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:24.915375 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb08e91-0b58-4677-83f8-9b4e614bc38a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:24.916813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb08e91-0b58-4677-83f8-9b4e614bc38a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:24.978084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:25.021301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 561/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:02:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:02:25.027524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f8ed9-8764-4014-9dc6-0d20c02cf124 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:25.129248 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f8ed9-8764-4014-9dc6-0d20c02cf124 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:25.171569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3966-6098-4e0e-8c2c-8d14fc53c3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:25.172206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3966-6098-4e0e-8c2c-8d14fc53c3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:25.172487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3966-6098-4e0e-8c2c-8d14fc53c3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:25.172762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3966-6098-4e0e-8c2c-8d14fc53c3e8 None admin] PATH_INFO: `/v3/projects/c4849fb6886a4dc68092306f5fdf9e89` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:25.174080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c3966-6098-4e0e-8c2c-8d14fc53c3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=c4849fb6886a4dc68092306f5fdf9e89)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:25.175529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c3966-6098-4e0e-8c2c-8d14fc53c3e8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:25.177213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 555/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:02:25 2022] GET /identity/v3/projects/c4849fb6886a4dc68092306f5fdf9e89 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:25.184069 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb08e91-0b58-4677-83f8-9b4e614bc38a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:25.290062 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb08e91-0b58-4677-83f8-9b4e614bc38a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:25.331060 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cf4ed-563e-4044-bb7d-0fae6781c05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:25.331672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cf4ed-563e-4044-bb7d-0fae6781c05d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:25.331947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cf4ed-563e-4044-bb7d-0fae6781c05d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:25.332221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cf4ed-563e-4044-bb7d-0fae6781c05d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:25.333033 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cf4ed-563e-4044-bb7d-0fae6781c05d None admin] RBAC: Adding query filter params (role.id=04a9c139ed6d44d4bcd37b614aeb009e, scope.project.id=c4849fb6886a4dc68092306f5fdf9e89, user.id=69a1351982de4299a3dc7d67e7711c99) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:25.333456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cf4ed-563e-4044-bb7d-0fae6781c05d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:25.334889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cf4ed-563e-4044-bb7d-0fae6781c05d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:25.340414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 562/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:02:25 2022] GET /identity/v3/role_assignments?user.id=69a1351982de4299a3dc7d67e7711c99&scope.project.id=c4849fb6886a4dc68092306f5fdf9e89&role.id=04a9c139ed6d44d4bcd37b614aeb009e => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:27.282922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c4cad-be4b-4e79-9b1a-42a11e8429ec None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:27.283324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c4cad-be4b-4e79-9b1a-42a11e8429ec None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:27.283475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c4cad-be4b-4e79-9b1a-42a11e8429ec None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:27.284846 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 556/1118] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:27.291164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38046f-0c20-4cfa-a64e-748c6a75001c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:27.291608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38046f-0c20-4cfa-a64e-748c6a75001c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:27.291715 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38046f-0c20-4cfa-a64e-748c6a75001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:27.311100 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-df38046f-0c20-4cfa-a64e-748c6a75001c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:27.312436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-df38046f-0c20-4cfa-a64e-748c6a75001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:27.330535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:27.384562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 563/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:27.407069 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c4cad-be4b-4e79-9b1a-42a11e8429ec None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:27.444416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:27.525807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c4cad-be4b-4e79-9b1a-42a11e8429ec None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:27.561931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b39856-7551-4c27-bdd6-df0105d55ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:27.562503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b39856-7551-4c27-bdd6-df0105d55ebe None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:27.562780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b39856-7551-4c27-bdd6-df0105d55ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:27.563054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b39856-7551-4c27-bdd6-df0105d55ebe None admin] PATH_INFO: `/v3/roles/04a9c139ed6d44d4bcd37b614aeb009e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:27.564551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b39856-7551-4c27-bdd6-df0105d55ebe None admin] RBAC: Authorizing `identity:get_role(role_id=04a9c139ed6d44d4bcd37b614aeb009e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:27.565961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b39856-7551-4c27-bdd6-df0105d55ebe None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:27.567296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 557/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:27 2022] GET /identity/v3/roles/04a9c139ed6d44d4bcd37b614aeb009e => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:27.574476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38046f-0c20-4cfa-a64e-748c6a75001c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:27.679893 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38046f-0c20-4cfa-a64e-748c6a75001c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:27.723183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d58cc-c951-490b-8528-2d69bec1d1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:27.723819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d58cc-c951-490b-8528-2d69bec1d1fd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:27.724097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d58cc-c951-490b-8528-2d69bec1d1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:27.724371 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d58cc-c951-490b-8528-2d69bec1d1fd None admin] PATH_INFO: `/v3/users/69a1351982de4299a3dc7d67e7711c99` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:27.725614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d58cc-c951-490b-8528-2d69bec1d1fd None admin] RBAC: Authorizing `identity:get_user(user_id=69a1351982de4299a3dc7d67e7711c99)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:27.727054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d58cc-c951-490b-8528-2d69bec1d1fd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:27.728655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 564/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:27 2022] GET /identity/v3/users/69a1351982de4299a3dc7d67e7711c99 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:27.734742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b39856-7551-4c27-bdd6-df0105d55ebe None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:27.836154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:27.842681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b39856-7551-4c27-bdd6-df0105d55ebe None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:27.877619 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6d36c-cf6b-40e1-bc16-8f7459ce4988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:27.878249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6d36c-cf6b-40e1-bc16-8f7459ce4988 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:27.878529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6d36c-cf6b-40e1-bc16-8f7459ce4988 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:27.878803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6d36c-cf6b-40e1-bc16-8f7459ce4988 None admin] PATH_INFO: `/v3/projects/c4849fb6886a4dc68092306f5fdf9e89` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:27.880011 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6d36c-cf6b-40e1-bc16-8f7459ce4988 None admin] RBAC: Authorizing `identity:get_project(project_id=c4849fb6886a4dc68092306f5fdf9e89)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:27.881490 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6d36c-cf6b-40e1-bc16-8f7459ce4988 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:27.883140 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 558/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:02:27 2022] GET /identity/v3/projects/c4849fb6886a4dc68092306f5fdf9e89 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:27.889241 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d58cc-c951-490b-8528-2d69bec1d1fd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:27.916527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:28.010450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d58cc-c951-490b-8528-2d69bec1d1fd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:28.046498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9964dce-5f71-494c-b38b-2398d93a2623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:28.047159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9964dce-5f71-494c-b38b-2398d93a2623 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:28.047445 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9964dce-5f71-494c-b38b-2398d93a2623 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:28.047726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9964dce-5f71-494c-b38b-2398d93a2623 None admin] PATH_INFO: `/v3/projects/c4849fb6886a4dc68092306f5fdf9e89/users/69a1351982de4299a3dc7d67e7711c99/roles/04a9c139ed6d44d4bcd37b614aeb009e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:28.050271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9964dce-5f71-494c-b38b-2398d93a2623 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4849fb6886a4dc68092306f5fdf9e89, user_id=69a1351982de4299a3dc7d67e7711c99, role_id=04a9c139ed6d44d4bcd37b614aeb009e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:28.051704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9964dce-5f71-494c-b38b-2398d93a2623 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:28.067602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 565/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:02:27 2022] PUT /identity/v3/projects/c4849fb6886a4dc68092306f5fdf9e89/users/69a1351982de4299a3dc7d67e7711c99/roles/04a9c139ed6d44d4bcd37b614aeb009e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:02:30.013191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3fa57-fc5e-46bd-8ead-d1a6fca2eda2 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:30.013784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3fa57-fc5e-46bd-8ead-d1a6fca2eda2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:30.013784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3fa57-fc5e-46bd-8ead-d1a6fca2eda2 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:30.015248 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 559/1124] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:30.020882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d33589-8f58-4225-9dba-28f6444bd047 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:30.021357 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d33589-8f58-4225-9dba-28f6444bd047 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:30.021458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d33589-8f58-4225-9dba-28f6444bd047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:30.041142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-68d33589-8f58-4225-9dba-28f6444bd047 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:30.042347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-68d33589-8f58-4225-9dba-28f6444bd047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:30.107581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 566/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:30.130747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3fa57-fc5e-46bd-8ead-d1a6fca2eda2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:30.234341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3fa57-fc5e-46bd-8ead-d1a6fca2eda2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:30.271033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582211b-7db0-46fa-a595-769087c63475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:30.271597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582211b-7db0-46fa-a595-769087c63475 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:30.271877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582211b-7db0-46fa-a595-769087c63475 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:30.272110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582211b-7db0-46fa-a595-769087c63475 None admin] PATH_INFO: `/v3/roles/04a9c139ed6d44d4bcd37b614aeb009e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:30.273674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582211b-7db0-46fa-a595-769087c63475 None admin] RBAC: Authorizing `identity:get_role(role_id=04a9c139ed6d44d4bcd37b614aeb009e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:30.275059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582211b-7db0-46fa-a595-769087c63475 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:30.276423 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 560/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:30 2022] GET /identity/v3/roles/04a9c139ed6d44d4bcd37b614aeb009e => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:30.282835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d33589-8f58-4225-9dba-28f6444bd047 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:30.298005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:30.389144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d33589-8f58-4225-9dba-28f6444bd047 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:30.425504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2b2bb-0e0e-49f8-ac85-1f0c651d9c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:30.426148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2b2bb-0e0e-49f8-ac85-1f0c651d9c7f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:30.426427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2b2bb-0e0e-49f8-ac85-1f0c651d9c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:30.426699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2b2bb-0e0e-49f8-ac85-1f0c651d9c7f None admin] PATH_INFO: `/v3/users/69a1351982de4299a3dc7d67e7711c99` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:30.427922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2b2bb-0e0e-49f8-ac85-1f0c651d9c7f None admin] RBAC: Authorizing `identity:get_user(user_id=69a1351982de4299a3dc7d67e7711c99)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:30.429400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2b2bb-0e0e-49f8-ac85-1f0c651d9c7f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:30.431036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 567/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:30 2022] GET /identity/v3/users/69a1351982de4299a3dc7d67e7711c99 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:30.437318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582211b-7db0-46fa-a595-769087c63475 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:30.470120 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:30.542026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582211b-7db0-46fa-a595-769087c63475 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:30.576831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f6ca8-f7f1-44d6-a3d4-e7d498aa73e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:30.577714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f6ca8-f7f1-44d6-a3d4-e7d498aa73e9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:30.577994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f6ca8-f7f1-44d6-a3d4-e7d498aa73e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:30.578265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f6ca8-f7f1-44d6-a3d4-e7d498aa73e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:30.647776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f6ca8-f7f1-44d6-a3d4-e7d498aa73e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:30.649273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f6ca8-f7f1-44d6-a3d4-e7d498aa73e9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:30.679949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:30.749295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 561/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:02:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:02:30.755552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2b2bb-0e0e-49f8-ac85-1f0c651d9c7f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:30.837432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:30.857895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2b2bb-0e0e-49f8-ac85-1f0c651d9c7f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:30.892288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f755b6-fe31-48ed-a25a-d8aabc2671ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:30.892939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f755b6-fe31-48ed-a25a-d8aabc2671ea None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:30.893240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f755b6-fe31-48ed-a25a-d8aabc2671ea None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:30.893517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f755b6-fe31-48ed-a25a-d8aabc2671ea None admin] PATH_INFO: `/v3/projects/c4849fb6886a4dc68092306f5fdf9e89` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:30.894709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f755b6-fe31-48ed-a25a-d8aabc2671ea None admin] RBAC: Authorizing `identity:get_project(project_id=c4849fb6886a4dc68092306f5fdf9e89)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:30.896148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f755b6-fe31-48ed-a25a-d8aabc2671ea None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:30.897859 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 568/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:02:30 2022] GET /identity/v3/projects/c4849fb6886a4dc68092306f5fdf9e89 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:30.904304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f6ca8-f7f1-44d6-a3d4-e7d498aa73e9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:31.007915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f6ca8-f7f1-44d6-a3d4-e7d498aa73e9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:31.038276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:31.044026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af845ca0-a4c5-4263-b445-755db5c11760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:31.044638 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845ca0-a4c5-4263-b445-755db5c11760 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:31.044927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845ca0-a4c5-4263-b445-755db5c11760 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:31.045204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af845ca0-a4c5-4263-b445-755db5c11760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:31.046013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af845ca0-a4c5-4263-b445-755db5c11760 None admin] RBAC: Adding query filter params (role.id=04a9c139ed6d44d4bcd37b614aeb009e, scope.project.id=c4849fb6886a4dc68092306f5fdf9e89, user.id=69a1351982de4299a3dc7d67e7711c99) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:31.046298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af845ca0-a4c5-4263-b445-755db5c11760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:31.047727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af845ca0-a4c5-4263-b445-755db5c11760 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:31.053615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 562/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:02:30 2022] GET /identity/v3/role_assignments?user.id=69a1351982de4299a3dc7d67e7711c99&scope.project.id=c4849fb6886a4dc68092306f5fdf9e89&role.id=04a9c139ed6d44d4bcd37b614aeb009e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:33.053121 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b173f61-9bf4-4ab0-936e-215eefd9b7a3 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:33.053686 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b173f61-9bf4-4ab0-936e-215eefd9b7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:33.053686 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b173f61-9bf4-4ab0-936e-215eefd9b7a3 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:33.055016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 569/1131] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:33.060549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669d5a2-eec8-420a-9beb-7209298a26ec None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:33.061019 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669d5a2-eec8-420a-9beb-7209298a26ec None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:33.061125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669d5a2-eec8-420a-9beb-7209298a26ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:33.080592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9669d5a2-eec8-420a-9beb-7209298a26ec None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:33.081834 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9669d5a2-eec8-420a-9beb-7209298a26ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:33.152190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 563/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:33.176064 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b173f61-9bf4-4ab0-936e-215eefd9b7a3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:33.286957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b173f61-9bf4-4ab0-936e-215eefd9b7a3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:33.324857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dd3a4-e704-4fc2-b83d-053b2b8277bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:33.325438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dd3a4-e704-4fc2-b83d-053b2b8277bf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:33.325721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dd3a4-e704-4fc2-b83d-053b2b8277bf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:33.325996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dd3a4-e704-4fc2-b83d-053b2b8277bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:33.327134 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dd3a4-e704-4fc2-b83d-053b2b8277bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:33.328582 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dd3a4-e704-4fc2-b83d-053b2b8277bf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:33.330237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 570/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:33.336489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669d5a2-eec8-420a-9beb-7209298a26ec None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:33.445145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669d5a2-eec8-420a-9beb-7209298a26ec None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:33.472024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:33.481214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb42c0-6fd2-44be-ac27-b2cfd9906e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:33.481844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb42c0-6fd2-44be-ac27-b2cfd9906e3e None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:33.482122 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb42c0-6fd2-44be-ac27-b2cfd9906e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:33.482394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb42c0-6fd2-44be-ac27-b2cfd9906e3e None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:33.483085 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb42c0-6fd2-44be-ac27-b2cfd9906e3e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:33.484567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb42c0-6fd2-44be-ac27-b2cfd9906e3e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:33.513673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 564/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:02:33 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:02:35.562366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ab510-f111-4284-b706-13f1d5aba3cd None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:35.562909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ab510-f111-4284-b706-13f1d5aba3cd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:35.562909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ab510-f111-4284-b706-13f1d5aba3cd None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:35.564200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 571/1135] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:35.569781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed05f39-4afb-4233-a3ea-fd65dd2ac542 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:35.570231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed05f39-4afb-4233-a3ea-fd65dd2ac542 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:35.570330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed05f39-4afb-4233-a3ea-fd65dd2ac542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:35.589355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5ed05f39-4afb-4233-a3ea-fd65dd2ac542 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:35.590558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5ed05f39-4afb-4233-a3ea-fd65dd2ac542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:35.662243 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 565/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:35.686918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ab510-f111-4284-b706-13f1d5aba3cd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:35.707071 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:35.806443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ab510-f111-4284-b706-13f1d5aba3cd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:35.843380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a245f9-aaea-4ed5-a0a6-be98d43dd1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:35.843934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a245f9-aaea-4ed5-a0a6-be98d43dd1ee None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:35.844224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a245f9-aaea-4ed5-a0a6-be98d43dd1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:35.844501 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a245f9-aaea-4ed5-a0a6-be98d43dd1ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:35.845704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a245f9-aaea-4ed5-a0a6-be98d43dd1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:35.847140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a245f9-aaea-4ed5-a0a6-be98d43dd1ee None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:35.848756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 572/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:02:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:35.854966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed05f39-4afb-4233-a3ea-fd65dd2ac542 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:35.960060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed05f39-4afb-4233-a3ea-fd65dd2ac542 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:35.969505 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:35.996235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67d080-2179-4171-b5b8-29ac2113980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:35.996841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d080-2179-4171-b5b8-29ac2113980a None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:35.997156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d080-2179-4171-b5b8-29ac2113980a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:35.997427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67d080-2179-4171-b5b8-29ac2113980a None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:35.998101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67d080-2179-4171-b5b8-29ac2113980a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:35.999559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67d080-2179-4171-b5b8-29ac2113980a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:36.022296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 566/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:02:35 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:02:38.037814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a87c48-dd1f-4d6c-9e74-75408c9be9cb None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:38.038379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a87c48-dd1f-4d6c-9e74-75408c9be9cb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:38.038379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a87c48-dd1f-4d6c-9e74-75408c9be9cb None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:38.039750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 573/1139] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:38.045125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d0823-22e1-4cba-a207-33776c4b7443 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:38.045517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d0823-22e1-4cba-a207-33776c4b7443 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:38.045725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d0823-22e1-4cba-a207-33776c4b7443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:38.064619 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ab8d0823-22e1-4cba-a207-33776c4b7443 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:38.065853 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ab8d0823-22e1-4cba-a207-33776c4b7443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:38.134055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 567/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:38.157919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a87c48-dd1f-4d6c-9e74-75408c9be9cb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:38.251271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:38.269419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a87c48-dd1f-4d6c-9e74-75408c9be9cb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:38.304672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e94049-627c-4da1-8b0c-3d9d48dc2e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:38.305277 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e94049-627c-4da1-8b0c-3d9d48dc2e7f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:38.305557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e94049-627c-4da1-8b0c-3d9d48dc2e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:38.305829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e94049-627c-4da1-8b0c-3d9d48dc2e7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:38.316188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e94049-627c-4da1-8b0c-3d9d48dc2e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-69e94049-627c-4da1-8b0c-3d9d48dc2e7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:02:38.321195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:38.322288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:38.323247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 574/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:02:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:38.329404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d0823-22e1-4cba-a207-33776c4b7443 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:38.421993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:38.429953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d0823-22e1-4cba-a207-33776c4b7443 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:38.464531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e66b69-d1e7-46fd-8f87-e02d4d91e46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:38.465177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e66b69-d1e7-46fd-8f87-e02d4d91e46d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:38.465453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e66b69-d1e7-46fd-8f87-e02d4d91e46d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:38.465722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e66b69-d1e7-46fd-8f87-e02d4d91e46d None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:38.466440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e66b69-d1e7-46fd-8f87-e02d4d91e46d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:38.466745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e66b69-d1e7-46fd-8f87-e02d4d91e46d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:38.468159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e66b69-d1e7-46fd-8f87-e02d4d91e46d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:38.476443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 568/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:02:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:38.482672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e94049-627c-4da1-8b0c-3d9d48dc2e7f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:38.588685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e94049-627c-4da1-8b0c-3d9d48dc2e7f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:38.623187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617b7fa-0347-4b3a-bb67-041b36fe5965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:38.623842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617b7fa-0347-4b3a-bb67-041b36fe5965 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:38.624151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617b7fa-0347-4b3a-bb67-041b36fe5965 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:38.624424 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617b7fa-0347-4b3a-bb67-041b36fe5965 None admin] PATH_INFO: `/v3/users/8bdb6ebde6ec45309888641f7b3fd647` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:38.637980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617b7fa-0347-4b3a-bb67-041b36fe5965 None admin] RBAC: Authorizing `identity:get_user(user_id=8bdb6ebde6ec45309888641f7b3fd647)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:38.639599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617b7fa-0347-4b3a-bb67-041b36fe5965 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:38.641260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 575/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:38 2022] GET /identity/v3/users/8bdb6ebde6ec45309888641f7b3fd647 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:38.647323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e66b69-d1e7-46fd-8f87-e02d4d91e46d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:38.760321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e66b69-d1e7-46fd-8f87-e02d4d91e46d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:38.795994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cfeca-5d46-44f5-8c77-83de3fb7cfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:38.796614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cfeca-5d46-44f5-8c77-83de3fb7cfae None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:38.796928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cfeca-5d46-44f5-8c77-83de3fb7cfae None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:38.797202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cfeca-5d46-44f5-8c77-83de3fb7cfae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:38.825251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:38.870650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cfeca-5d46-44f5-8c77-83de3fb7cfae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:38.872040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cfeca-5d46-44f5-8c77-83de3fb7cfae None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:38.974897 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 569/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:02:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 07:02:38.981181 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617b7fa-0347-4b3a-bb67-041b36fe5965 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:38.984394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:39.085444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617b7fa-0347-4b3a-bb67-041b36fe5965 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:39.120076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505ca97-ca31-49a6-9e4e-4bc4011ddfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:39.120779 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505ca97-ca31-49a6-9e4e-4bc4011ddfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:39.120971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505ca97-ca31-49a6-9e4e-4bc4011ddfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:39.121278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505ca97-ca31-49a6-9e4e-4bc4011ddfa7 None admin] PATH_INFO: `/v3/projects/764e8a5faec84190869fefdd5876623e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:39.122470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505ca97-ca31-49a6-9e4e-4bc4011ddfa7 None admin] RBAC: Authorizing `identity:get_project(project_id=764e8a5faec84190869fefdd5876623e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:39.123920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505ca97-ca31-49a6-9e4e-4bc4011ddfa7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:39.125605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 576/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:02:38 2022] GET /identity/v3/projects/764e8a5faec84190869fefdd5876623e => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:39.132151 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cfeca-5d46-44f5-8c77-83de3fb7cfae None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:39.189071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:39.234176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cfeca-5d46-44f5-8c77-83de3fb7cfae None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:39.269873 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9822d3-3270-45c2-8190-e83d107521e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:39.270490 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9822d3-3270-45c2-8190-e83d107521e0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:39.270772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9822d3-3270-45c2-8190-e83d107521e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:39.271044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9822d3-3270-45c2-8190-e83d107521e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:39.271837 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9822d3-3270-45c2-8190-e83d107521e0 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=764e8a5faec84190869fefdd5876623e, user.id=8bdb6ebde6ec45309888641f7b3fd647) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:39.272149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9822d3-3270-45c2-8190-e83d107521e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:39.273629 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9822d3-3270-45c2-8190-e83d107521e0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:39.280640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 570/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:02:39 2022] GET /identity/v3/role_assignments?user.id=8bdb6ebde6ec45309888641f7b3fd647&scope.project.id=764e8a5faec84190869fefdd5876623e&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:41.256649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0e55-cfcc-4cda-9caf-4009e06a0a5d None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:41.257258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0e55-cfcc-4cda-9caf-4009e06a0a5d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:41.257258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0e55-cfcc-4cda-9caf-4009e06a0a5d None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:41.258596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 577/1147] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:41.265793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08833d-89cd-41be-a5f4-057ed55acfdc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:41.266411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08833d-89cd-41be-a5f4-057ed55acfdc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:41.266411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08833d-89cd-41be-a5f4-057ed55acfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:41.285951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-df08833d-89cd-41be-a5f4-057ed55acfdc None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:41.287239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-df08833d-89cd-41be-a5f4-057ed55acfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:41.358724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 571/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:41.381098 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a0e55-cfcc-4cda-9caf-4009e06a0a5d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:41.456006 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:41.492786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a0e55-cfcc-4cda-9caf-4009e06a0a5d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:41.529593 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7492b-7dd2-4ca7-81b0-763bdf087f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:41.530211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7492b-7dd2-4ca7-81b0-763bdf087f70 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:41.530491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7492b-7dd2-4ca7-81b0-763bdf087f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:41.530763 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7492b-7dd2-4ca7-81b0-763bdf087f70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:41.542150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7492b-7dd2-4ca7-81b0-763bdf087f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f6e7492b-7dd2-4ca7-81b0-763bdf087f70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:02:41.547260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:41.548734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:41.549761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 578/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:41.554857 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08833d-89cd-41be-a5f4-057ed55acfdc None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:41.610324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:41.664044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08833d-89cd-41be-a5f4-057ed55acfdc None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:41.699835 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5aaab-2fa7-45f7-8f2c-0d9b7ee4de6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:41.700467 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5aaab-2fa7-45f7-8f2c-0d9b7ee4de6d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:41.700747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5aaab-2fa7-45f7-8f2c-0d9b7ee4de6d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:41.701053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5aaab-2fa7-45f7-8f2c-0d9b7ee4de6d None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:41.701822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5aaab-2fa7-45f7-8f2c-0d9b7ee4de6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:41.702128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5aaab-2fa7-45f7-8f2c-0d9b7ee4de6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:41.703510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5aaab-2fa7-45f7-8f2c-0d9b7ee4de6d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:41.712283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 572/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:41.718900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7492b-7dd2-4ca7-81b0-763bdf087f70 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:41.829303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7492b-7dd2-4ca7-81b0-763bdf087f70 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:41.862384 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:41.869269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeead0-c728-473c-b112-fedfca0f80a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:41.869914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeead0-c728-473c-b112-fedfca0f80a7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:41.870190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeead0-c728-473c-b112-fedfca0f80a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:41.870462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeead0-c728-473c-b112-fedfca0f80a7 None admin] PATH_INFO: `/v3/users/8bdb6ebde6ec45309888641f7b3fd647` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:41.871646 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeead0-c728-473c-b112-fedfca0f80a7 None admin] RBAC: Authorizing `identity:get_user(user_id=8bdb6ebde6ec45309888641f7b3fd647)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:41.873251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeead0-c728-473c-b112-fedfca0f80a7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:41.874940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 579/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:41 2022] GET /identity/v3/users/8bdb6ebde6ec45309888641f7b3fd647 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:41.881624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5aaab-2fa7-45f7-8f2c-0d9b7ee4de6d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:41.996366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5aaab-2fa7-45f7-8f2c-0d9b7ee4de6d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:42.009711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:42.033043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10cb28-4393-4c37-acb7-f1399cfc9ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:42.033692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10cb28-4393-4c37-acb7-f1399cfc9ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:42.033973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10cb28-4393-4c37-acb7-f1399cfc9ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:42.034234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10cb28-4393-4c37-acb7-f1399cfc9ec3 None admin] PATH_INFO: `/v3/projects/764e8a5faec84190869fefdd5876623e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:42.035743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10cb28-4393-4c37-acb7-f1399cfc9ec3 None admin] RBAC: Authorizing `identity:get_project(project_id=764e8a5faec84190869fefdd5876623e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:42.037263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10cb28-4393-4c37-acb7-f1399cfc9ec3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:42.038926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 573/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:02:41 2022] GET /identity/v3/projects/764e8a5faec84190869fefdd5876623e => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:42.045374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeead0-c728-473c-b112-fedfca0f80a7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:42.154574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeead0-c728-473c-b112-fedfca0f80a7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:42.192959 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45049808-7b45-4cac-abe9-57b8793dd72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:42.193667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45049808-7b45-4cac-abe9-57b8793dd72e None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:42.193950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45049808-7b45-4cac-abe9-57b8793dd72e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:42.194222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45049808-7b45-4cac-abe9-57b8793dd72e None admin] PATH_INFO: `/v3/projects/764e8a5faec84190869fefdd5876623e/users/8bdb6ebde6ec45309888641f7b3fd647/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:42.196345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45049808-7b45-4cac-abe9-57b8793dd72e None admin] RBAC: Authorizing `identity:create_grant(project_id=764e8a5faec84190869fefdd5876623e, user_id=8bdb6ebde6ec45309888641f7b3fd647, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:42.197837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45049808-7b45-4cac-abe9-57b8793dd72e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:42.216954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 580/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:02:42 2022] PUT /identity/v3/projects/764e8a5faec84190869fefdd5876623e/users/8bdb6ebde6ec45309888641f7b3fd647/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:02:44.174040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639af9b5-137f-4d73-9c15-d02536a0a910 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:44.174600 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639af9b5-137f-4d73-9c15-d02536a0a910 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:44.174600 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639af9b5-137f-4d73-9c15-d02536a0a910 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:44.175927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 574/1154] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:44.181307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0fc05-1eee-402b-aa0c-31199301f6ed None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:44.181735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0fc05-1eee-402b-aa0c-31199301f6ed None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:44.181856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0fc05-1eee-402b-aa0c-31199301f6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:44.204101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6ae0fc05-1eee-402b-aa0c-31199301f6ed None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:44.205369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6ae0fc05-1eee-402b-aa0c-31199301f6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:44.265201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:44.281667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 581/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:44.305260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639af9b5-137f-4d73-9c15-d02536a0a910 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:44.411919 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639af9b5-137f-4d73-9c15-d02536a0a910 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:44.448680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d8e48-40f0-4112-b12b-976b8b0edf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:44.449280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d8e48-40f0-4112-b12b-976b8b0edf17 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:44.449560 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d8e48-40f0-4112-b12b-976b8b0edf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:44.449833 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d8e48-40f0-4112-b12b-976b8b0edf17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:44.461614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d8e48-40f0-4112-b12b-976b8b0edf17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-677d8e48-40f0-4112-b12b-976b8b0edf17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:02:44.466551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:44.467648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:44.468613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 575/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:44.474306 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0fc05-1eee-402b-aa0c-31199301f6ed None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:44.577897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0fc05-1eee-402b-aa0c-31199301f6ed None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:44.612134 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41287ec2-4087-4119-808e-5e19e37111a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:44.612752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41287ec2-4087-4119-808e-5e19e37111a6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:44.613061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41287ec2-4087-4119-808e-5e19e37111a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:44.613329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41287ec2-4087-4119-808e-5e19e37111a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:44.614038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41287ec2-4087-4119-808e-5e19e37111a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:44.614334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41287ec2-4087-4119-808e-5e19e37111a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:44.615703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41287ec2-4087-4119-808e-5e19e37111a6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:44.623946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 582/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:02:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:44.631572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d8e48-40f0-4112-b12b-976b8b0edf17 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:44.680692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:44.740081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d8e48-40f0-4112-b12b-976b8b0edf17 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:44.776296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea570e-64cc-4b4a-8da6-98308fe01048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:44.776937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea570e-64cc-4b4a-8da6-98308fe01048 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:44.777242 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea570e-64cc-4b4a-8da6-98308fe01048 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:44.777513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea570e-64cc-4b4a-8da6-98308fe01048 None admin] PATH_INFO: `/v3/users/8bdb6ebde6ec45309888641f7b3fd647` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:44.778832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea570e-64cc-4b4a-8da6-98308fe01048 None admin] RBAC: Authorizing `identity:get_user(user_id=8bdb6ebde6ec45309888641f7b3fd647)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:44.780413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea570e-64cc-4b4a-8da6-98308fe01048 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:44.782062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 576/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:44 2022] GET /identity/v3/users/8bdb6ebde6ec45309888641f7b3fd647 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:44.788692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41287ec2-4087-4119-808e-5e19e37111a6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:44.846940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:44.898858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41287ec2-4087-4119-808e-5e19e37111a6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:44.935431 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10926df0-c7b1-4537-98a7-4fa926ecf953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:44.936080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10926df0-c7b1-4537-98a7-4fa926ecf953 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:44.936432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10926df0-c7b1-4537-98a7-4fa926ecf953 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:44.936708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10926df0-c7b1-4537-98a7-4fa926ecf953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:45.007233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10926df0-c7b1-4537-98a7-4fa926ecf953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:45.008575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10926df0-c7b1-4537-98a7-4fa926ecf953 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:45.063773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:45.114980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 583/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:02:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:02:45.121493 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea570e-64cc-4b4a-8da6-98308fe01048 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:45.227872 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea570e-64cc-4b4a-8da6-98308fe01048 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:45.237235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:45.268213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4f6ad-95c5-4b11-b809-0dd9f6d6460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:45.268782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4f6ad-95c5-4b11-b809-0dd9f6d6460e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:45.269071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4f6ad-95c5-4b11-b809-0dd9f6d6460e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:45.269345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4f6ad-95c5-4b11-b809-0dd9f6d6460e None admin] PATH_INFO: `/v3/projects/764e8a5faec84190869fefdd5876623e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:45.270547 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4f6ad-95c5-4b11-b809-0dd9f6d6460e None admin] RBAC: Authorizing `identity:get_project(project_id=764e8a5faec84190869fefdd5876623e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:45.271995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4f6ad-95c5-4b11-b809-0dd9f6d6460e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:45.273701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 577/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:02:45 2022] GET /identity/v3/projects/764e8a5faec84190869fefdd5876623e => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:45.280338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10926df0-c7b1-4537-98a7-4fa926ecf953 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:45.384233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10926df0-c7b1-4537-98a7-4fa926ecf953 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:45.420219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bd543-0a1e-404b-a97d-00f164053808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:45.420852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bd543-0a1e-404b-a97d-00f164053808 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:45.421343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bd543-0a1e-404b-a97d-00f164053808 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:45.421622 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bd543-0a1e-404b-a97d-00f164053808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:45.422424 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bd543-0a1e-404b-a97d-00f164053808 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=764e8a5faec84190869fefdd5876623e, user.id=8bdb6ebde6ec45309888641f7b3fd647) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:45.422734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bd543-0a1e-404b-a97d-00f164053808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:45.424186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bd543-0a1e-404b-a97d-00f164053808 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:45.430778 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 584/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:02:45 2022] GET /identity/v3/role_assignments?user.id=8bdb6ebde6ec45309888641f7b3fd647&scope.project.id=764e8a5faec84190869fefdd5876623e&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:47.448420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fdaf9-2f0f-4205-b21e-8c76af267327 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:47.448987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fdaf9-2f0f-4205-b21e-8c76af267327 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:47.449078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fdaf9-2f0f-4205-b21e-8c76af267327 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:47.451228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 578/1162] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:47.457306 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d25c43-bc65-4c67-8ce7-bd0037a0e4c3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:47.457758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d25c43-bc65-4c67-8ce7-bd0037a0e4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:47.457852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d25c43-bc65-4c67-8ce7-bd0037a0e4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:47.480071 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-91d25c43-bc65-4c67-8ce7-bd0037a0e4c3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:47.481400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-91d25c43-bc65-4c67-8ce7-bd0037a0e4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:47.491354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:47.561840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 585/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:47.585156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fdaf9-2f0f-4205-b21e-8c76af267327 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:47.705391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fdaf9-2f0f-4205-b21e-8c76af267327 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:47.740405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed961d-d8a7-476b-8da0-8d412dcebbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:47.741058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed961d-d8a7-476b-8da0-8d412dcebbfb None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:47.741334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed961d-d8a7-476b-8da0-8d412dcebbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:47.741598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed961d-d8a7-476b-8da0-8d412dcebbfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:47.785802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:47.810220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed961d-d8a7-476b-8da0-8d412dcebbfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:47.811699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed961d-d8a7-476b-8da0-8d412dcebbfb None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:47.913349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 579/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:02:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:02:47.919537 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d25c43-bc65-4c67-8ce7-bd0037a0e4c3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:48.028921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d25c43-bc65-4c67-8ce7-bd0037a0e4c3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:48.067901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536ddbe-0db4-4c04-87b1-3c54bf7ac88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:48.068561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536ddbe-0db4-4c04-87b1-3c54bf7ac88d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:48.068813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536ddbe-0db4-4c04-87b1-3c54bf7ac88d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:48.069151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536ddbe-0db4-4c04-87b1-3c54bf7ac88d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:48.076915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536ddbe-0db4-4c04-87b1-3c54bf7ac88d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:48.078383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536ddbe-0db4-4c04-87b1-3c54bf7ac88d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-1536ddbe-0db4-4c04-87b1-3c54bf7ac88d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:48.090502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:48.091685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:02:48.092581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 586/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 07:02:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:48.098134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed961d-d8a7-476b-8da0-8d412dcebbfb None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:48.179234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:48.205416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed961d-d8a7-476b-8da0-8d412dcebbfb None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:48.242597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1c702-90ca-4066-9c49-4c05aaa28630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:48.243230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1c702-90ca-4066-9c49-4c05aaa28630 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:48.243506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1c702-90ca-4066-9c49-4c05aaa28630 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:48.243778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1c702-90ca-4066-9c49-4c05aaa28630 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:48.244479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1c702-90ca-4066-9c49-4c05aaa28630 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:48.244785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1c702-90ca-4066-9c49-4c05aaa28630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:48.246209 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1c702-90ca-4066-9c49-4c05aaa28630 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:48.254564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 580/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Aug 5 07:02:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:50.244139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abf52d-637e-406d-a08b-e5d02ab8b1ef None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:50.244722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abf52d-637e-406d-a08b-e5d02ab8b1ef None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:50.244722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abf52d-637e-406d-a08b-e5d02ab8b1ef None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:50.246104 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 587/1167] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:50.252027 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876d59-3dde-4592-8ea4-a6b08f9e4e63 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:50.252524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876d59-3dde-4592-8ea4-a6b08f9e4e63 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:50.252524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876d59-3dde-4592-8ea4-a6b08f9e4e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:50.271312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-fa876d59-3dde-4592-8ea4-a6b08f9e4e63 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:50.272499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fa876d59-3dde-4592-8ea4-a6b08f9e4e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:50.346131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 581/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:02:50.368889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abf52d-637e-406d-a08b-e5d02ab8b1ef None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:50.373493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:50.481240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abf52d-637e-406d-a08b-e5d02ab8b1ef None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:50.521397 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060308c-9baf-4ce1-a749-f6195408bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:50.521940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060308c-9baf-4ce1-a749-f6195408bf9e None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:50.522223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060308c-9baf-4ce1-a749-f6195408bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:50.522494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060308c-9baf-4ce1-a749-f6195408bf9e None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:50.523237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060308c-9baf-4ce1-a749-f6195408bf9e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:50.524658 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060308c-9baf-4ce1-a749-f6195408bf9e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:50.544426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 588/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Fri Aug 5 07:02:50 2022] POST /identity/v3/domains => generated 267 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:02:52.570031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312f03f-0b60-4101-b7cf-a91b8723c7b6 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:52.570554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312f03f-0b60-4101-b7cf-a91b8723c7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:52.570554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312f03f-0b60-4101-b7cf-a91b8723c7b6 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:52.571896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 582/1170] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:52.577314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb8b4f-fa97-4cc6-89f0-9c4f03390616 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:52.577792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb8b4f-fa97-4cc6-89f0-9c4f03390616 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:52.577882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb8b4f-fa97-4cc6-89f0-9c4f03390616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:52.597565 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-61fb8b4f-fa97-4cc6-89f0-9c4f03390616 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:52.598747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-61fb8b4f-fa97-4cc6-89f0-9c4f03390616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:52.661415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:52.673607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 589/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:52.697237 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312f03f-0b60-4101-b7cf-a91b8723c7b6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:52.771692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:52.814798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312f03f-0b60-4101-b7cf-a91b8723c7b6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:52.853538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1b924-4010-44f1-94fd-15bff1950d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:52.854091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1b924-4010-44f1-94fd-15bff1950d81 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:52.854367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1b924-4010-44f1-94fd-15bff1950d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:52.854641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1b924-4010-44f1-94fd-15bff1950d81 None admin] PATH_INFO: `/v3/domains/f499d8fefa91408d8b3080517583740f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:52.865769 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1b924-4010-44f1-94fd-15bff1950d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f499d8fefa91408d8b3080517583740f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:52.867238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1b924-4010-44f1-94fd-15bff1950d81 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:52.868874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 583/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Fri Aug 5 07:02:52 2022] GET /identity/v3/domains/f499d8fefa91408d8b3080517583740f => generated 267 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:52.875479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb8b4f-fa97-4cc6-89f0-9c4f03390616 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:52.983570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb8b4f-fa97-4cc6-89f0-9c4f03390616 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:53.019442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b079f8-eccc-4735-ba08-9e3404e7aa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:53.020066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b079f8-eccc-4735-ba08-9e3404e7aa63 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:53.020347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b079f8-eccc-4735-ba08-9e3404e7aa63 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:53.020622 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b079f8-eccc-4735-ba08-9e3404e7aa63 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:53.021342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b079f8-eccc-4735-ba08-9e3404e7aa63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:53.022794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b079f8-eccc-4735-ba08-9e3404e7aa63 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:53.052414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 590/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:02:52 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:02:55.077802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc042de2-36ee-4c8a-82ca-a96076de6352 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:55.078401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc042de2-36ee-4c8a-82ca-a96076de6352 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:55.078401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc042de2-36ee-4c8a-82ca-a96076de6352 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:55.079676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 584/1174] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:55.085112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7ac28-2173-436c-8067-6def5c6eaec0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:55.085534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7ac28-2173-436c-8067-6def5c6eaec0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:55.085619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7ac28-2173-436c-8067-6def5c6eaec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:55.104413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7fc7ac28-2173-436c-8067-6def5c6eaec0 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:55.105673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7fc7ac28-2173-436c-8067-6def5c6eaec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:55.151862 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:55.179207 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 591/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:55.204083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc042de2-36ee-4c8a-82ca-a96076de6352 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:55.320373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc042de2-36ee-4c8a-82ca-a96076de6352 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:55.350636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:55.357160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf04339-f995-4b1e-8f4a-8215aa798ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:55.357811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf04339-f995-4b1e-8f4a-8215aa798ead None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:55.358084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf04339-f995-4b1e-8f4a-8215aa798ead None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:55.358357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf04339-f995-4b1e-8f4a-8215aa798ead None admin] PATH_INFO: `/v3/domains/f499d8fefa91408d8b3080517583740f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:55.359572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf04339-f995-4b1e-8f4a-8215aa798ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=f499d8fefa91408d8b3080517583740f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:55.361037 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf04339-f995-4b1e-8f4a-8215aa798ead None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:55.362650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 585/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Fri Aug 5 07:02:55 2022] GET /identity/v3/domains/f499d8fefa91408d8b3080517583740f => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:55.368736 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7ac28-2173-436c-8067-6def5c6eaec0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:55.475192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7ac28-2173-436c-8067-6def5c6eaec0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:55.510823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb28631-32ea-4637-bb65-6c379b7c682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:55.511446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb28631-32ea-4637-bb65-6c379b7c682c None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:55.511721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb28631-32ea-4637-bb65-6c379b7c682c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:55.511993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb28631-32ea-4637-bb65-6c379b7c682c None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:55.512670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb28631-32ea-4637-bb65-6c379b7c682c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:55.514123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb28631-32ea-4637-bb65-6c379b7c682c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:55.537966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 592/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:02:55 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:02:57.613797 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc0bd-3fa5-49b7-a05a-de6e2e3ba73e None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:57.614370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc0bd-3fa5-49b7-a05a-de6e2e3ba73e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:57.614370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc0bd-3fa5-49b7-a05a-de6e2e3ba73e None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:57.615591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 586/1178] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:02:57.620990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1c35f-582c-4179-83a0-67f3ac915e10 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:57.621453 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1c35f-582c-4179-83a0-67f3ac915e10 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:57.621565 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1c35f-582c-4179-83a0-67f3ac915e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:57.640954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-47e1c35f-582c-4179-83a0-67f3ac915e10 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:02:57.642192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-47e1c35f-582c-4179-83a0-67f3ac915e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:02:57.669498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:57.713319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 593/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:02:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:02:57.740076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc0bd-3fa5-49b7-a05a-de6e2e3ba73e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:57.850463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc0bd-3fa5-49b7-a05a-de6e2e3ba73e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:57.886874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070c927-c24e-4604-87aa-21edcb21bc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:57.887449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070c927-c24e-4604-87aa-21edcb21bc06 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:57.887725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070c927-c24e-4604-87aa-21edcb21bc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:57.887995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070c927-c24e-4604-87aa-21edcb21bc06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:57.899380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070c927-c24e-4604-87aa-21edcb21bc06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-3070c927-c24e-4604-87aa-21edcb21bc06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:02:57.904306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:02:57.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:02:57.906725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 587/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:02:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:02:57.912183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1c35f-582c-4179-83a0-67f3ac915e10 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:58.016770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1c35f-582c-4179-83a0-67f3ac915e10 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:58.053788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d919b8-7b9b-4b38-839e-2e2de7fbd392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:58.054415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d919b8-7b9b-4b38-839e-2e2de7fbd392 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:58.054691 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d919b8-7b9b-4b38-839e-2e2de7fbd392 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:58.054966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d919b8-7b9b-4b38-839e-2e2de7fbd392 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:58.055688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d919b8-7b9b-4b38-839e-2e2de7fbd392 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:58.056001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d919b8-7b9b-4b38-839e-2e2de7fbd392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:58.057419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d919b8-7b9b-4b38-839e-2e2de7fbd392 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:58.065993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 594/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:58.072340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070c927-c24e-4604-87aa-21edcb21bc06 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:58.135961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:58.178924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070c927-c24e-4604-87aa-21edcb21bc06 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:58.213356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b83eb-f779-4ee8-af1d-0ba66dc20ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:58.214004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b83eb-f779-4ee8-af1d-0ba66dc20ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:58.214283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b83eb-f779-4ee8-af1d-0ba66dc20ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:58.214558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b83eb-f779-4ee8-af1d-0ba66dc20ce0 None admin] PATH_INFO: `/v3/users/f5da63160645428f882e287ce5aff631` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:58.227957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b83eb-f779-4ee8-af1d-0ba66dc20ce0 None admin] RBAC: Authorizing `identity:get_user(user_id=f5da63160645428f882e287ce5aff631)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:58.229492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b83eb-f779-4ee8-af1d-0ba66dc20ce0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:58.231194 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 588/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:02:58 2022] GET /identity/v3/users/f5da63160645428f882e287ce5aff631 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:58.238373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d919b8-7b9b-4b38-839e-2e2de7fbd392 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:58.270937 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:58.352022 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d919b8-7b9b-4b38-839e-2e2de7fbd392 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:58.391991 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4311bd-5235-4c72-85fc-2b4750edf8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:58.392620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4311bd-5235-4c72-85fc-2b4750edf8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:58.392931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4311bd-5235-4c72-85fc-2b4750edf8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:58.393206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4311bd-5235-4c72-85fc-2b4750edf8f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:58.467372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4311bd-5235-4c72-85fc-2b4750edf8f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:58.468751 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4311bd-5235-4c72-85fc-2b4750edf8f3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:58.494009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:58.574328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 595/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:02:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:02:58.580815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b83eb-f779-4ee8-af1d-0ba66dc20ce0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:58.696685 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b83eb-f779-4ee8-af1d-0ba66dc20ce0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:58.715725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:58.735343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a3bcf-e3e0-4a6b-b039-c2e0cf777402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:58.735994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a3bcf-e3e0-4a6b-b039-c2e0cf777402 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:58.736267 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a3bcf-e3e0-4a6b-b039-c2e0cf777402 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:58.736540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a3bcf-e3e0-4a6b-b039-c2e0cf777402 None admin] PATH_INFO: `/v3/projects/a3deaf62026d4011b25b21903512f6c0` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:58.737873 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a3bcf-e3e0-4a6b-b039-c2e0cf777402 None admin] RBAC: Authorizing `identity:get_project(project_id=a3deaf62026d4011b25b21903512f6c0)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:58.739316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a3bcf-e3e0-4a6b-b039-c2e0cf777402 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:58.741045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 589/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:02:58 2022] GET /identity/v3/projects/a3deaf62026d4011b25b21903512f6c0 => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:02:58.749800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4311bd-5235-4c72-85fc-2b4750edf8f3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:02:58.867535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4311bd-5235-4c72-85fc-2b4750edf8f3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:02:58.892749 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:02:58.905286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2fa03-5bbd-425d-8e84-751e6cedd547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:02:58.905914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2fa03-5bbd-425d-8e84-751e6cedd547 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:02:58.906264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2fa03-5bbd-425d-8e84-751e6cedd547 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:02:58.906541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2fa03-5bbd-425d-8e84-751e6cedd547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:02:58.907341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2fa03-5bbd-425d-8e84-751e6cedd547 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=a3deaf62026d4011b25b21903512f6c0, user.id=f5da63160645428f882e287ce5aff631) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:02:58.907653 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2fa03-5bbd-425d-8e84-751e6cedd547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:02:58.909109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2fa03-5bbd-425d-8e84-751e6cedd547 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:02:58.915237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 596/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:02:58 2022] GET /identity/v3/role_assignments?user.id=f5da63160645428f882e287ce5aff631&scope.project.id=a3deaf62026d4011b25b21903512f6c0&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:03:00.874734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2754a-93bd-4d06-aed3-666e6d403ae9 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:00.875330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2754a-93bd-4d06-aed3-666e6d403ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:00.875330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2754a-93bd-4d06-aed3-666e6d403ae9 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:00.877304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 590/1186] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:03:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:03:00.882677 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981e2e7-a755-4959-9fd1-6593e3505e24 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:00.883105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981e2e7-a755-4959-9fd1-6593e3505e24 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:00.883205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981e2e7-a755-4959-9fd1-6593e3505e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:00.902135 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5981e2e7-a755-4959-9fd1-6593e3505e24 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:03:00.903351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5981e2e7-a755-4959-9fd1-6593e3505e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:03:00.976491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 597/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:03:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:03:00.998462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2754a-93bd-4d06-aed3-666e6d403ae9 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:03:01.103960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2754a-93bd-4d06-aed3-666e6d403ae9 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:03:01.140226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf34b82-641a-4ce3-af47-26672b66ac46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:03:01.140793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf34b82-641a-4ce3-af47-26672b66ac46 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:01.141104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf34b82-641a-4ce3-af47-26672b66ac46 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:01.141380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf34b82-641a-4ce3-af47-26672b66ac46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:01.152193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf34b82-641a-4ce3-af47-26672b66ac46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-6cf34b82-641a-4ce3-af47-26672b66ac46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:03:01.157280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:03:01.158403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:03:01.159980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 591/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:03:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:03:01.165076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981e2e7-a755-4959-9fd1-6593e3505e24 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:03:01.265272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981e2e7-a755-4959-9fd1-6593e3505e24 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:03:01.283648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:03:01.302175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2cf63-413c-4e09-862d-bc71c4b7d21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:03:01.302796 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2cf63-413c-4e09-862d-bc71c4b7d21b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:01.303069 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2cf63-413c-4e09-862d-bc71c4b7d21b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:01.303337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2cf63-413c-4e09-862d-bc71c4b7d21b None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:01.304044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2cf63-413c-4e09-862d-bc71c4b7d21b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:03:01.304343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2cf63-413c-4e09-862d-bc71c4b7d21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:03:01.305734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2cf63-413c-4e09-862d-bc71c4b7d21b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:03:01.313797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 598/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:03:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:03:01.319967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf34b82-641a-4ce3-af47-26672b66ac46 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:03:01.369515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:03:01.425607 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf34b82-641a-4ce3-af47-26672b66ac46 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:03:01.460872 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ab769-64b6-4f6c-801c-fdbfe187d398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:03:01.461534 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ab769-64b6-4f6c-801c-fdbfe187d398 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:01.461815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ab769-64b6-4f6c-801c-fdbfe187d398 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:01.462082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ab769-64b6-4f6c-801c-fdbfe187d398 None admin] PATH_INFO: `/v3/users/f5da63160645428f882e287ce5aff631` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:01.463235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ab769-64b6-4f6c-801c-fdbfe187d398 None admin] RBAC: Authorizing `identity:get_user(user_id=f5da63160645428f882e287ce5aff631)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:03:01.464674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ab769-64b6-4f6c-801c-fdbfe187d398 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:03:01.466303 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 592/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:03:01 2022] GET /identity/v3/users/f5da63160645428f882e287ce5aff631 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:03:01.472467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2cf63-413c-4e09-862d-bc71c4b7d21b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:03:01.581667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2cf63-413c-4e09-862d-bc71c4b7d21b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:03:01.621312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7e62a-8471-463d-b5f7-ccd9b89bd971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:03:01.621952 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7e62a-8471-463d-b5f7-ccd9b89bd971 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:01.622233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7e62a-8471-463d-b5f7-ccd9b89bd971 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:01.622506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7e62a-8471-463d-b5f7-ccd9b89bd971 None admin] PATH_INFO: `/v3/projects/a3deaf62026d4011b25b21903512f6c0` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:01.623727 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7e62a-8471-463d-b5f7-ccd9b89bd971 None admin] RBAC: Authorizing `identity:get_project(project_id=a3deaf62026d4011b25b21903512f6c0)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:03:01.625341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7e62a-8471-463d-b5f7-ccd9b89bd971 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:03:01.627030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 599/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:03:01 2022] GET /identity/v3/projects/a3deaf62026d4011b25b21903512f6c0 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:03:01.633341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ab769-64b6-4f6c-801c-fdbfe187d398 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:03:01.739716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ab769-64b6-4f6c-801c-fdbfe187d398 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:03:01.752045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:03:01.774158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfdeca-d75c-4c2a-9251-8f4a62ffa48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:03:01.774970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfdeca-d75c-4c2a-9251-8f4a62ffa48d None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:01.775248 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfdeca-d75c-4c2a-9251-8f4a62ffa48d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:01.775520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfdeca-d75c-4c2a-9251-8f4a62ffa48d None admin] PATH_INFO: `/v3/projects/a3deaf62026d4011b25b21903512f6c0/users/f5da63160645428f882e287ce5aff631/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:01.777614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfdeca-d75c-4c2a-9251-8f4a62ffa48d None admin] RBAC: Authorizing `identity:create_grant(project_id=a3deaf62026d4011b25b21903512f6c0, user_id=f5da63160645428f882e287ce5aff631, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:03:01.779052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfdeca-d75c-4c2a-9251-8f4a62ffa48d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:03:01.793683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 593/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:03:01 2022] PUT /identity/v3/projects/a3deaf62026d4011b25b21903512f6c0/users/f5da63160645428f882e287ce5aff631/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:03:03.789954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbd5c4-c732-42ef-8e08-3918abcf305e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:03.790542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbd5c4-c732-42ef-8e08-3918abcf305e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:03.790542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbd5c4-c732-42ef-8e08-3918abcf305e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:03.791875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 600/1193] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:03:03.797358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06727104-f1a2-401d-b6f2-92af52ea28d6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:03.797769 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06727104-f1a2-401d-b6f2-92af52ea28d6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:03.797881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06727104-f1a2-401d-b6f2-92af52ea28d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:03.817509 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-06727104-f1a2-401d-b6f2-92af52ea28d6 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:03:03.818708 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-06727104-f1a2-401d-b6f2-92af52ea28d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:03:03.888510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 594/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:03:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:03:03.912175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbd5c4-c732-42ef-8e08-3918abcf305e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:03:03.966120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:03:04.019594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbd5c4-c732-42ef-8e08-3918abcf305e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:03:04.054967 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d07a3-5e78-406f-a351-0dac74dbcb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:03:04.055505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d07a3-5e78-406f-a351-0dac74dbcb4c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:04.055781 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d07a3-5e78-406f-a351-0dac74dbcb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:04.056055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d07a3-5e78-406f-a351-0dac74dbcb4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:04.066755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d07a3-5e78-406f-a351-0dac74dbcb4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-794d07a3-5e78-406f-a351-0dac74dbcb4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:03:04.071610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:03:04.072674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:03:04.073573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 601/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:03:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:03:04.079266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06727104-f1a2-401d-b6f2-92af52ea28d6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:03:04.182858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06727104-f1a2-401d-b6f2-92af52ea28d6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:03:04.184373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:03:04.218887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8ba9-241c-4492-94a8-50bfd4facdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:03:04.219499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8ba9-241c-4492-94a8-50bfd4facdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:04.219780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8ba9-241c-4492-94a8-50bfd4facdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:04.220055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8ba9-241c-4492-94a8-50bfd4facdf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:04.220762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd8ba9-241c-4492-94a8-50bfd4facdf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:03:04.221105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd8ba9-241c-4492-94a8-50bfd4facdf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:03:04.222480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd8ba9-241c-4492-94a8-50bfd4facdf9 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:03:04.230495 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 595/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:03:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:03:04.236637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d07a3-5e78-406f-a351-0dac74dbcb4c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:03:04.344120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d07a3-5e78-406f-a351-0dac74dbcb4c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:03:04.355137 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:03:04.382752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3a1b9-444d-4e2e-889d-1864981cc166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:03:04.383391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3a1b9-444d-4e2e-889d-1864981cc166 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:04.383666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3a1b9-444d-4e2e-889d-1864981cc166 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:04.383934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3a1b9-444d-4e2e-889d-1864981cc166 None admin] PATH_INFO: `/v3/users/f5da63160645428f882e287ce5aff631` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:04.385124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3a1b9-444d-4e2e-889d-1864981cc166 None admin] RBAC: Authorizing `identity:get_user(user_id=f5da63160645428f882e287ce5aff631)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:03:04.386548 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3a1b9-444d-4e2e-889d-1864981cc166 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:03:04.388189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 602/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Aug 5 07:03:04 2022] GET /identity/v3/users/f5da63160645428f882e287ce5aff631 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:03:04.394455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8ba9-241c-4492-94a8-50bfd4facdf9 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:03:04.498998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8ba9-241c-4492-94a8-50bfd4facdf9 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:03:04.533833 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c49ba-d6fc-4e8e-a622-d8d625e69b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:03:04.534440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c49ba-d6fc-4e8e-a622-d8d625e69b30 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:04.535032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c49ba-d6fc-4e8e-a622-d8d625e69b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:04.535300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c49ba-d6fc-4e8e-a622-d8d625e69b30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:04.567300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:03:04.604940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c49ba-d6fc-4e8e-a622-d8d625e69b30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:03:04.606309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c49ba-d6fc-4e8e-a622-d8d625e69b30 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:03:04.714304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 596/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:03:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:03:04.721124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3a1b9-444d-4e2e-889d-1864981cc166 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:03:04.838061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3a1b9-444d-4e2e-889d-1864981cc166 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:03:04.875355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861ee42-480e-4695-9038-3b1c38bec243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:03:04.875916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861ee42-480e-4695-9038-3b1c38bec243 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:04.876190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861ee42-480e-4695-9038-3b1c38bec243 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:04.876462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861ee42-480e-4695-9038-3b1c38bec243 None admin] PATH_INFO: `/v3/projects/a3deaf62026d4011b25b21903512f6c0` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:04.877655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861ee42-480e-4695-9038-3b1c38bec243 None admin] RBAC: Authorizing `identity:get_project(project_id=a3deaf62026d4011b25b21903512f6c0)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:03:04.879087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861ee42-480e-4695-9038-3b1c38bec243 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:03:04.880777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 603/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Aug 5 07:03:04 2022] GET /identity/v3/projects/a3deaf62026d4011b25b21903512f6c0 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:03:04.888010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c49ba-d6fc-4e8e-a622-d8d625e69b30 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:03:04.959497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:03:05.000931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c49ba-d6fc-4e8e-a622-d8d625e69b30 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:03:05.038169 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b38dd8-5dac-4173-b466-2786dc31dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:03:05.038783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38dd8-5dac-4173-b466-2786dc31dd89 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:03:05.039063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38dd8-5dac-4173-b466-2786dc31dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:03:05.039334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b38dd8-5dac-4173-b466-2786dc31dd89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:03:05.040128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b38dd8-5dac-4173-b466-2786dc31dd89 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=a3deaf62026d4011b25b21903512f6c0, user.id=f5da63160645428f882e287ce5aff631) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:03:05.040439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b38dd8-5dac-4173-b466-2786dc31dd89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:03:05.041896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b38dd8-5dac-4173-b466-2786dc31dd89 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:03:05.048537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 597/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:03:04 2022] GET /identity/v3/role_assignments?user.id=f5da63160645428f882e287ce5aff631&scope.project.id=a3deaf62026d4011b25b21903512f6c0&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:03:14.870879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=78 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:03:15.045198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=36 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:01.008473 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba0a35-31c1-4e2b-81ed-74e7170d2dad None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:01.009126 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba0a35-31c1-4e2b-81ed-74e7170d2dad None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:01.009126 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba0a35-31c1-4e2b-81ed-74e7170d2dad None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:01.010434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 604/1201] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:04:01.017647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2cd50-0a22-4ec6-895c-dbe3985bc4d3 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:01.018158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2cd50-0a22-4ec6-895c-dbe3985bc4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:01.018654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2cd50-0a22-4ec6-895c-dbe3985bc4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:01.042023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a9c2cd50-0a22-4ec6-895c-dbe3985bc4d3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:04:01.043302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a9c2cd50-0a22-4ec6-895c-dbe3985bc4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:04:01.131721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 598/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:04:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:04:01.157989 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba0a35-31c1-4e2b-81ed-74e7170d2dad None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:01.303055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba0a35-31c1-4e2b-81ed-74e7170d2dad None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:01.351358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3b53-60d9-41c6-98de-879fab3bed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:01.352066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3b53-60d9-41c6-98de-879fab3bed88 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:01.352346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3b53-60d9-41c6-98de-879fab3bed88 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:01.352616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3b53-60d9-41c6-98de-879fab3bed88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:01.366969 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb3b53-60d9-41c6-98de-879fab3bed88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:01.368568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb3b53-60d9-41c6-98de-879fab3bed88 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2bfb3b53-60d9-41c6-98de-879fab3bed88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:01.392270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:01.393478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:01.398077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:01.398077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:01.398077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:01.398077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:01.398077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 605/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:04:01.400174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2cd50-0a22-4ec6-895c-dbe3985bc4d3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:01.558572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2cd50-0a22-4ec6-895c-dbe3985bc4d3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:01.595041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:01.602713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d0210-9471-490d-9a22-069e6a9284f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:01.603349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d0210-9471-490d-9a22-069e6a9284f2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:01.603666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d0210-9471-490d-9a22-069e6a9284f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:01.604077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d0210-9471-490d-9a22-069e6a9284f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:01.604988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d0210-9471-490d-9a22-069e6a9284f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:01.605322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d0210-9471-490d-9a22-069e6a9284f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:01.607377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d0210-9471-490d-9a22-069e6a9284f2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:01.622844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 599/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:01.629496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3b53-60d9-41c6-98de-879fab3bed88 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:01.707257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:01.781726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3b53-60d9-41c6-98de-879fab3bed88 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:01.863247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043385e8-8896-4b48-94bd-6e092c75a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:01.864341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043385e8-8896-4b48-94bd-6e092c75a9c8 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:01.864818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043385e8-8896-4b48-94bd-6e092c75a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:01.865354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043385e8-8896-4b48-94bd-6e092c75a9c8 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:01.866626 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043385e8-8896-4b48-94bd-6e092c75a9c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:01.869318 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043385e8-8896-4b48-94bd-6e092c75a9c8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:01.924927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 606/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Aug 5 07:04:01 2022] POST /identity/v3/users => generated 251 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:04:04.139563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc366f8b-8602-4ad9-9c3e-0463a185fbb5 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:04.140102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc366f8b-8602-4ad9-9c3e-0463a185fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:04.140473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc366f8b-8602-4ad9-9c3e-0463a185fbb5 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:04.143492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 600/1206] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:04:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:04:04.153143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae8a8-13f8-4e7d-8a2b-b4f4990dce05 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:04.153932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae8a8-13f8-4e7d-8a2b-b4f4990dce05 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:04.153932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae8a8-13f8-4e7d-8a2b-b4f4990dce05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:04.174700 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-92eae8a8-13f8-4e7d-8a2b-b4f4990dce05 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:04:04.176011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-92eae8a8-13f8-4e7d-8a2b-b4f4990dce05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:04:04.259026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 607/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:04:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:04:04.285239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc366f8b-8602-4ad9-9c3e-0463a185fbb5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:04.419886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc366f8b-8602-4ad9-9c3e-0463a185fbb5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:04.485081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064a04b-df8f-4cde-82aa-c40d09c871c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:04.485794 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064a04b-df8f-4cde-82aa-c40d09c871c7 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:04.486069 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064a04b-df8f-4cde-82aa-c40d09c871c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:04.486349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064a04b-df8f-4cde-82aa-c40d09c871c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:04.499657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064a04b-df8f-4cde-82aa-c40d09c871c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0064a04b-df8f-4cde-82aa-c40d09c871c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:04:04.507860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:04.508932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:04.509862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:04.509862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:04.509862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:04.509862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:04.509862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:04:04.509862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:04:04.509862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:04:04.509862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:04:04.509862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:04:04.509862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:04:04.509862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:04:04.509862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:04.513067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 601/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:04:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:04.516921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eae8a8-13f8-4e7d-8a2b-b4f4990dce05 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:04.563865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:04.637027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eae8a8-13f8-4e7d-8a2b-b4f4990dce05 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:04.678819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3e67a-152f-4a0a-95b5-7c13cd6343e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:04.679448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3e67a-152f-4a0a-95b5-7c13cd6343e7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:04.679770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3e67a-152f-4a0a-95b5-7c13cd6343e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:04.679905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3e67a-152f-4a0a-95b5-7c13cd6343e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:04.680641 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3e67a-152f-4a0a-95b5-7c13cd6343e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:04.680992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3e67a-152f-4a0a-95b5-7c13cd6343e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:04.682361 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3e67a-152f-4a0a-95b5-7c13cd6343e7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:04.691769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 608/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:04:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:04.697854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064a04b-df8f-4cde-82aa-c40d09c871c7 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:04.757683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:04.820349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064a04b-df8f-4cde-82aa-c40d09c871c7 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:04.869753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6135d4-f3d7-44d0-93ff-ce3313dcb7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:04.870452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6135d4-f3d7-44d0-93ff-ce3313dcb7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:04.870791 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6135d4-f3d7-44d0-93ff-ce3313dcb7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:04.870988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6135d4-f3d7-44d0-93ff-ce3313dcb7a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:04.883756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6135d4-f3d7-44d0-93ff-ce3313dcb7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:04.885191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6135d4-f3d7-44d0-93ff-ce3313dcb7a0 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0e6135d4-f3d7-44d0-93ff-ce3313dcb7a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:04.903336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:04.904739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:04.905705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:04.905705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:04.905705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:04.905705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:04.908055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 602/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:04.915154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3e67a-152f-4a0a-95b5-7c13cd6343e7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:05.043238 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:05.048752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3e67a-152f-4a0a-95b5-7c13cd6343e7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:05.095966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d172136-8444-46b6-a937-4d0f2dea2587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:05.096610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d172136-8444-46b6-a937-4d0f2dea2587 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:05.096922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d172136-8444-46b6-a937-4d0f2dea2587 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:05.097201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d172136-8444-46b6-a937-4d0f2dea2587 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:05.097915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d172136-8444-46b6-a937-4d0f2dea2587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:05.098231 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d172136-8444-46b6-a937-4d0f2dea2587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:05.099677 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d172136-8444-46b6-a937-4d0f2dea2587 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:05.116611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 609/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:05.134314 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6135d4-f3d7-44d0-93ff-ce3313dcb7a0 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:05.253044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6135d4-f3d7-44d0-93ff-ce3313dcb7a0 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:05.255001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:05.296225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa026fb-add3-4879-8d4b-b2511d08983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:05.296888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa026fb-add3-4879-8d4b-b2511d08983e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:05.297191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa026fb-add3-4879-8d4b-b2511d08983e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:05.297463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa026fb-add3-4879-8d4b-b2511d08983e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:05.306508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa026fb-add3-4879-8d4b-b2511d08983e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:05.308041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa026fb-add3-4879-8d4b-b2511d08983e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-caa026fb-add3-4879-8d4b-b2511d08983e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:04:05.320657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:05.325212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:05.326446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:05.326446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:05.326446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:04:05.326446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:04:05.326446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:04:05.326446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:04:05.326446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:04:05.326446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:04:05.326446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 07:04:05.326446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:05.326446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 603/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:05.328774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d172136-8444-46b6-a937-4d0f2dea2587 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:05.448099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d172136-8444-46b6-a937-4d0f2dea2587 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:05.485766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d76f5-7db1-4ab0-8860-d320e2ed2eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:05.486394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d76f5-7db1-4ab0-8860-d320e2ed2eff None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:05.486673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d76f5-7db1-4ab0-8860-d320e2ed2eff None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:05.486944 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d76f5-7db1-4ab0-8860-d320e2ed2eff None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:05.487739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d76f5-7db1-4ab0-8860-d320e2ed2eff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:05.488041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d76f5-7db1-4ab0-8860-d320e2ed2eff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:05.489644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d76f5-7db1-4ab0-8860-d320e2ed2eff None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:05.509758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 610/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 5 07:04:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:05.516496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa026fb-add3-4879-8d4b-b2511d08983e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:05.648644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa026fb-add3-4879-8d4b-b2511d08983e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:05.688807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912962c-0813-4d5a-9cd5-ff688b861862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:05.689746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912962c-0813-4d5a-9cd5-ff688b861862 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:05.690293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912962c-0813-4d5a-9cd5-ff688b861862 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:05.690797 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912962c-0813-4d5a-9cd5-ff688b861862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:05.731034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:05.772284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912962c-0813-4d5a-9cd5-ff688b861862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:05.773926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912962c-0813-4d5a-9cd5-ff688b861862 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:05.898200 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 604/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:04:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:04:05.905325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d76f5-7db1-4ab0-8860-d320e2ed2eff None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:05.930182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:06.040406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d76f5-7db1-4ab0-8860-d320e2ed2eff None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:06.083271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc117219-2754-4ff0-98a5-0d8965b025e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:06.084114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc117219-2754-4ff0-98a5-0d8965b025e1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:06.084398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc117219-2754-4ff0-98a5-0d8965b025e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:06.084782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc117219-2754-4ff0-98a5-0d8965b025e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:06.099203 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc117219-2754-4ff0-98a5-0d8965b025e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:06.101707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc117219-2754-4ff0-98a5-0d8965b025e1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-bc117219-2754-4ff0-98a5-0d8965b025e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:06.118544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:06.119898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:06.120815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:06.120815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:06.120815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:06.120815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:06.120815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 611/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:06.125905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912962c-0813-4d5a-9cd5-ff688b861862 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:06.212050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:06.279944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912962c-0813-4d5a-9cd5-ff688b861862 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:06.331854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835eca5-b27d-4095-85b2-548a9902acaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:06.332751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835eca5-b27d-4095-85b2-548a9902acaf None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:06.333173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835eca5-b27d-4095-85b2-548a9902acaf None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:06.333553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835eca5-b27d-4095-85b2-548a9902acaf None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:06.334578 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835eca5-b27d-4095-85b2-548a9902acaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:06.335014 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835eca5-b27d-4095-85b2-548a9902acaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:06.337254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835eca5-b27d-4095-85b2-548a9902acaf None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:06.356490 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 605/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:04:06.362274 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc117219-2754-4ff0-98a5-0d8965b025e1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:06.477080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:06.553246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc117219-2754-4ff0-98a5-0d8965b025e1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:06.615609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a5ab3-1908-4913-a503-1a9ad53c385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:06.616979 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a5ab3-1908-4913-a503-1a9ad53c385a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:06.617340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a5ab3-1908-4913-a503-1a9ad53c385a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:06.617838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a5ab3-1908-4913-a503-1a9ad53c385a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:06.630324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a5ab3-1908-4913-a503-1a9ad53c385a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:06.633226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a5ab3-1908-4913-a503-1a9ad53c385a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-039a5ab3-1908-4913-a503-1a9ad53c385a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:04:06.659323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:06.661427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:06.662765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:04:06.662765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:04:06.662765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:04:06.662765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:04:06.662765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:04:06.662765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:04:06.662765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:04:06.662765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:06.662765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 612/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:06.668666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835eca5-b27d-4095-85b2-548a9902acaf None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:06.842426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835eca5-b27d-4095-85b2-548a9902acaf None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:06.873186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:06.888154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e1ba4-fbd2-41ea-8f2d-3bf5bbb5bad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:06.889105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e1ba4-fbd2-41ea-8f2d-3bf5bbb5bad2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:06.889549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e1ba4-fbd2-41ea-8f2d-3bf5bbb5bad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:06.889905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e1ba4-fbd2-41ea-8f2d-3bf5bbb5bad2 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:06.890867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e1ba4-fbd2-41ea-8f2d-3bf5bbb5bad2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:06.891256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e1ba4-fbd2-41ea-8f2d-3bf5bbb5bad2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:06.892823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e1ba4-fbd2-41ea-8f2d-3bf5bbb5bad2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:06.913157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 606/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:06.915625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a5ab3-1908-4913-a503-1a9ad53c385a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:07.055204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a5ab3-1908-4913-a503-1a9ad53c385a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:07.095923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:07.103664 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a024fa6-5d58-4578-b5c5-180891ad0838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:07.104511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a024fa6-5d58-4578-b5c5-180891ad0838 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:07.104796 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a024fa6-5d58-4578-b5c5-180891ad0838 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:07.105139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a024fa6-5d58-4578-b5c5-180891ad0838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:07.106260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a024fa6-5d58-4578-b5c5-180891ad0838 None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=33213d31b1394cdfb5b447f4f4952b53) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:07.106569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a024fa6-5d58-4578-b5c5-180891ad0838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:07.108051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a024fa6-5d58-4578-b5c5-180891ad0838 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:07.115246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 613/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:04:06 2022] GET /identity/v3/role_assignments?user.id=33213d31b1394cdfb5b447f4f4952b53&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:09.263123 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fd959-666f-4d09-8f1d-55d9a1860b7d None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:09.263839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fd959-666f-4d09-8f1d-55d9a1860b7d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:09.263839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fd959-666f-4d09-8f1d-55d9a1860b7d None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:09.265460 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 607/1220] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:04:09.271585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2e0a4-e10d-4de9-9058-7f431486bf0b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:09.272369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2e0a4-e10d-4de9-9058-7f431486bf0b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:09.272369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2e0a4-e10d-4de9-9058-7f431486bf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:09.297625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bef2e0a4-e10d-4de9-9058-7f431486bf0b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:04:09.298981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bef2e0a4-e10d-4de9-9058-7f431486bf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:04:09.388645 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 614/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:04:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:04:09.418159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fd959-666f-4d09-8f1d-55d9a1860b7d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:09.546362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fd959-666f-4d09-8f1d-55d9a1860b7d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:09.594840 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ae391-dec1-421c-b8e4-75e0615b5ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:09.595177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ae391-dec1-421c-b8e4-75e0615b5ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:09.595862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ae391-dec1-421c-b8e4-75e0615b5ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:09.595862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ae391-dec1-421c-b8e4-75e0615b5ec5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:09.607188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ae391-dec1-421c-b8e4-75e0615b5ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-881ae391-dec1-421c-b8e4-75e0615b5ec5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:04:09.612430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:09.613816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:09.614741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 608/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:04:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:09.620703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2e0a4-e10d-4de9-9058-7f431486bf0b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:09.758411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2e0a4-e10d-4de9-9058-7f431486bf0b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:09.789075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:09.801141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407938b-efbc-4975-82c2-85b09a63aeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:09.801507 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407938b-efbc-4975-82c2-85b09a63aeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:09.801789 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407938b-efbc-4975-82c2-85b09a63aeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:09.802065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407938b-efbc-4975-82c2-85b09a63aeb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:09.802813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407938b-efbc-4975-82c2-85b09a63aeb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:09.803191 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407938b-efbc-4975-82c2-85b09a63aeb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:09.804590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407938b-efbc-4975-82c2-85b09a63aeb2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:09.813633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 615/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:04:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:09.820331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ae391-dec1-421c-b8e4-75e0615b5ec5 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:09.874570 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:09.961109 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ae391-dec1-421c-b8e4-75e0615b5ec5 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:10.001063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee209af-c3da-4826-b698-736440039bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:10.001746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee209af-c3da-4826-b698-736440039bbe None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:10.002002 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee209af-c3da-4826-b698-736440039bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:10.002278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee209af-c3da-4826-b698-736440039bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:10.013729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee209af-c3da-4826-b698-736440039bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:10.015334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee209af-c3da-4826-b698-736440039bbe None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-6ee209af-c3da-4826-b698-736440039bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:10.033039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:10.034182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:10.035265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:10.035265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:10.035265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:10.035265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:10.035265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 609/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:10.041880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407938b-efbc-4975-82c2-85b09a63aeb2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:10.159382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407938b-efbc-4975-82c2-85b09a63aeb2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:10.199217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020755b-9b4e-4c64-ac4a-2f4224c2f099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:10.199891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020755b-9b4e-4c64-ac4a-2f4224c2f099 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:10.200206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020755b-9b4e-4c64-ac4a-2f4224c2f099 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:10.200589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020755b-9b4e-4c64-ac4a-2f4224c2f099 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:10.201354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020755b-9b4e-4c64-ac4a-2f4224c2f099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:10.201691 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020755b-9b4e-4c64-ac4a-2f4224c2f099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:10.203223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020755b-9b4e-4c64-ac4a-2f4224c2f099 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:10.223709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 616/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:10.231811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee209af-c3da-4826-b698-736440039bbe None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:10.355625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:10.370106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee209af-c3da-4826-b698-736440039bbe None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:10.420428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7a680-918f-4e17-9c5c-5afe4ae29c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:10.421157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7a680-918f-4e17-9c5c-5afe4ae29c9d None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:10.421482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7a680-918f-4e17-9c5c-5afe4ae29c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:10.421754 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7a680-918f-4e17-9c5c-5afe4ae29c9d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:10.430915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7a680-918f-4e17-9c5c-5afe4ae29c9d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:10.432438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7a680-918f-4e17-9c5c-5afe4ae29c9d None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-31c7a680-918f-4e17-9c5c-5afe4ae29c9d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:04:10.445531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:10.447366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:10.448478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:10.448478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:10.448478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:04:10.448478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:04:10.448478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:04:10.448478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:04:10.448478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:04:10.448478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:04:10.448478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 07:04:10.448478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:10.448478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 610/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:10.453163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020755b-9b4e-4c64-ac4a-2f4224c2f099 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:10.510343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:10.576956 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020755b-9b4e-4c64-ac4a-2f4224c2f099 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:10.614595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc70a7-89f0-4c98-9046-f8ba3045f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:10.615235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc70a7-89f0-4c98-9046-f8ba3045f502 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:10.615517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc70a7-89f0-4c98-9046-f8ba3045f502 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:10.615784 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc70a7-89f0-4c98-9046-f8ba3045f502 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:10.616586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc70a7-89f0-4c98-9046-f8ba3045f502 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:10.616888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc70a7-89f0-4c98-9046-f8ba3045f502 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:10.618349 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc70a7-89f0-4c98-9046-f8ba3045f502 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:10.638493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 617/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 5 07:04:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:04:10.644476 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7a680-918f-4e17-9c5c-5afe4ae29c9d None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:10.765965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7a680-918f-4e17-9c5c-5afe4ae29c9d None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:10.801710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b05bf3-255d-4502-97c1-3ddb6f40e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:10.802363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b05bf3-255d-4502-97c1-3ddb6f40e0db None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:10.802640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b05bf3-255d-4502-97c1-3ddb6f40e0db None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:10.802916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b05bf3-255d-4502-97c1-3ddb6f40e0db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:10.813981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b05bf3-255d-4502-97c1-3ddb6f40e0db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:10.815470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b05bf3-255d-4502-97c1-3ddb6f40e0db None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-83b05bf3-255d-4502-97c1-3ddb6f40e0db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:10.830740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:10.831875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:10.833257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:10.833257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:10.833257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:10.833257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:10.833257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 611/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:10.838244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc70a7-89f0-4c98-9046-f8ba3045f502 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:10.958051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc70a7-89f0-4c98-9046-f8ba3045f502 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:10.960391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:11.016130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff28ed-10d8-4e74-89b4-ee581256eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:11.017108 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff28ed-10d8-4e74-89b4-ee581256eb68 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:11.017513 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff28ed-10d8-4e74-89b4-ee581256eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:11.017826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff28ed-10d8-4e74-89b4-ee581256eb68 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:11.018569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff28ed-10d8-4e74-89b4-ee581256eb68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:11.018987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff28ed-10d8-4e74-89b4-ee581256eb68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:11.020558 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff28ed-10d8-4e74-89b4-ee581256eb68 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:11.042183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 618/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:11.044074 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b05bf3-255d-4502-97c1-3ddb6f40e0db None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:11.055659 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:11.152509 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b05bf3-255d-4502-97c1-3ddb6f40e0db None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:11.188445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b628408-170f-46ff-be09-5561a219b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:11.189114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628408-170f-46ff-be09-5561a219b5ed None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:11.189356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628408-170f-46ff-be09-5561a219b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:11.189629 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628408-170f-46ff-be09-5561a219b5ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:11.196704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b628408-170f-46ff-be09-5561a219b5ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:11.198602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b628408-170f-46ff-be09-5561a219b5ed None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-5b628408-170f-46ff-be09-5561a219b5ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:04:11.214732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:11.215903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:11.216938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:04:11.216938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:04:11.216938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:04:11.216938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:04:11.216938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:04:11.216938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:04:11.216938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:04:11.216938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:11.216938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 612/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:11.222360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff28ed-10d8-4e74-89b4-ee581256eb68 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:11.343321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff28ed-10d8-4e74-89b4-ee581256eb68 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:11.387786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edfcca-0acf-444b-b5c1-70adfda239b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:11.388429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edfcca-0acf-444b-b5c1-70adfda239b7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:11.388703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edfcca-0acf-444b-b5c1-70adfda239b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:11.389004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edfcca-0acf-444b-b5c1-70adfda239b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:11.389762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edfcca-0acf-444b-b5c1-70adfda239b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:11.390061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edfcca-0acf-444b-b5c1-70adfda239b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:11.391498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edfcca-0acf-444b-b5c1-70adfda239b7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:11.404948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 619/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:04:11.412422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b628408-170f-46ff-be09-5561a219b5ed None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:11.503614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:11.544862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b628408-170f-46ff-be09-5561a219b5ed None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:11.582800 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe2b93-036b-4e69-ba10-6647a8d17ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:11.583528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe2b93-036b-4e69-ba10-6647a8d17ed8 None admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:11.583808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe2b93-036b-4e69-ba10-6647a8d17ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:11.584087 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe2b93-036b-4e69-ba10-6647a8d17ed8 None admin] PATH_INFO: `/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/33213d31b1394cdfb5b447f4f4952b53/roles/58b981aa32454837bd8eae9e804d811e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:11.599829 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe2b93-036b-4e69-ba10-6647a8d17ed8 None admin] RBAC: Authorizing `identity:create_grant(project_id=29b560f1bcf347f6b8b885cc02d52e33, user_id=33213d31b1394cdfb5b447f4f4952b53, role_id=58b981aa32454837bd8eae9e804d811e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:11.601322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe2b93-036b-4e69-ba10-6647a8d17ed8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:11.615082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 613/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:04:11 2022] PUT /identity/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/33213d31b1394cdfb5b447f4f4952b53/roles/58b981aa32454837bd8eae9e804d811e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:04:13.734943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525b47-0b78-473f-87f7-41107df72c0c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:13.735553 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525b47-0b78-473f-87f7-41107df72c0c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:13.735553 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525b47-0b78-473f-87f7-41107df72c0c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:13.736970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 620/1233] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:04:13.743154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d5e57-d26b-41ae-88e4-ca41a0365fe8 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:13.743625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d5e57-d26b-41ae-88e4-ca41a0365fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:13.743734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d5e57-d26b-41ae-88e4-ca41a0365fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:13.766913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e65d5e57-d26b-41ae-88e4-ca41a0365fe8 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:04:13.768327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e65d5e57-d26b-41ae-88e4-ca41a0365fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:04:13.858656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 614/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:04:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:04:13.884829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb525b47-0b78-473f-87f7-41107df72c0c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:13.921801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:14.021914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb525b47-0b78-473f-87f7-41107df72c0c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:14.061550 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c1a18-9471-4229-b0fa-684f2e25ba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:14.062201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c1a18-9471-4229-b0fa-684f2e25ba2a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:14.062476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c1a18-9471-4229-b0fa-684f2e25ba2a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:14.062742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c1a18-9471-4229-b0fa-684f2e25ba2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:14.075871 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c1a18-9471-4229-b0fa-684f2e25ba2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9e4c1a18-9471-4229-b0fa-684f2e25ba2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:04:14.080984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:14.082261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:14.083263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 621/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Aug 5 07:04:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:14.088676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d5e57-d26b-41ae-88e4-ca41a0365fe8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:14.141026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:14.200880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d5e57-d26b-41ae-88e4-ca41a0365fe8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:14.239556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2079-8cb5-44d7-aabd-dd92b0b1bba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:14.240266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2079-8cb5-44d7-aabd-dd92b0b1bba4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:14.240540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2079-8cb5-44d7-aabd-dd92b0b1bba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:14.241003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c2079-8cb5-44d7-aabd-dd92b0b1bba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:14.241816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c2079-8cb5-44d7-aabd-dd92b0b1bba4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:14.242222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c2079-8cb5-44d7-aabd-dd92b0b1bba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:14.243783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c2079-8cb5-44d7-aabd-dd92b0b1bba4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:14.254037 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 615/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Aug 5 07:04:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:14.260023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c1a18-9471-4229-b0fa-684f2e25ba2a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:14.358354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:14.381994 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c1a18-9471-4229-b0fa-684f2e25ba2a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:14.433981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3bf94-6c90-421e-b612-17426f06e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:14.434618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3bf94-6c90-421e-b612-17426f06e878 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:14.434900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3bf94-6c90-421e-b612-17426f06e878 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:14.435176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3bf94-6c90-421e-b612-17426f06e878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:14.445745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3bf94-6c90-421e-b612-17426f06e878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:14.447211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3bf94-6c90-421e-b612-17426f06e878 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d3e3bf94-6c90-421e-b612-17426f06e878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:14.463947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:14.465244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:14.466330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:14.466330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:14.466330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:14.466330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:14.466330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 622/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:14.471421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2079-8cb5-44d7-aabd-dd92b0b1bba4 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:14.582147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c2079-8cb5-44d7-aabd-dd92b0b1bba4 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:14.591266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:14.617989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ff7ce-d176-49a9-9c73-16918e8315a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:14.618613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ff7ce-d176-49a9-9c73-16918e8315a6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:14.618897 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ff7ce-d176-49a9-9c73-16918e8315a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:14.619186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ff7ce-d176-49a9-9c73-16918e8315a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:14.619916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ff7ce-d176-49a9-9c73-16918e8315a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:14.620265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ff7ce-d176-49a9-9c73-16918e8315a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:14.621818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ff7ce-d176-49a9-9c73-16918e8315a6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:14.634644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 616/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:14.641109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3bf94-6c90-421e-b612-17426f06e878 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:14.751733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3bf94-6c90-421e-b612-17426f06e878 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:14.787140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728b23d-5ab6-434d-8ae4-44f5fec6e423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:14.787791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728b23d-5ab6-434d-8ae4-44f5fec6e423 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:14.788070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728b23d-5ab6-434d-8ae4-44f5fec6e423 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:14.788351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728b23d-5ab6-434d-8ae4-44f5fec6e423 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:14.792975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:14.798901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728b23d-5ab6-434d-8ae4-44f5fec6e423 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:14.800528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e728b23d-5ab6-434d-8ae4-44f5fec6e423 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e728b23d-5ab6-434d-8ae4-44f5fec6e423 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:04:14.812153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:14.813339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:14.814560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:14.814560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:14.814560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:04:14.814560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:04:14.814560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:04:14.814560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:04:14.814560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:04:14.814560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:04:14.814560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 07:04:14.814560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:14.817082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 623/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:04:14.819198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ff7ce-d176-49a9-9c73-16918e8315a6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:14.934389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ff7ce-d176-49a9-9c73-16918e8315a6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:14.971355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81018b5c-f6ab-459b-a796-ff4a33bf9737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:14.972010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81018b5c-f6ab-459b-a796-ff4a33bf9737 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:14.972345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81018b5c-f6ab-459b-a796-ff4a33bf9737 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:14.972621 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81018b5c-f6ab-459b-a796-ff4a33bf9737 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:14.973538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81018b5c-f6ab-459b-a796-ff4a33bf9737 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:14.973851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81018b5c-f6ab-459b-a796-ff4a33bf9737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:14.975371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81018b5c-f6ab-459b-a796-ff4a33bf9737 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:14.994307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 617/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 5 07:04:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:15.000342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728b23d-5ab6-434d-8ae4-44f5fec6e423 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:15.114537 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728b23d-5ab6-434d-8ae4-44f5fec6e423 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:15.156757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429990f-2af5-4f74-ba81-768271159404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:15.157589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429990f-2af5-4f74-ba81-768271159404 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:15.157963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429990f-2af5-4f74-ba81-768271159404 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:15.158335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429990f-2af5-4f74-ba81-768271159404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:15.232303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:15.239843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429990f-2af5-4f74-ba81-768271159404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:15.241428 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429990f-2af5-4f74-ba81-768271159404 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:15.359359 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 624/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:04:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:04:15.365682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81018b5c-f6ab-459b-a796-ff4a33bf9737 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:15.395764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:15.475398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81018b5c-f6ab-459b-a796-ff4a33bf9737 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:15.514415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca89f56-32e0-4a74-a644-5656f4b5d431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:15.514999 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89f56-32e0-4a74-a644-5656f4b5d431 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:15.515275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89f56-32e0-4a74-a644-5656f4b5d431 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:15.515549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89f56-32e0-4a74-a644-5656f4b5d431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:15.526514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca89f56-32e0-4a74-a644-5656f4b5d431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:15.528013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca89f56-32e0-4a74-a644-5656f4b5d431 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-0ca89f56-32e0-4a74-a644-5656f4b5d431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:15.546224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:15.547355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:15.548573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:15.548573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:15.548573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:15.548573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:15.552753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 618/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:15.553773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429990f-2af5-4f74-ba81-768271159404 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:15.666516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:15.673533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429990f-2af5-4f74-ba81-768271159404 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:15.709622 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f98641-e06a-43b8-9a9d-6a3d2d4e12da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:15.710355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f98641-e06a-43b8-9a9d-6a3d2d4e12da None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:15.710642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f98641-e06a-43b8-9a9d-6a3d2d4e12da None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:15.710936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f98641-e06a-43b8-9a9d-6a3d2d4e12da None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:15.711765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f98641-e06a-43b8-9a9d-6a3d2d4e12da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:15.712077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f98641-e06a-43b8-9a9d-6a3d2d4e12da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:15.713678 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f98641-e06a-43b8-9a9d-6a3d2d4e12da None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:15.726580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 625/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:04:15.733441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca89f56-32e0-4a74-a644-5656f4b5d431 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:15.828372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:15.854896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca89f56-32e0-4a74-a644-5656f4b5d431 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:15.894637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eca954-2f3f-47a4-bd0b-446e85e5a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:15.895412 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eca954-2f3f-47a4-bd0b-446e85e5a235 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:15.895745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eca954-2f3f-47a4-bd0b-446e85e5a235 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:15.896130 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eca954-2f3f-47a4-bd0b-446e85e5a235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:15.905387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eca954-2f3f-47a4-bd0b-446e85e5a235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:15.907546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eca954-2f3f-47a4-bd0b-446e85e5a235 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-e0eca954-2f3f-47a4-bd0b-446e85e5a235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:04:15.924196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:15.925350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:15.926406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:04:15.926406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:04:15.926406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:04:15.926406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:04:15.926406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:04:15.926406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:04:15.926406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:04:15.926406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:15.926406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 619/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:04:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:15.933902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f98641-e06a-43b8-9a9d-6a3d2d4e12da None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:16.049254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f98641-e06a-43b8-9a9d-6a3d2d4e12da None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:16.092702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92907a9d-5c59-4921-bccc-bcc6de7d5481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:16.093525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92907a9d-5c59-4921-bccc-bcc6de7d5481 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:16.093828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92907a9d-5c59-4921-bccc-bcc6de7d5481 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:16.094413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92907a9d-5c59-4921-bccc-bcc6de7d5481 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:16.095054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92907a9d-5c59-4921-bccc-bcc6de7d5481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:16.095407 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92907a9d-5c59-4921-bccc-bcc6de7d5481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:16.097109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92907a9d-5c59-4921-bccc-bcc6de7d5481 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:16.112169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 626/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:04:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:16.118421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eca954-2f3f-47a4-bd0b-446e85e5a235 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:16.226410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eca954-2f3f-47a4-bd0b-446e85e5a235 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:16.262838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303aec98-b449-49fa-b9d2-a0bb64669bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:16.263502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aec98-b449-49fa-b9d2-a0bb64669bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:16.263803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aec98-b449-49fa-b9d2-a0bb64669bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:16.264072 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aec98-b449-49fa-b9d2-a0bb64669bf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:16.264910 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303aec98-b449-49fa-b9d2-a0bb64669bf4 None admin] RBAC: Adding query filter params (role.id=58b981aa32454837bd8eae9e804d811e, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=33213d31b1394cdfb5b447f4f4952b53) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:16.265354 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303aec98-b449-49fa-b9d2-a0bb64669bf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:16.266799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303aec98-b449-49fa-b9d2-a0bb64669bf4 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:16.273198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 620/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:04:16 2022] GET /identity/v3/role_assignments?user.id=33213d31b1394cdfb5b447f4f4952b53&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=58b981aa32454837bd8eae9e804d811e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:18.463171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608daea2-a7b7-4e3f-b1bf-ebae1e3bb808 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:18.463721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608daea2-a7b7-4e3f-b1bf-ebae1e3bb808 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:18.463721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608daea2-a7b7-4e3f-b1bf-ebae1e3bb808 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:18.465168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 627/1247] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:04:18.470808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf3f66-7f3a-43f1-8845-bdf58ed51fdd None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:18.471240 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf3f66-7f3a-43f1-8845-bdf58ed51fdd None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:18.471404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf3f66-7f3a-43f1-8845-bdf58ed51fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:18.479199 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:18.496863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6cdf3f66-7f3a-43f1-8845-bdf58ed51fdd None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:04:18.498233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6cdf3f66-7f3a-43f1-8845-bdf58ed51fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:04:18.574108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 621/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:04:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:04:18.599511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608daea2-a7b7-4e3f-b1bf-ebae1e3bb808 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:18.619737 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:18.717744 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608daea2-a7b7-4e3f-b1bf-ebae1e3bb808 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:18.756153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47d555-ad34-4e68-b836-452f35959145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:18.756993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47d555-ad34-4e68-b836-452f35959145 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:18.757293 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47d555-ad34-4e68-b836-452f35959145 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:18.757563 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47d555-ad34-4e68-b836-452f35959145 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:18.768959 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47d555-ad34-4e68-b836-452f35959145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7b47d555-ad34-4e68-b836-452f35959145 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:04:18.774248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:18.775365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:18.776222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 628/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:04:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:04:18.782585 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf3f66-7f3a-43f1-8845-bdf58ed51fdd None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:18.911586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf3f66-7f3a-43f1-8845-bdf58ed51fdd None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:18.957173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:18.964818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43b74f-e10b-4b6b-a8d2-56d3093fb3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:18.965788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43b74f-e10b-4b6b-a8d2-56d3093fb3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:18.966492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43b74f-e10b-4b6b-a8d2-56d3093fb3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:18.966757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43b74f-e10b-4b6b-a8d2-56d3093fb3f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:18.967885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43b74f-e10b-4b6b-a8d2-56d3093fb3f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:18.968210 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43b74f-e10b-4b6b-a8d2-56d3093fb3f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:18.969726 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43b74f-e10b-4b6b-a8d2-56d3093fb3f2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:18.980274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 622/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:04:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:18.986738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47d555-ad34-4e68-b836-452f35959145 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:19.084614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:19.110637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47d555-ad34-4e68-b836-452f35959145 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:19.163965 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b58e38-0e7b-429d-995c-da71176d86d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:19.165043 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b58e38-0e7b-429d-995c-da71176d86d0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:19.165668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b58e38-0e7b-429d-995c-da71176d86d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:19.166006 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b58e38-0e7b-429d-995c-da71176d86d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:19.183635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b58e38-0e7b-429d-995c-da71176d86d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:19.185670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b58e38-0e7b-429d-995c-da71176d86d0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a4b58e38-0e7b-429d-995c-da71176d86d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:19.204251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:19.206210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:19.207449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:19.207449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:19.207449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:19.207449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:19.209291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 629/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:19.211661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43b74f-e10b-4b6b-a8d2-56d3093fb3f2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:19.351839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43b74f-e10b-4b6b-a8d2-56d3093fb3f2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:19.401909 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab46d5-2519-45b1-b995-259d33da4007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:19.402650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab46d5-2519-45b1-b995-259d33da4007 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:19.403100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab46d5-2519-45b1-b995-259d33da4007 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:19.403245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab46d5-2519-45b1-b995-259d33da4007 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:19.403950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab46d5-2519-45b1-b995-259d33da4007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:19.404257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab46d5-2519-45b1-b995-259d33da4007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:19.405814 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab46d5-2519-45b1-b995-259d33da4007 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:19.420779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 623/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:19.427195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b58e38-0e7b-429d-995c-da71176d86d0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:19.555918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b58e38-0e7b-429d-995c-da71176d86d0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:19.594672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:19.607327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c595a-c1d7-47fd-a0d6-e06f338da582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:19.608209 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c595a-c1d7-47fd-a0d6-e06f338da582 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:19.608509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c595a-c1d7-47fd-a0d6-e06f338da582 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:19.608790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c595a-c1d7-47fd-a0d6-e06f338da582 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:19.618635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c595a-c1d7-47fd-a0d6-e06f338da582 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:19.620258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c595a-c1d7-47fd-a0d6-e06f338da582 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c01c595a-c1d7-47fd-a0d6-e06f338da582 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:04:19.633917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:19.635699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:19.636788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:19.636788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:19.636788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:04:19.636788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:04:19.636788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:04:19.636788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:04:19.636788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:04:19.636788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:04:19.636788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 07:04:19.636788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:19.636788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 630/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:19.641945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab46d5-2519-45b1-b995-259d33da4007 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:19.728154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:19.791569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab46d5-2519-45b1-b995-259d33da4007 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:19.837113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2bd1-5dd9-4a6b-a0a9-925640bfab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:19.837961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2bd1-5dd9-4a6b-a0a9-925640bfab81 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:19.838403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2bd1-5dd9-4a6b-a0a9-925640bfab81 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:19.838785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e2bd1-5dd9-4a6b-a0a9-925640bfab81 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:19.840068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e2bd1-5dd9-4a6b-a0a9-925640bfab81 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:19.840497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e2bd1-5dd9-4a6b-a0a9-925640bfab81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:19.842644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e2bd1-5dd9-4a6b-a0a9-925640bfab81 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:19.867020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 624/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 5 07:04:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:04:19.873425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c595a-c1d7-47fd-a0d6-e06f338da582 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:20.014007 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c595a-c1d7-47fd-a0d6-e06f338da582 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:20.063090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862fb45-25e7-455a-8806-4b6efb032c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:20.063682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862fb45-25e7-455a-8806-4b6efb032c62 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:20.063961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862fb45-25e7-455a-8806-4b6efb032c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:20.064287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862fb45-25e7-455a-8806-4b6efb032c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:20.143640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:20.169419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862fb45-25e7-455a-8806-4b6efb032c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:20.171240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862fb45-25e7-455a-8806-4b6efb032c62 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:20.317176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 631/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:04:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:04:20.324271 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2bd1-5dd9-4a6b-a0a9-925640bfab81 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:20.454933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e2bd1-5dd9-4a6b-a0a9-925640bfab81 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:20.471133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:20.498527 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91442019-521b-4d70-89fb-a50e91f8b054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:20.499865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91442019-521b-4d70-89fb-a50e91f8b054 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:20.500217 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91442019-521b-4d70-89fb-a50e91f8b054 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:20.500793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91442019-521b-4d70-89fb-a50e91f8b054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:20.517810 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91442019-521b-4d70-89fb-a50e91f8b054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:20.519772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91442019-521b-4d70-89fb-a50e91f8b054 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-91442019-521b-4d70-89fb-a50e91f8b054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:20.543553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:20.544729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:20.546444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:20.546444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:20.546444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:20.546444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:20.546444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 625/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:20.557146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862fb45-25e7-455a-8806-4b6efb032c62 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:20.669768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:20.685461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862fb45-25e7-455a-8806-4b6efb032c62 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:20.732337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a76a8-d984-4932-8a4e-f52cdf3acafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:20.732991 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a76a8-d984-4932-8a4e-f52cdf3acafc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:20.733337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a76a8-d984-4932-8a4e-f52cdf3acafc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:20.733718 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a76a8-d984-4932-8a4e-f52cdf3acafc None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:20.734546 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a76a8-d984-4932-8a4e-f52cdf3acafc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:20.734915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a76a8-d984-4932-8a4e-f52cdf3acafc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:20.736761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a76a8-d984-4932-8a4e-f52cdf3acafc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:20.755393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 632/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:20.756816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91442019-521b-4d70-89fb-a50e91f8b054 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:20.888288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91442019-521b-4d70-89fb-a50e91f8b054 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:20.946948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f499ca-4bac-441f-9175-290d4872618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:20.947703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f499ca-4bac-441f-9175-290d4872618f None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:20.948050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f499ca-4bac-441f-9175-290d4872618f None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:20.948376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f499ca-4bac-441f-9175-290d4872618f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:20.956503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f499ca-4bac-441f-9175-290d4872618f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:20.958144 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f499ca-4bac-441f-9175-290d4872618f None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-24f499ca-4bac-441f-9175-290d4872618f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:04:20.971349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:20.972673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:20.974031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:04:20.974031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:04:20.974031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:04:20.974031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:04:20.974031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:04:20.974031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:04:20.974031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:04:20.974031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:20.974031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 626/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:04:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:04:20.982110 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a76a8-d984-4932-8a4e-f52cdf3acafc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:21.104852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a76a8-d984-4932-8a4e-f52cdf3acafc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:21.144346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4fd04-2eb0-40d4-877f-547f73f687b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:21.144907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4fd04-2eb0-40d4-877f-547f73f687b2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:21.145201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4fd04-2eb0-40d4-877f-547f73f687b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:21.145470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4fd04-2eb0-40d4-877f-547f73f687b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:21.146226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4fd04-2eb0-40d4-877f-547f73f687b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:21.146528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4fd04-2eb0-40d4-877f-547f73f687b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:21.147966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4fd04-2eb0-40d4-877f-547f73f687b2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:21.165382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 633/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:04:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:21.172238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f499ca-4bac-441f-9175-290d4872618f None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:21.218588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:21.329066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f499ca-4bac-441f-9175-290d4872618f None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:21.373823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6462d53-7121-4b1b-98ee-a518087ba047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:21.374736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6462d53-7121-4b1b-98ee-a518087ba047 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:21.375102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6462d53-7121-4b1b-98ee-a518087ba047 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:21.375441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6462d53-7121-4b1b-98ee-a518087ba047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:21.376481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6462d53-7121-4b1b-98ee-a518087ba047 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=33213d31b1394cdfb5b447f4f4952b53) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:21.376810 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6462d53-7121-4b1b-98ee-a518087ba047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:21.378858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6462d53-7121-4b1b-98ee-a518087ba047 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:21.387298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 627/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:04:21 2022] GET /identity/v3/role_assignments?user.id=33213d31b1394cdfb5b447f4f4952b53&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:23.481645 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf89593-655e-4aa8-bf2e-d1e73220c60a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:23.482187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf89593-655e-4aa8-bf2e-d1e73220c60a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:23.482187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf89593-655e-4aa8-bf2e-d1e73220c60a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:23.483546 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 634/1261] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:04:23.488862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fce02-b578-4df8-bdfb-62c8f74f45fc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:23.489347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fce02-b578-4df8-bdfb-62c8f74f45fc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:23.489440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fce02-b578-4df8-bdfb-62c8f74f45fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:23.508301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b30fce02-b578-4df8-bdfb-62c8f74f45fc None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:04:23.509529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b30fce02-b578-4df8-bdfb-62c8f74f45fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:04:23.588119 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 628/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:04:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:04:23.610308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf89593-655e-4aa8-bf2e-d1e73220c60a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:23.622275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:23.731500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf89593-655e-4aa8-bf2e-d1e73220c60a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:23.767060 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491afd4-dfb5-47c4-afb9-1254c2b7fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:23.767708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491afd4-dfb5-47c4-afb9-1254c2b7fce0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:23.767987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491afd4-dfb5-47c4-afb9-1254c2b7fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:23.768258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491afd4-dfb5-47c4-afb9-1254c2b7fce0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:23.778922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491afd4-dfb5-47c4-afb9-1254c2b7fce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4491afd4-dfb5-47c4-afb9-1254c2b7fce0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:04:23.784185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:23.785223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:23.786136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 635/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:04:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:23.791717 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fce02-b578-4df8-bdfb-62c8f74f45fc None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:23.811105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:23.895611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fce02-b578-4df8-bdfb-62c8f74f45fc None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:23.941123 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ce8a6-db30-4999-a55e-0b7525eab4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:23.941757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce8a6-db30-4999-a55e-0b7525eab4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:23.942038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce8a6-db30-4999-a55e-0b7525eab4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:23.942312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce8a6-db30-4999-a55e-0b7525eab4c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:23.943040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ce8a6-db30-4999-a55e-0b7525eab4c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:23.943343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ce8a6-db30-4999-a55e-0b7525eab4c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:23.944730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ce8a6-db30-4999-a55e-0b7525eab4c2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:23.953223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 629/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:04:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:23.959336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491afd4-dfb5-47c4-afb9-1254c2b7fce0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:24.035850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:24.070682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491afd4-dfb5-47c4-afb9-1254c2b7fce0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:24.106551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d339c-8079-4995-b51c-85e0941599bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:24.107190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d339c-8079-4995-b51c-85e0941599bd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:24.107468 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d339c-8079-4995-b51c-85e0941599bd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:24.107738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d339c-8079-4995-b51c-85e0941599bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:24.118305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d339c-8079-4995-b51c-85e0941599bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:24.119751 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d339c-8079-4995-b51c-85e0941599bd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-5d5d339c-8079-4995-b51c-85e0941599bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:24.134850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:24.135861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:24.136850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:24.136850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:24.136850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:24.136850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:24.136850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 636/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:24.142037 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ce8a6-db30-4999-a55e-0b7525eab4c2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:24.225770 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:24.246111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ce8a6-db30-4999-a55e-0b7525eab4c2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:24.280455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b6401-56fe-43cf-a0d1-9c621e2bc7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:24.282328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b6401-56fe-43cf-a0d1-9c621e2bc7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:24.282328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b6401-56fe-43cf-a0d1-9c621e2bc7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:24.282328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b6401-56fe-43cf-a0d1-9c621e2bc7e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:24.282716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b6401-56fe-43cf-a0d1-9c621e2bc7e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:24.282957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b6401-56fe-43cf-a0d1-9c621e2bc7e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:24.284348 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b6401-56fe-43cf-a0d1-9c621e2bc7e6 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:24.296694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 630/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:24.302570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d339c-8079-4995-b51c-85e0941599bd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:24.404068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d339c-8079-4995-b51c-85e0941599bd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:24.424003 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:24.439295 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fa12e-617a-469b-aa32-93b9789ff207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:24.439925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fa12e-617a-469b-aa32-93b9789ff207 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:24.440199 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fa12e-617a-469b-aa32-93b9789ff207 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:24.440449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fa12e-617a-469b-aa32-93b9789ff207 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:24.447950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fa12e-617a-469b-aa32-93b9789ff207 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:24.449458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fa12e-617a-469b-aa32-93b9789ff207 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-029fa12e-617a-469b-aa32-93b9789ff207 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:04:24.460559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:24.461745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:24.462696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:24.462696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:24.462696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:04:24.462696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:04:24.462696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:04:24.462696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:04:24.462696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:04:24.462696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:04:24.462696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 07:04:24.462696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:24.462696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 637/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:04:24.467962 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b6401-56fe-43cf-a0d1-9c621e2bc7e6 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:24.574612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b6401-56fe-43cf-a0d1-9c621e2bc7e6 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:24.612551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168aca0-0a94-484f-a928-8994e59869a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:24.612551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168aca0-0a94-484f-a928-8994e59869a2 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:24.612551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168aca0-0a94-484f-a928-8994e59869a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:24.612551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168aca0-0a94-484f-a928-8994e59869a2 None admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:24.613104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168aca0-0a94-484f-a928-8994e59869a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:24.613407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168aca0-0a94-484f-a928-8994e59869a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:24.614851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168aca0-0a94-484f-a928-8994e59869a2 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:24.624115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:24.634515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 631/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 5 07:04:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:24.641269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fa12e-617a-469b-aa32-93b9789ff207 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:24.748499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fa12e-617a-469b-aa32-93b9789ff207 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:24.783324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03355afb-a00c-4ec4-917d-7fa2f897b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:24.783962 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03355afb-a00c-4ec4-917d-7fa2f897b14b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:24.784236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03355afb-a00c-4ec4-917d-7fa2f897b14b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:24.784506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03355afb-a00c-4ec4-917d-7fa2f897b14b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:24.795467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03355afb-a00c-4ec4-917d-7fa2f897b14b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:24.796913 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03355afb-a00c-4ec4-917d-7fa2f897b14b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-03355afb-a00c-4ec4-917d-7fa2f897b14b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:24.811334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:24.812315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:24.813393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:24.813393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:24.813393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:24.813393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:24.813393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 638/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:04:24.818607 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168aca0-0a94-484f-a928-8994e59869a2 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:24.926785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168aca0-0a94-484f-a928-8994e59869a2 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:24.961739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb30a2d-afef-4b92-98ef-fd2a8d83eb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:24.962356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb30a2d-afef-4b92-98ef-fd2a8d83eb74 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:24.962632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb30a2d-afef-4b92-98ef-fd2a8d83eb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:24.962902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb30a2d-afef-4b92-98ef-fd2a8d83eb74 None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:24.963586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb30a2d-afef-4b92-98ef-fd2a8d83eb74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:24.963884 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb30a2d-afef-4b92-98ef-fd2a8d83eb74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:24.965455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb30a2d-afef-4b92-98ef-fd2a8d83eb74 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:24.993220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 632/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:24.999304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03355afb-a00c-4ec4-917d-7fa2f897b14b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:25.034803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:25.106352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03355afb-a00c-4ec4-917d-7fa2f897b14b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:25.140939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154d55c-ab9f-4b28-8567-0a367888af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:25.141554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154d55c-ab9f-4b28-8567-0a367888af2b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:25.141830 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154d55c-ab9f-4b28-8567-0a367888af2b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:25.142096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154d55c-ab9f-4b28-8567-0a367888af2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:25.149000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154d55c-ab9f-4b28-8567-0a367888af2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:25.150425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154d55c-ab9f-4b28-8567-0a367888af2b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d154d55c-ab9f-4b28-8567-0a367888af2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:04:25.162360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:25.163389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:25.164521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:04:25.164521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:04:25.164521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:04:25.164521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:04:25.164521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:04:25.164521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:04:25.164521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:04:25.164521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:25.164521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 639/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:25.171312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb30a2d-afef-4b92-98ef-fd2a8d83eb74 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:25.233854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:25.278649 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb30a2d-afef-4b92-98ef-fd2a8d83eb74 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:25.315899 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bac00a-af5e-4efe-9bf4-50ddd4133884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:25.316524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bac00a-af5e-4efe-9bf4-50ddd4133884 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:25.316800 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bac00a-af5e-4efe-9bf4-50ddd4133884 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:25.317098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bac00a-af5e-4efe-9bf4-50ddd4133884 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:25.317853 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bac00a-af5e-4efe-9bf4-50ddd4133884 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:25.318156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bac00a-af5e-4efe-9bf4-50ddd4133884 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:25.319600 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bac00a-af5e-4efe-9bf4-50ddd4133884 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:25.332236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 633/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:04:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:25.338553 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154d55c-ab9f-4b28-8567-0a367888af2b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:25.434464 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:25.444798 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154d55c-ab9f-4b28-8567-0a367888af2b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:25.478953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65ace6-4d64-4e44-a203-b56db1e12b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:25.479621 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65ace6-4d64-4e44-a203-b56db1e12b23 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:25.479901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65ace6-4d64-4e44-a203-b56db1e12b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:25.480234 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65ace6-4d64-4e44-a203-b56db1e12b23 None admin] PATH_INFO: `/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/33213d31b1394cdfb5b447f4f4952b53/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:25.482278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65ace6-4d64-4e44-a203-b56db1e12b23 None admin] RBAC: Authorizing `identity:create_grant(project_id=29b560f1bcf347f6b8b885cc02d52e33, user_id=33213d31b1394cdfb5b447f4f4952b53, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:25.483769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65ace6-4d64-4e44-a203-b56db1e12b23 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:25.498094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 640/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Aug 5 07:04:25 2022] PUT /identity/v3/projects/29b560f1bcf347f6b8b885cc02d52e33/users/33213d31b1394cdfb5b447f4f4952b53/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:04:27.476157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d95ef-c083-4288-8047-ac3d75a89c6b None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:27.476708 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d95ef-c083-4288-8047-ac3d75a89c6b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:27.476708 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d95ef-c083-4288-8047-ac3d75a89c6b None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:27.478121 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 634/1274] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:04:27.483425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455458d0-dd60-4e9b-93e0-b1dd8cddc610 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:27.483850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455458d0-dd60-4e9b-93e0-b1dd8cddc610 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:27.483969 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455458d0-dd60-4e9b-93e0-b1dd8cddc610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:27.503628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-455458d0-dd60-4e9b-93e0-b1dd8cddc610 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:04:27.504858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-455458d0-dd60-4e9b-93e0-b1dd8cddc610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:04:27.576737 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 641/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:04:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:04:27.600250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d95ef-c083-4288-8047-ac3d75a89c6b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:27.716611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d95ef-c083-4288-8047-ac3d75a89c6b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:27.735205 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:27.754310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d72bc-3d26-408c-80ad-38de90934965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:27.754953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d72bc-3d26-408c-80ad-38de90934965 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:27.755227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d72bc-3d26-408c-80ad-38de90934965 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:27.755495 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d72bc-3d26-408c-80ad-38de90934965 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:27.765858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d72bc-3d26-408c-80ad-38de90934965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-d24d72bc-3d26-408c-80ad-38de90934965 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 07:04:27.770831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:27.771888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:27.772915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:27.772915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:27.772915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:27.772915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:27.772915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 07:04:27.772915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 07:04:27.772915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 07:04:27.772915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 07:04:27.772915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 07:04:27.772915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 07:04:27.772915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 07:04:27.772915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:27.777080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 635/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Aug 5 07:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:27.778174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455458d0-dd60-4e9b-93e0-b1dd8cddc610 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:27.867531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:27.887676 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455458d0-dd60-4e9b-93e0-b1dd8cddc610 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:27.928779 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d71ae2-4716-4b0f-a82d-72450d19092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:27.929620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d71ae2-4716-4b0f-a82d-72450d19092e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:27.930063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d71ae2-4716-4b0f-a82d-72450d19092e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:27.930338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d71ae2-4716-4b0f-a82d-72450d19092e None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:27.931101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d71ae2-4716-4b0f-a82d-72450d19092e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:27.931406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d71ae2-4716-4b0f-a82d-72450d19092e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:27.933199 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d71ae2-4716-4b0f-a82d-72450d19092e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:27.943486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 642/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Aug 5 07:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:27.950532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d72bc-3d26-408c-80ad-38de90934965 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:28.061544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d72bc-3d26-408c-80ad-38de90934965 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:28.097631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccb86f-32c9-4a97-8a17-fd9eec63740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:28.098271 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccb86f-32c9-4a97-8a17-fd9eec63740e None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:28.098550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccb86f-32c9-4a97-8a17-fd9eec63740e None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:28.098825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccb86f-32c9-4a97-8a17-fd9eec63740e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:28.109339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccb86f-32c9-4a97-8a17-fd9eec63740e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:28.110788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccb86f-32c9-4a97-8a17-fd9eec63740e None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-ebccb86f-32c9-4a97-8a17-fd9eec63740e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:28.125796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:28.126911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:28.128302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:28.128302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:28.128302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:28.128302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:28.128302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 636/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:28.132870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d71ae2-4716-4b0f-a82d-72450d19092e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:28.236092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d71ae2-4716-4b0f-a82d-72450d19092e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:28.271576 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4edfd-969e-41cf-b986-9b7cd6057092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:28.272191 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4edfd-969e-41cf-b986-9b7cd6057092 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:28.272480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4edfd-969e-41cf-b986-9b7cd6057092 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:28.272738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4edfd-969e-41cf-b986-9b7cd6057092 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:28.273485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4edfd-969e-41cf-b986-9b7cd6057092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:28.273784 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4edfd-969e-41cf-b986-9b7cd6057092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:28.275166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4edfd-969e-41cf-b986-9b7cd6057092 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:28.288245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 643/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:28.294296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccb86f-32c9-4a97-8a17-fd9eec63740e None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:28.327320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:28.400333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccb86f-32c9-4a97-8a17-fd9eec63740e None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:28.435944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626f183-a51c-4318-bed4-eaa92de034f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:28.436580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626f183-a51c-4318-bed4-eaa92de034f8 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:28.436859 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626f183-a51c-4318-bed4-eaa92de034f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:28.437173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626f183-a51c-4318-bed4-eaa92de034f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:28.444987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626f183-a51c-4318-bed4-eaa92de034f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:28.446437 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626f183-a51c-4318-bed4-eaa92de034f8 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-7626f183-a51c-4318-bed4-eaa92de034f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 07:04:28.458051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:28.459155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:28.460296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:28.460296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:28.460296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 07:04:28.460296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 07:04:28.460296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 07:04:28.460296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 07:04:28.460296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 07:04:28.460296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 07:04:28.460296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 07:04:28.460296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:28.460296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 637/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:28.465263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4edfd-969e-41cf-b986-9b7cd6057092 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:28.469328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:28.577983 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4edfd-969e-41cf-b986-9b7cd6057092 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:28.617913 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e985-b0c7-4eb3-869a-196e542385c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:28.618540 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e985-b0c7-4eb3-869a-196e542385c6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:28.618817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e985-b0c7-4eb3-869a-196e542385c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:28.619091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e985-b0c7-4eb3-869a-196e542385c6 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:28.619893 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955e985-b0c7-4eb3-869a-196e542385c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:28.620203 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955e985-b0c7-4eb3-869a-196e542385c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:28.621780 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955e985-b0c7-4eb3-869a-196e542385c6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:28.640167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 644/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Aug 5 07:04:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:28.646468 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626f183-a51c-4318-bed4-eaa92de034f8 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:28.739806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:28.751185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626f183-a51c-4318-bed4-eaa92de034f8 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:28.786640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ec95e-3ebc-4476-bf5c-0fd2feeaf4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:28.787255 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ec95e-3ebc-4476-bf5c-0fd2feeaf4cc None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:28.787534 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ec95e-3ebc-4476-bf5c-0fd2feeaf4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:28.787809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ec95e-3ebc-4476-bf5c-0fd2feeaf4cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:28.859747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ec95e-3ebc-4476-bf5c-0fd2feeaf4cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:28.861255 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ec95e-3ebc-4476-bf5c-0fd2feeaf4cc None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:28.964116 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:28.975542 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 638/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Aug 5 07:04:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 07:04:28.981645 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e985-b0c7-4eb3-869a-196e542385c6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:29.046088 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:29.087334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e985-b0c7-4eb3-869a-196e542385c6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:29.124184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35f24-63e2-461c-bfba-ea392b77417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:29.124817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35f24-63e2-461c-bfba-ea392b77417c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:29.125128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35f24-63e2-461c-bfba-ea392b77417c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:29.125403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e35f24-63e2-461c-bfba-ea392b77417c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:29.136015 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e35f24-63e2-461c-bfba-ea392b77417c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:29.137618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e35f24-63e2-461c-bfba-ea392b77417c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-22e35f24-63e2-461c-bfba-ea392b77417c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 07:04:29.152790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:29.153690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:29.154575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 07:04:29.154575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 07:04:29.154575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 07:04:29.154575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:29.154575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 645/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:29.160443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ec95e-3ebc-4476-bf5c-0fd2feeaf4cc None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:29.266605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ec95e-3ebc-4476-bf5c-0fd2feeaf4cc None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:29.303799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a534170-3247-4ca1-b8af-5be50123f38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:29.304347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534170-3247-4ca1-b8af-5be50123f38a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:29.304628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534170-3247-4ca1-b8af-5be50123f38a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:29.304923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534170-3247-4ca1-b8af-5be50123f38a None admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:29.305629 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a534170-3247-4ca1-b8af-5be50123f38a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:29.305937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a534170-3247-4ca1-b8af-5be50123f38a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:29.307317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a534170-3247-4ca1-b8af-5be50123f38a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:29.319618 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 639/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Aug 5 07:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:29.325643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35f24-63e2-461c-bfba-ea392b77417c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:29.431155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e35f24-63e2-461c-bfba-ea392b77417c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:29.444657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:29.466764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e2044-0453-4736-b958-736109244a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:29.467396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e2044-0453-4736-b958-736109244a6a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:29.467670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e2044-0453-4736-b958-736109244a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:29.467934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e2044-0453-4736-b958-736109244a6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:29.475021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e2044-0453-4736-b958-736109244a6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:29.476454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e2044-0453-4736-b958-736109244a6a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-0d0e2044-0453-4736-b958-736109244a6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 07:04:29.487961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:29.488960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:29.490021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 07:04:29.490021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 07:04:29.490021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 07:04:29.490021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 07:04:29.490021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 07:04:29.490021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 07:04:29.490021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 07:04:29.490021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Aug 05 07:04:29.490021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 646/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Aug 5 07:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:29.495247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a534170-3247-4ca1-b8af-5be50123f38a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:29.546554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:29.600424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a534170-3247-4ca1-b8af-5be50123f38a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:29.635717 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033aa0c-dfe0-4f1c-882e-5e5b4303d721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:29.636336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033aa0c-dfe0-4f1c-882e-5e5b4303d721 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:29.636613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033aa0c-dfe0-4f1c-882e-5e5b4303d721 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:29.636923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033aa0c-dfe0-4f1c-882e-5e5b4303d721 None admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:29.637674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033aa0c-dfe0-4f1c-882e-5e5b4303d721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:29.637978 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033aa0c-dfe0-4f1c-882e-5e5b4303d721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:29.639429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033aa0c-dfe0-4f1c-882e-5e5b4303d721 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:29.652196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 640/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Aug 5 07:04:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:29.659135 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e2044-0453-4736-b958-736109244a6a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:29.765682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e2044-0453-4736-b958-736109244a6a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:29.801639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f8f45-084d-4552-8c55-5fe97f1cda04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:29.802249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f8f45-084d-4552-8c55-5fe97f1cda04 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:29.802526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f8f45-084d-4552-8c55-5fe97f1cda04 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:29.802799 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f8f45-084d-4552-8c55-5fe97f1cda04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:29.803612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f8f45-084d-4552-8c55-5fe97f1cda04 None admin] RBAC: Adding query filter params (role.id=86cc3f5017af47bdbd356a87243cdcce, scope.project.id=29b560f1bcf347f6b8b885cc02d52e33, user.id=33213d31b1394cdfb5b447f4f4952b53) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:29.803904 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f8f45-084d-4552-8c55-5fe97f1cda04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:29.805372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f8f45-084d-4552-8c55-5fe97f1cda04 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:29.811496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 647/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Aug 5 07:04:29 2022] GET /identity/v3/role_assignments?user.id=33213d31b1394cdfb5b447f4f4952b53&scope.project.id=29b560f1bcf347f6b8b885cc02d52e33&role.id=86cc3f5017af47bdbd356a87243cdcce => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:31.822733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822172-a0f2-481b-b1b3-36aeeb269a0c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:31.823331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822172-a0f2-481b-b1b3-36aeeb269a0c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:31.823331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9822172-a0f2-481b-b1b3-36aeeb269a0c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:31.824684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 641/1288] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:04:31.830038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c50f7-acf2-4c49-a876-c786aa679762 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:31.830506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c50f7-acf2-4c49-a876-c786aa679762 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:31.830605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c50f7-acf2-4c49-a876-c786aa679762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:31.849510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e54c50f7-acf2-4c49-a876-c786aa679762 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:04:31.850709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e54c50f7-acf2-4c49-a876-c786aa679762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:04:31.883819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:31.928244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 648/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:04:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:04:31.953222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9822172-a0f2-481b-b1b3-36aeeb269a0c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:32.078293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9822172-a0f2-481b-b1b3-36aeeb269a0c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:32.088925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:32.113755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6daa7b-887a-41c5-ac52-68521aca121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:32.114393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6daa7b-887a-41c5-ac52-68521aca121a None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:32.114671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6daa7b-887a-41c5-ac52-68521aca121a None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:32.114940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6daa7b-887a-41c5-ac52-68521aca121a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:32.115577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6daa7b-887a-41c5-ac52-68521aca121a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:32.116984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6daa7b-887a-41c5-ac52-68521aca121a None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-af6daa7b-887a-41c5-ac52-68521aca121a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:32.125904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:32.127043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:32.127931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 642/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 07:04:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:04:32.133651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c50f7-acf2-4c49-a876-c786aa679762 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:32.237340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c50f7-acf2-4c49-a876-c786aa679762 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:32.278907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1983a95-80c7-456f-b4f6-e02be7a97b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:32.279530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1983a95-80c7-456f-b4f6-e02be7a97b42 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:32.279802 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1983a95-80c7-456f-b4f6-e02be7a97b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:32.280073 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1983a95-80c7-456f-b4f6-e02be7a97b42 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:32.281166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1983a95-80c7-456f-b4f6-e02be7a97b42 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:32.282059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1983a95-80c7-456f-b4f6-e02be7a97b42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:32.282854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1983a95-80c7-456f-b4f6-e02be7a97b42 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:32.288829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 649/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Aug 5 07:04:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:32.295236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6daa7b-887a-41c5-ac52-68521aca121a None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:32.402527 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6daa7b-887a-41c5-ac52-68521aca121a None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:32.438906 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5044f-fb64-4cd2-9d72-71bda3b83406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:32.439538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5044f-fb64-4cd2-9d72-71bda3b83406 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:32.439815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5044f-fb64-4cd2-9d72-71bda3b83406 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:32.440091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5044f-fb64-4cd2-9d72-71bda3b83406 None admin] PATH_INFO: `/v3/services` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:32.440776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5044f-fb64-4cd2-9d72-71bda3b83406 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:32.441114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5044f-fb64-4cd2-9d72-71bda3b83406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:32.442503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5044f-fb64-4cd2-9d72-71bda3b83406 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:32.447227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 643/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Aug 5 07:04:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:34.421239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1cc21-b74e-4bae-bedf-b2878b7a4d0a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:34.421838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1cc21-b74e-4bae-bedf-b2878b7a4d0a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:34.421838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1cc21-b74e-4bae-bedf-b2878b7a4d0a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:34.423146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 650/1293] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:04:34.428785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87b2e1-4c76-4d3e-8960-5b41a8c78d03 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:34.429285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87b2e1-4c76-4d3e-8960-5b41a8c78d03 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:34.429401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87b2e1-4c76-4d3e-8960-5b41a8c78d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:34.448217 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0a87b2e1-4c76-4d3e-8960-5b41a8c78d03 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:04:34.449533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0a87b2e1-4c76-4d3e-8960-5b41a8c78d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:04:34.481116 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:34.520755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 644/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:04:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:04:34.544054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1cc21-b74e-4bae-bedf-b2878b7a4d0a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:34.576797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:34.651505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1cc21-b74e-4bae-bedf-b2878b7a4d0a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:34.688494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd73f31-b1a0-4574-af1a-4434957abcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:34.689136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd73f31-b1a0-4574-af1a-4434957abcc9 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:34.689413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd73f31-b1a0-4574-af1a-4434957abcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:34.689685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd73f31-b1a0-4574-af1a-4434957abcc9 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:34.690383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd73f31-b1a0-4574-af1a-4434957abcc9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:34.692113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd73f31-b1a0-4574-af1a-4434957abcc9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:34.707904 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 651/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Aug 5 07:04:34 2022] POST /identity/v3/services => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:04:36.684527 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba55f6b-1039-438c-b67b-ce029139036f None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:36.685108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba55f6b-1039-438c-b67b-ce029139036f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:36.685108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba55f6b-1039-438c-b67b-ce029139036f None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:36.686343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 645/1296] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:04:36.691967 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a397bf-c19e-4fc0-9b9d-12e7a9635f9a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:36.692436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a397bf-c19e-4fc0-9b9d-12e7a9635f9a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:36.692534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a397bf-c19e-4fc0-9b9d-12e7a9635f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:36.711044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a1a397bf-c19e-4fc0-9b9d-12e7a9635f9a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:04:36.712225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a1a397bf-c19e-4fc0-9b9d-12e7a9635f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:04:36.787626 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 652/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:04:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 07:04:36.810228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba55f6b-1039-438c-b67b-ce029139036f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:36.922010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba55f6b-1039-438c-b67b-ce029139036f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:36.967995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3ef6f-7fa7-46d2-8f0b-b70934e82cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:36.968858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3ef6f-7fa7-46d2-8f0b-b70934e82cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:36.969317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3ef6f-7fa7-46d2-8f0b-b70934e82cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:36.969723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3ef6f-7fa7-46d2-8f0b-b70934e82cb1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:36.970685 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3ef6f-7fa7-46d2-8f0b-b70934e82cb1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:36.972888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3ef6f-7fa7-46d2-8f0b-b70934e82cb1 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-cfb3ef6f-7fa7-46d2-8f0b-b70934e82cb1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:36.984393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:36.985713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:36.986688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 646/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 07:04:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 07:04:36.992308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a397bf-c19e-4fc0-9b9d-12e7a9635f9a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:37.012428 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:37.097768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a397bf-c19e-4fc0-9b9d-12e7a9635f9a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:37.132857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a45769-1cfb-4f6f-9692-6a314fda2373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:37.133477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a45769-1cfb-4f6f-9692-6a314fda2373 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:37.133782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a45769-1cfb-4f6f-9692-6a314fda2373 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:37.134056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a45769-1cfb-4f6f-9692-6a314fda2373 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:37.134730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a45769-1cfb-4f6f-9692-6a314fda2373 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:37.135039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a45769-1cfb-4f6f-9692-6a314fda2373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:37.136428 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a45769-1cfb-4f6f-9692-6a314fda2373 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:37.141758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 653/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Aug 5 07:04:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:04:37.148170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3ef6f-7fa7-46d2-8f0b-b70934e82cb1 None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:37.182116 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:37.255991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3ef6f-7fa7-46d2-8f0b-b70934e82cb1 None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:37.296701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e509a52-0523-48bd-af7b-8c0188f253a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:37.297635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e509a52-0523-48bd-af7b-8c0188f253a3 None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:37.297914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e509a52-0523-48bd-af7b-8c0188f253a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:37.298183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e509a52-0523-48bd-af7b-8c0188f253a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:37.298975 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e509a52-0523-48bd-af7b-8c0188f253a3 None admin] RBAC: Adding query filter params (interface=public, service_id=f68a0c8bb7554f5bae6451a5231daf4b, region_id=RegionOne) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:37.299286 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e509a52-0523-48bd-af7b-8c0188f253a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:37.300670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e509a52-0523-48bd-af7b-8c0188f253a3 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:37.306730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 647/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Aug 5 07:04:37 2022] GET /identity/v3/endpoints?service_id=f68a0c8bb7554f5bae6451a5231daf4b&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:37.312913 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a45769-1cfb-4f6f-9692-6a314fda2373 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:37.397593 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:37.416769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a45769-1cfb-4f6f-9692-6a314fda2373 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:37.450137 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b744e-71a5-47b4-a876-68ed9ea91594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:37.450759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b744e-71a5-47b4-a876-68ed9ea91594 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:37.451039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b744e-71a5-47b4-a876-68ed9ea91594 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:37.451313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b744e-71a5-47b4-a876-68ed9ea91594 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:37.451963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b744e-71a5-47b4-a876-68ed9ea91594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:37.453362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b744e-71a5-47b4-a876-68ed9ea91594 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:37.460196 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 654/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Aug 5 07:04:37 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:04:39.452782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d0926-b89d-4571-88a6-b5b2da9e6881 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:39.453338 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d0926-b89d-4571-88a6-b5b2da9e6881 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:39.453458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d0926-b89d-4571-88a6-b5b2da9e6881 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:39.454742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 648/1302] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:04:39.460369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766fc77-36c7-40c6-a98e-dca52203cd87 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:39.460808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766fc77-36c7-40c6-a98e-dca52203cd87 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:39.460941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766fc77-36c7-40c6-a98e-dca52203cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:39.479421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4766fc77-36c7-40c6-a98e-dca52203cd87 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:04:39.480617 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4766fc77-36c7-40c6-a98e-dca52203cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:04:39.548718 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 655/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:04:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 07:04:39.571270 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d0926-b89d-4571-88a6-b5b2da9e6881 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:39.672046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:39.680810 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d0926-b89d-4571-88a6-b5b2da9e6881 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:39.717994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3242e7-31e0-4f00-b69d-6ce817976abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:39.718639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3242e7-31e0-4f00-b69d-6ce817976abe None admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:39.718915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3242e7-31e0-4f00-b69d-6ce817976abe None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:39.719191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3242e7-31e0-4f00-b69d-6ce817976abe None admin] PATH_INFO: `/v3/services/placement` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:39.719820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3242e7-31e0-4f00-b69d-6ce817976abe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:39.721233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3242e7-31e0-4f00-b69d-6ce817976abe None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application [None req-ea3242e7-31e0-4f00-b69d-6ce817976abe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 07:04:39.730601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 07:04:39.731755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application with Lock( Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self._enter() Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application return self.creator() Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application created_value = creator( Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: ERROR keystone.server.flask.application Aug 05 07:04:39.732594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 649/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Aug 5 07:04:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 07:04:39.738195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766fc77-36c7-40c6-a98e-dca52203cd87 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:39.817606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:39.844162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766fc77-36c7-40c6-a98e-dca52203cd87 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:39.881044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45020fb8-322a-40d7-85b4-423ae2d41a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:39.881668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45020fb8-322a-40d7-85b4-423ae2d41a98 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:39.881942 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45020fb8-322a-40d7-85b4-423ae2d41a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:39.882215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45020fb8-322a-40d7-85b4-423ae2d41a98 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:39.882890 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45020fb8-322a-40d7-85b4-423ae2d41a98 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:04:39.883193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45020fb8-322a-40d7-85b4-423ae2d41a98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:39.884557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45020fb8-322a-40d7-85b4-423ae2d41a98 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:39.890230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 656/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Aug 5 07:04:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:04:39.897239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3242e7-31e0-4f00-b69d-6ce817976abe None admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:04:40.001671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3242e7-31e0-4f00-b69d-6ce817976abe None admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:04:40.037414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92467c-f773-487b-a6bb-d605b6be5c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:04:40.038027 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92467c-f773-487b-a6bb-d605b6be5c03 None admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:04:40.038299 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92467c-f773-487b-a6bb-d605b6be5c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:04:40.038569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92467c-f773-487b-a6bb-d605b6be5c03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:04:40.039270 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92467c-f773-487b-a6bb-d605b6be5c03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:04:40.040638 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92467c-f773-487b-a6bb-d605b6be5c03 None admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:04:40.062193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 650/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:04:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:04:49.887305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=30 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:04:50.057369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:05:48.031975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bb5a6-d110-48cb-8f86-87f07cb26a8b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:48.032619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bb5a6-d110-48cb-8f86-87f07cb26a8b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:48.032619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bb5a6-d110-48cb-8f86-87f07cb26a8b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:48.034097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 657/1307] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:05:48.040163 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d38632-3bcb-4bc4-99b3-aa034738d006 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:48.041149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d38632-3bcb-4bc4-99b3-aa034738d006 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:48.041670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d38632-3bcb-4bc4-99b3-aa034738d006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:48.137778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-93d38632-3bcb-4bc4-99b3-aa034738d006 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:05:48.139671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-93d38632-3bcb-4bc4-99b3-aa034738d006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:48.350301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 651/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:05:48.403329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7bec8-5b08-4dc3-ac8f-5737002cc556 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:48.404165 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7bec8-5b08-4dc3-ac8f-5737002cc556 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:48.404981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7bec8-5b08-4dc3-ac8f-5737002cc556 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:48.408235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 658/1309] 10.222.0.27 () {54 vars in 965 bytes} [Fri Aug 5 07:05:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:05:48.415838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b115b-7975-402b-aab4-088e4174f4f4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:48.416305 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b115b-7975-402b-aab4-088e4174f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:48.417005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b115b-7975-402b-aab4-088e4174f4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:48.588359 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-508b115b-7975-402b-aab4-088e4174f4f4 None None] MFA Rules not processed for user `9c4ce8a3f876467f93e7c9efd9e33390`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:05:48.590159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-508b115b-7975-402b-aab4-088e4174f4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:48.629564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:05:48.734680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 652/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Fri Aug 5 07:05:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:05:48.748571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7bec8-5b08-4dc3-ac8f-5737002cc556 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:05:48.751477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d3f7bec8-5b08-4dc3-ac8f-5737002cc556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:48.948627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7bec8-5b08-4dc3-ac8f-5737002cc556 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:05:49.065552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90774a-d97d-4778-9941-387bf82cb64a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:05:49.066606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90774a-d97d-4778-9941-387bf82cb64a service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:49.066606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90774a-d97d-4778-9941-387bf82cb64a service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:49.066862 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90774a-d97d-4778-9941-387bf82cb64a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:49.068624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9f90774a-d97d-4778-9941-387bf82cb64a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:49.144027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:05:49.215475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90774a-d97d-4778-9941-387bf82cb64a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:05:49.217427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90774a-d97d-4778-9941-387bf82cb64a service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:05:49.240953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 659/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:05:51.995073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c76fe6-70ed-4535-aaaf-36856b204af7 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:51.995648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c76fe6-70ed-4535-aaaf-36856b204af7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:51.995822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c76fe6-70ed-4535-aaaf-36856b204af7 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:51.997474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 653/1312] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:05:52.003922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffb387-390a-4d9d-9324-326cd11d78d3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:52.004534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffb387-390a-4d9d-9324-326cd11d78d3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:52.004534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffb387-390a-4d9d-9324-326cd11d78d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:52.100392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-95ffb387-390a-4d9d-9324-326cd11d78d3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:05:52.101671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-95ffb387-390a-4d9d-9324-326cd11d78d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:52.210519 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 660/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:05:52.264487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319de2c4-8253-4d54-ab72-bc0f8974baaa None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:52.264860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319de2c4-8253-4d54-ab72-bc0f8974baaa None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:52.265232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319de2c4-8253-4d54-ab72-bc0f8974baaa None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:52.266940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 654/1314] 10.222.0.27 () {54 vars in 965 bytes} [Fri Aug 5 07:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:05:52.273822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1077-e8ca-41ed-bf52-39101b0c0299 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:52.274226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1077-e8ca-41ed-bf52-39101b0c0299 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:52.274534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1077-e8ca-41ed-bf52-39101b0c0299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:52.290202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:05:52.371792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-73ce1077-e8ca-41ed-bf52-39101b0c0299 None None] MFA Rules not processed for user `9c4ce8a3f876467f93e7c9efd9e33390`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:05:52.373175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-73ce1077-e8ca-41ed-bf52-39101b0c0299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:52.465096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 661/1315] 10.222.0.27 () {58 vars in 1062 bytes} [Fri Aug 5 07:05:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:05:52.474413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319de2c4-8253-4d54-ab72-bc0f8974baaa None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:05:52.476058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-319de2c4-8253-4d54-ab72-bc0f8974baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:52.655398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319de2c4-8253-4d54-ab72-bc0f8974baaa None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:05:52.764846 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:05:52.768888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40fe07-8458-47a2-b723-d3d545e4afc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:05:52.769781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40fe07-8458-47a2-b723-d3d545e4afc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:52.770112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40fe07-8458-47a2-b723-d3d545e4afc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:52.771016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40fe07-8458-47a2-b723-d3d545e4afc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:52.774039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3d40fe07-8458-47a2-b723-d3d545e4afc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:52.957082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40fe07-8458-47a2-b723-d3d545e4afc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:05:52.958832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40fe07-8458-47a2-b723-d3d545e4afc7 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:05:52.984654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 655/1316] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:05:55.662741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab05b4-ed59-4f44-984c-d4d64d6b8e49 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:55.663296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab05b4-ed59-4f44-984c-d4d64d6b8e49 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:55.663296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab05b4-ed59-4f44-984c-d4d64d6b8e49 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:55.664574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 662/1317] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:05:55.670334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3577b65-837f-4585-a998-f508ceba3a8c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:55.670831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3577b65-837f-4585-a998-f508ceba3a8c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:55.670986 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3577b65-837f-4585-a998-f508ceba3a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:55.758847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d3577b65-837f-4585-a998-f508ceba3a8c None None] MFA Rules not processed for user `11359104efc34da0960a532caed4dfd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:05:55.760112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d3577b65-837f-4585-a998-f508ceba3a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:55.823308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:05:55.877275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 656/1318] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:05:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:05:55.921939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab05b4-ed59-4f44-984c-d4d64d6b8e49 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:05:55.923588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5fab05b4-ed59-4f44-984c-d4d64d6b8e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:56.041299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab05b4-ed59-4f44-984c-d4d64d6b8e49 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:05:56.044403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:05:56.129861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f5644-aec7-4774-8dd7-9c1c1b22c383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:05:56.130505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f5644-aec7-4774-8dd7-9c1c1b22c383 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:56.130780 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f5644-aec7-4774-8dd7-9c1c1b22c383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:56.131075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f5644-aec7-4774-8dd7-9c1c1b22c383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:56.132986 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-275f5644-aec7-4774-8dd7-9c1c1b22c383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:56.265188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f5644-aec7-4774-8dd7-9c1c1b22c383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:05:56.266846 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f5644-aec7-4774-8dd7-9c1c1b22c383 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:05:56.289378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 663/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:05:55 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:05:59.222556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4a2f4-b034-4b3d-bb0f-ad88231c0bbe None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:59.223135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4a2f4-b034-4b3d-bb0f-ad88231c0bbe None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:59.223135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4a2f4-b034-4b3d-bb0f-ad88231c0bbe None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:59.224447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 657/1320] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:05:59.230228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7306ebd-2f69-4be3-a0c6-068918d8ed60 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:59.230769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7306ebd-2f69-4be3-a0c6-068918d8ed60 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:59.230769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7306ebd-2f69-4be3-a0c6-068918d8ed60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:59.276850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:05:59.313777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f7306ebd-2f69-4be3-a0c6-068918d8ed60 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:05:59.315553 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f7306ebd-2f69-4be3-a0c6-068918d8ed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:59.441686 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 664/1321] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:05:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:05:59.482347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4a2f4-b034-4b3d-bb0f-ad88231c0bbe None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:05:59.483916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4ff4a2f4-b034-4b3d-bb0f-ad88231c0bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:59.599542 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4a2f4-b034-4b3d-bb0f-ad88231c0bbe None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:05:59.682656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ef41e-1f3e-45ed-bb69-60bedbfb31de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:05:59.683367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ef41e-1f3e-45ed-bb69-60bedbfb31de service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:05:59.683693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ef41e-1f3e-45ed-bb69-60bedbfb31de service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:05:59.684010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ef41e-1f3e-45ed-bb69-60bedbfb31de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:05:59.685995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-279ef41e-1f3e-45ed-bb69-60bedbfb31de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:05:59.694410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:05:59.810161 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ef41e-1f3e-45ed-bb69-60bedbfb31de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:05:59.811756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ef41e-1f3e-45ed-bb69-60bedbfb31de service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:05:59.832089 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 658/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:05:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:06:02.941744 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb91ea-ed3f-4bca-9fc2-0a902100a374 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:02.942698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb91ea-ed3f-4bca-9fc2-0a902100a374 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:02.942698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb91ea-ed3f-4bca-9fc2-0a902100a374 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:02.945377 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 665/1323] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:06:02.951176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f490ebb-35d9-463b-9723-5c8d35e7ea95 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:02.952085 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f490ebb-35d9-463b-9723-5c8d35e7ea95 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:02.952417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f490ebb-35d9-463b-9723-5c8d35e7ea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:03.033075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6f490ebb-35d9-463b-9723-5c8d35e7ea95 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:03.034361 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6f490ebb-35d9-463b-9723-5c8d35e7ea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:03.127005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:03.187031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 659/1324] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:03.229008 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb91ea-ed3f-4bca-9fc2-0a902100a374 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:06:03.231114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8aeb91ea-ed3f-4bca-9fc2-0a902100a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:03.378993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb91ea-ed3f-4bca-9fc2-0a902100a374 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:06:03.396297 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:03.498189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62f44e-5edc-4ba9-a825-9d629959db36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:06:03.499261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62f44e-5edc-4ba9-a825-9d629959db36 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:03.499664 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62f44e-5edc-4ba9-a825-9d629959db36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:03.500091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62f44e-5edc-4ba9-a825-9d629959db36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:03.503370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cc62f44e-5edc-4ba9-a825-9d629959db36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:03.687080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62f44e-5edc-4ba9-a825-9d629959db36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:06:03.689759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62f44e-5edc-4ba9-a825-9d629959db36 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:06:03.728518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 666/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:06:05.886034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47b0b9-78d7-41a0-a6bc-bcbd43e33c9b None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:05.886627 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47b0b9-78d7-41a0-a6bc-bcbd43e33c9b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:05.887031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47b0b9-78d7-41a0-a6bc-bcbd43e33c9b None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:05.889639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 660/1326] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:05.898673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709970e-ab6f-4c07-9d3f-aeaa50cdc3eb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:05.899489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709970e-ab6f-4c07-9d3f-aeaa50cdc3eb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:05.899653 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709970e-ab6f-4c07-9d3f-aeaa50cdc3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:05.961291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:05.982429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5709970e-ab6f-4c07-9d3f-aeaa50cdc3eb None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:05.983589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5709970e-ab6f-4c07-9d3f-aeaa50cdc3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:06.099419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 667/1327] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:06.141085 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47b0b9-78d7-41a0-a6bc-bcbd43e33c9b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:06:06.143130 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cd47b0b9-78d7-41a0-a6bc-bcbd43e33c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:06.293506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47b0b9-78d7-41a0-a6bc-bcbd43e33c9b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:06:06.419353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2cf62-5049-4a2c-9668-7d51c5ebb826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:06:06.419977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2cf62-5049-4a2c-9668-7d51c5ebb826 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:06.420250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2cf62-5049-4a2c-9668-7d51c5ebb826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:06.420517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2cf62-5049-4a2c-9668-7d51c5ebb826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:06.422279 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-31f2cf62-5049-4a2c-9668-7d51c5ebb826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:06.441866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:06.559746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2cf62-5049-4a2c-9668-7d51c5ebb826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:06:06.561177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2cf62-5049-4a2c-9668-7d51c5ebb826 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:06:06.582107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 661/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:06:08.676277 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a03838-0bfc-4938-972e-952bcf7dbb90 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:08.676872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a03838-0bfc-4938-972e-952bcf7dbb90 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:08.677180 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a03838-0bfc-4938-972e-952bcf7dbb90 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:08.678862 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 668/1329] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:08.685341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a09830-344e-4b39-84dd-625822bf7497 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:08.686235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a09830-344e-4b39-84dd-625822bf7497 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:08.686403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a09830-344e-4b39-84dd-625822bf7497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:08.766951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-85a09830-344e-4b39-84dd-625822bf7497 None None] MFA Rules not processed for user `11359104efc34da0960a532caed4dfd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:08.768196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-85a09830-344e-4b39-84dd-625822bf7497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:08.867064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:08.905137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 662/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:08.946782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a03838-0bfc-4938-972e-952bcf7dbb90 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:06:08.948413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-08a03838-0bfc-4938-972e-952bcf7dbb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:09.069338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a03838-0bfc-4938-972e-952bcf7dbb90 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:06:09.092596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:09.167603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c20229-9302-414b-abb6-6a1faac1bf9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:06:09.168140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c20229-9302-414b-abb6-6a1faac1bf9c service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:09.168420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c20229-9302-414b-abb6-6a1faac1bf9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:09.168695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c20229-9302-414b-abb6-6a1faac1bf9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:09.170457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-23c20229-9302-414b-abb6-6a1faac1bf9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:09.314236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c20229-9302-414b-abb6-6a1faac1bf9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:06:09.315709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c20229-9302-414b-abb6-6a1faac1bf9c service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:06:09.336609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 669/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:06:11.719627 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dacc5a-be0b-43c0-a655-d11ebc240a5e None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:11.720162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dacc5a-be0b-43c0-a655-d11ebc240a5e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:11.720535 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dacc5a-be0b-43c0-a655-d11ebc240a5e None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:11.722991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 663/1332] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:11.731641 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad714b8a-088c-4c2e-af21-4bbd8152b803 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:11.732248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad714b8a-088c-4c2e-af21-4bbd8152b803 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:11.732823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad714b8a-088c-4c2e-af21-4bbd8152b803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:11.818656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:11.824560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ad714b8a-088c-4c2e-af21-4bbd8152b803 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:11.826864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ad714b8a-088c-4c2e-af21-4bbd8152b803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:11.984077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 670/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:12.021364 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dacc5a-be0b-43c0-a655-d11ebc240a5e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:06:12.023062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-59dacc5a-be0b-43c0-a655-d11ebc240a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:12.142603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dacc5a-be0b-43c0-a655-d11ebc240a5e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:06:12.225382 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5ad75-62a1-4173-a29a-85f2cf3734d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:06:12.226019 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ad75-62a1-4173-a29a-85f2cf3734d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:12.226296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ad75-62a1-4173-a29a-85f2cf3734d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:12.226566 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ad75-62a1-4173-a29a-85f2cf3734d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:12.228273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7eb5ad75-62a1-4173-a29a-85f2cf3734d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:12.259119 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:12.401881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5ad75-62a1-4173-a29a-85f2cf3734d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:06:12.404747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5ad75-62a1-4173-a29a-85f2cf3734d8 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:06:12.440734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 664/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:06:14.526228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037eee0-0a74-4b03-9971-06f29617d24f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:14.526796 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037eee0-0a74-4b03-9971-06f29617d24f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:14.526796 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037eee0-0a74-4b03-9971-06f29617d24f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:14.528130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 671/1335] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:14.534362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614365e6-c96d-4ba2-a97b-67067b6407ae None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:14.535013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614365e6-c96d-4ba2-a97b-67067b6407ae None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:14.535013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614365e6-c96d-4ba2-a97b-67067b6407ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:14.619542 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-614365e6-c96d-4ba2-a97b-67067b6407ae None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:14.620874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-614365e6-c96d-4ba2-a97b-67067b6407ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:14.709036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:14.737584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 665/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:06:14.778638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037eee0-0a74-4b03-9971-06f29617d24f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:06:14.780107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1037eee0-0a74-4b03-9971-06f29617d24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:14.923524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037eee0-0a74-4b03-9971-06f29617d24f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:06:14.956004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:15.007564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85326ec6-9e55-49f7-9777-fe7a993d8c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:06:15.008189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85326ec6-9e55-49f7-9777-fe7a993d8c36 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:15.008463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85326ec6-9e55-49f7-9777-fe7a993d8c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:15.008730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85326ec6-9e55-49f7-9777-fe7a993d8c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:15.010449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-85326ec6-9e55-49f7-9777-fe7a993d8c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:15.133847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85326ec6-9e55-49f7-9777-fe7a993d8c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:06:15.136530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85326ec6-9e55-49f7-9777-fe7a993d8c36 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:06:15.170464 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 672/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:06:17.834486 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36ace-6382-4bb4-8b91-f6dc4b6cc1b1 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:17.835057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36ace-6382-4bb4-8b91-f6dc4b6cc1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:17.835057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36ace-6382-4bb4-8b91-f6dc4b6cc1b1 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:17.836578 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 666/1338] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:17.842474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b9298-1e71-44f4-8751-00872c83b652 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:17.843079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b9298-1e71-44f4-8751-00872c83b652 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:17.843079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b9298-1e71-44f4-8751-00872c83b652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:17.933478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-628b9298-1e71-44f4-8751-00872c83b652 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:17.935900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-628b9298-1e71-44f4-8751-00872c83b652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:17.950802 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:18.084499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 673/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:18.140793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e36ace-6382-4bb4-8b91-f6dc4b6cc1b1 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:06:18.142752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-70e36ace-6382-4bb4-8b91-f6dc4b6cc1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:18.291691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e36ace-6382-4bb4-8b91-f6dc4b6cc1b1 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:06:18.404533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e537e4-9030-4334-a3f5-d3d85c3f959f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:06:18.405393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e537e4-9030-4334-a3f5-d3d85c3f959f service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:18.405808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e537e4-9030-4334-a3f5-d3d85c3f959f service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:18.406211 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e537e4-9030-4334-a3f5-d3d85c3f959f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:18.408989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-28e537e4-9030-4334-a3f5-d3d85c3f959f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:18.457749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:18.553150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e537e4-9030-4334-a3f5-d3d85c3f959f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:06:18.554703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e537e4-9030-4334-a3f5-d3d85c3f959f service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:06:18.589224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 667/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:06:22.975593 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794537f-9c55-4e24-9b61-fef64397dc25 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:22.976158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794537f-9c55-4e24-9b61-fef64397dc25 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:22.976158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794537f-9c55-4e24-9b61-fef64397dc25 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:22.977768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 674/1341] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:22.983414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99033c-ccd2-4436-b024-6184a2bbebf7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:22.983989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99033c-ccd2-4436-b024-6184a2bbebf7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:22.983989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99033c-ccd2-4436-b024-6184a2bbebf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:23.063002 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-1c99033c-ccd2-4436-b024-6184a2bbebf7 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:23.064226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1c99033c-ccd2-4436-b024-6184a2bbebf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:23.175874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:23.192011 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 668/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:23.233070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794537f-9c55-4e24-9b61-fef64397dc25 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:06:23.234516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1794537f-9c55-4e24-9b61-fef64397dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:23.361696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794537f-9c55-4e24-9b61-fef64397dc25 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:06:23.422978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:23.490266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824fdb4-3737-4743-87b3-6502c7971b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:06:23.491223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824fdb4-3737-4743-87b3-6502c7971b15 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:23.491694 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824fdb4-3737-4743-87b3-6502c7971b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:23.492197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824fdb4-3737-4743-87b3-6502c7971b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:23.495117 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c824fdb4-3737-4743-87b3-6502c7971b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:23.666867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824fdb4-3737-4743-87b3-6502c7971b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:06:23.668342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824fdb4-3737-4743-87b3-6502c7971b15 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:06:23.691823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 675/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:06:26.574645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c57899-6f19-4741-8a5f-7522fbc9d126 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:26.575197 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c57899-6f19-4741-8a5f-7522fbc9d126 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:26.575197 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c57899-6f19-4741-8a5f-7522fbc9d126 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:26.576502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 669/1344] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:26.582792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea83648-069d-4cf7-a8c5-14931544a888 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:26.583456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea83648-069d-4cf7-a8c5-14931544a888 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:26.583456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea83648-069d-4cf7-a8c5-14931544a888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:26.674477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7ea83648-069d-4cf7-a8c5-14931544a888 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:26.675718 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7ea83648-069d-4cf7-a8c5-14931544a888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:26.697013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:26.822408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 676/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:26.884976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c57899-6f19-4741-8a5f-7522fbc9d126 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:06:26.887023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b5c57899-6f19-4741-8a5f-7522fbc9d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:27.048921 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c57899-6f19-4741-8a5f-7522fbc9d126 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:06:27.145465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01a0c5-643b-491a-9d95-5f4b2d1769f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:06:27.146143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01a0c5-643b-491a-9d95-5f4b2d1769f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:27.146420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01a0c5-643b-491a-9d95-5f4b2d1769f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:27.146686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01a0c5-643b-491a-9d95-5f4b2d1769f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:27.148414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fb01a0c5-643b-491a-9d95-5f4b2d1769f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:27.207891 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:27.292315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01a0c5-643b-491a-9d95-5f4b2d1769f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:06:27.293872 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01a0c5-643b-491a-9d95-5f4b2d1769f7 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:06:27.317024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 670/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:06:32.179874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52112cd8-37a9-4e00-8082-9d245eda0253 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:32.180599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52112cd8-37a9-4e00-8082-9d245eda0253 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:32.180599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52112cd8-37a9-4e00-8082-9d245eda0253 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:32.181878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 677/1347] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:32.188099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31109e1a-5b09-426d-be93-adcb0270a0b8 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:32.188985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31109e1a-5b09-426d-be93-adcb0270a0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:32.188985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31109e1a-5b09-426d-be93-adcb0270a0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:32.271941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-31109e1a-5b09-426d-be93-adcb0270a0b8 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:32.274872 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-31109e1a-5b09-426d-be93-adcb0270a0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:32.450758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:32.469474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 671/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:06:32.527505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52112cd8-37a9-4e00-8082-9d245eda0253 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:06:32.529454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-52112cd8-37a9-4e00-8082-9d245eda0253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:32.690410 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52112cd8-37a9-4e00-8082-9d245eda0253 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:06:32.755353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:32.799234 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6134a29-4e30-41c8-9798-a0e977866822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:06:32.800314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6134a29-4e30-41c8-9798-a0e977866822 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:32.800807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6134a29-4e30-41c8-9798-a0e977866822 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:32.801330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6134a29-4e30-41c8-9798-a0e977866822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:32.804547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d6134a29-4e30-41c8-9798-a0e977866822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:32.949365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6134a29-4e30-41c8-9798-a0e977866822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:06:32.950824 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6134a29-4e30-41c8-9798-a0e977866822 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:06:32.977468 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 678/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:06:38.771507 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76fd1-7f13-4bcc-8765-f53a4dae3191 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:38.772279 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76fd1-7f13-4bcc-8765-f53a4dae3191 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:38.772279 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76fd1-7f13-4bcc-8765-f53a4dae3191 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:38.773496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 672/1350] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:38.782803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8c79d-4412-4ff4-b3cc-4918cc5848f3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:38.782803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8c79d-4412-4ff4-b3cc-4918cc5848f3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:38.783620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8c79d-4412-4ff4-b3cc-4918cc5848f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:38.946723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e2a8c79d-4412-4ff4-b3cc-4918cc5848f3 None None] MFA Rules not processed for user `33213d31b1394cdfb5b447f4f4952b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:38.949291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e2a8c79d-4412-4ff4-b3cc-4918cc5848f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:38.992340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:39.162915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 679/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:06:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:43.968372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724deeb-d385-4599-a7b3-8c6cae271760 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:43.968372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724deeb-d385-4599-a7b3-8c6cae271760 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:43.968372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724deeb-d385-4599-a7b3-8c6cae271760 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:43.969646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 673/1352] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:06:43.976183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a267275-4f80-4fea-83b8-40a947833d22 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:43.976846 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a267275-4f80-4fea-83b8-40a947833d22 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:43.977450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a267275-4f80-4fea-83b8-40a947833d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:44.114228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3a267275-4f80-4fea-83b8-40a947833d22 None None] MFA Rules not processed for user `33213d31b1394cdfb5b447f4f4952b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:44.115528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3a267275-4f80-4fea-83b8-40a947833d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:44.234078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:44.268432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 680/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:06:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:45.908498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024ddb1-78ff-442b-844b-d737f71fb5b6 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:45.908498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024ddb1-78ff-442b-844b-d737f71fb5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:45.909567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024ddb1-78ff-442b-844b-d737f71fb5b6 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:45.910765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 674/1354] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:45.916434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eea6b-65b4-4654-922c-baa8528ecbe5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:45.917255 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eea6b-65b4-4654-922c-baa8528ecbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:45.917255 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eea6b-65b4-4654-922c-baa8528ecbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:46.031187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-695eea6b-65b4-4654-922c-baa8528ecbe5 None None] MFA Rules not processed for user `33213d31b1394cdfb5b447f4f4952b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:46.032417 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-695eea6b-65b4-4654-922c-baa8528ecbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:46.215003 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 681/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:06:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:06:49.697609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489d01e-633a-449c-8485-715736a549bb None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:49.698510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489d01e-633a-449c-8485-715736a549bb None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:49.698510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489d01e-633a-449c-8485-715736a549bb None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:49.700082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 675/1356] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:49.706737 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64467-25e9-4b2c-8c6c-2fe5a3d20359 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:49.707719 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64467-25e9-4b2c-8c6c-2fe5a3d20359 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:49.707719 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece64467-25e9-4b2c-8c6c-2fe5a3d20359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:49.755280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:49.803287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ece64467-25e9-4b2c-8c6c-2fe5a3d20359 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:49.804428 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ece64467-25e9-4b2c-8c6c-2fe5a3d20359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:49.953105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 682/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:50.019252 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107c09c-8446-48b9-b425-c786daa865a3 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:50.020193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107c09c-8446-48b9-b425-c786daa865a3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:50.020678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107c09c-8446-48b9-b425-c786daa865a3 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:50.022775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 676/1358] 10.222.0.27 () {54 vars in 962 bytes} [Fri Aug 5 07:06:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:06:50.036649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a31601-1aaa-45cb-8b12-d64d1c01fa95 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:50.037102 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a31601-1aaa-45cb-8b12-d64d1c01fa95 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:50.037237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a31601-1aaa-45cb-8b12-d64d1c01fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:50.206043 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c6a31601-1aaa-45cb-8b12-d64d1c01fa95 None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:50.208226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c6a31601-1aaa-45cb-8b12-d64d1c01fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:50.296072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:50.382113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 683/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Aug 5 07:06:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:50.396116 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107c09c-8446-48b9-b425-c786daa865a3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:06:50.397904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3107c09c-8446-48b9-b425-c786daa865a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:50.602070 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107c09c-8446-48b9-b425-c786daa865a3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:06:50.691170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:50.752405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6331b-170e-4bb5-94bb-81fa31f5d5f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:06:50.753603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6331b-170e-4bb5-94bb-81fa31f5d5f3 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:50.753603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6331b-170e-4bb5-94bb-81fa31f5d5f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:50.754006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6331b-170e-4bb5-94bb-81fa31f5d5f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:50.755524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-61b6331b-170e-4bb5-94bb-81fa31f5d5f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:50.884128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6331b-170e-4bb5-94bb-81fa31f5d5f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:06:50.885987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b6331b-170e-4bb5-94bb-81fa31f5d5f3 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:06:50.908265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 677/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:06:53.403955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384974b-a3be-4f02-8d3e-19cdbdf7f364 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:53.404648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384974b-a3be-4f02-8d3e-19cdbdf7f364 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:53.405272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384974b-a3be-4f02-8d3e-19cdbdf7f364 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:53.408320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 684/1361] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:53.414382 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b9a60-91df-4790-8a3a-6dd26453a6da None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:53.415167 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b9a60-91df-4790-8a3a-6dd26453a6da None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:53.415167 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b9a60-91df-4790-8a3a-6dd26453a6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:53.493239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-128b9a60-91df-4790-8a3a-6dd26453a6da None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:53.494443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-128b9a60-91df-4790-8a3a-6dd26453a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:53.540453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:53.617961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 678/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:06:53.663406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384974b-a3be-4f02-8d3e-19cdbdf7f364 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:06:53.664981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6384974b-a3be-4f02-8d3e-19cdbdf7f364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:53.862663 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384974b-a3be-4f02-8d3e-19cdbdf7f364 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:06:53.876471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:54.087570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7281df-7fba-4d2b-bcc0-0a59a7578701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:06:54.088606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7281df-7fba-4d2b-bcc0-0a59a7578701 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:54.089129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7281df-7fba-4d2b-bcc0-0a59a7578701 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:54.089619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7281df-7fba-4d2b-bcc0-0a59a7578701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:54.092748 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bb7281df-7fba-4d2b-bcc0-0a59a7578701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:54.225512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7281df-7fba-4d2b-bcc0-0a59a7578701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:06:54.227300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7281df-7fba-4d2b-bcc0-0a59a7578701 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:06:54.251393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 685/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:06:56.741508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeccc6d-e2f4-4bc2-8a9b-c44da3683742 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:56.747426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeccc6d-e2f4-4bc2-8a9b-c44da3683742 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:56.747426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeccc6d-e2f4-4bc2-8a9b-c44da3683742 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:56.747426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 679/1364] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:56.754168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c05d7-ab84-41b1-a646-9fa47757945e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:56.754697 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c05d7-ab84-41b1-a646-9fa47757945e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:56.755101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c05d7-ab84-41b1-a646-9fa47757945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:56.780759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:56.868263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b95c05d7-ab84-41b1-a646-9fa47757945e None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:56.870080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b95c05d7-ab84-41b1-a646-9fa47757945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:57.025642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 686/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:06:57.081185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec4aae-4089-4284-b94e-1c191c3be424 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:57.083074 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec4aae-4089-4284-b94e-1c191c3be424 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:57.083534 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec4aae-4089-4284-b94e-1c191c3be424 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:57.087535 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 680/1366] 10.222.0.27 () {54 vars in 962 bytes} [Fri Aug 5 07:06:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:57.098416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba570fd1-9098-4cd0-9b67-e53758d36050 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:57.098416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba570fd1-9098-4cd0-9b67-e53758d36050 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:57.098416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba570fd1-9098-4cd0-9b67-e53758d36050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:57.208720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ba570fd1-9098-4cd0-9b67-e53758d36050 None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:57.210276 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ba570fd1-9098-4cd0-9b67-e53758d36050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:57.254847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:57.376642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 687/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Aug 5 07:06:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:57.386266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec4aae-4089-4284-b94e-1c191c3be424 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:06:57.388076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-dcec4aae-4089-4284-b94e-1c191c3be424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:57.579130 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec4aae-4089-4284-b94e-1c191c3be424 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:06:57.607087 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:57.775999 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f852-63e6-4b18-ad6c-b74061a4a106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:06:57.777069 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f852-63e6-4b18-ad6c-b74061a4a106 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:57.777597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f852-63e6-4b18-ad6c-b74061a4a106 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:57.778077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f852-63e6-4b18-ad6c-b74061a4a106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:57.781300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6429f852-63e6-4b18-ad6c-b74061a4a106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:57.922015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f852-63e6-4b18-ad6c-b74061a4a106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:06:57.923533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f852-63e6-4b18-ad6c-b74061a4a106 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:06:57.944091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 681/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:06:59.017503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f0e63-8e74-4b15-847e-6e9102eb4310 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:59.018361 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f0e63-8e74-4b15-847e-6e9102eb4310 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:59.018361 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f0e63-8e74-4b15-847e-6e9102eb4310 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:59.019783 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 688/1369] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:06:59.025703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab251d0-5974-4bcc-8f44-a7473d8c84ba None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:59.026497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab251d0-5974-4bcc-8f44-a7473d8c84ba None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:59.026497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab251d0-5974-4bcc-8f44-a7473d8c84ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:59.061351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:59.103027 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-bab251d0-5974-4bcc-8f44-a7473d8c84ba None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:59.104386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bab251d0-5974-4bcc-8f44-a7473d8c84ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:59.356278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 682/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:06:59.692692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92251ea2-ea26-4d70-9eb2-cc18331cd0c2 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:59.693628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92251ea2-ea26-4d70-9eb2-cc18331cd0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:59.694110 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92251ea2-ea26-4d70-9eb2-cc18331cd0c2 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:59.697152 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 689/1371] 10.222.0.27 () {54 vars in 964 bytes} [Fri Aug 5 07:06:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:06:59.704822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed7ea0-bc47-45f2-a662-91675d150344 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:06:59.705564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed7ea0-bc47-45f2-a662-91675d150344 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:06:59.706188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed7ea0-bc47-45f2-a662-91675d150344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:06:59.843154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-cbed7ea0-bc47-45f2-a662-91675d150344 None None] MFA Rules not processed for user `d44bcb27daeb4116835bbfb5dcb1dc33`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:06:59.844727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cbed7ea0-bc47-45f2-a662-91675d150344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:06:59.928545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:06:59.986625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 683/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Aug 5 07:06:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:06:59.997866 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92251ea2-ea26-4d70-9eb2-cc18331cd0c2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:00.000734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-92251ea2-ea26-4d70-9eb2-cc18331cd0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:00.150748 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92251ea2-ea26-4d70-9eb2-cc18331cd0c2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:00.203279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:00.213568 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22017a-55fc-4073-b05f-f4d54fe10fc5 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:00.214162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22017a-55fc-4073-b05f-f4d54fe10fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:00.214162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22017a-55fc-4073-b05f-f4d54fe10fc5 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:00.215506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 684/1373] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:00.221353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a5a72-79b3-4ef5-81f3-5e84cfb171ec None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:00.221634 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a5a72-79b3-4ef5-81f3-5e84cfb171ec None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:00.221966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a5a72-79b3-4ef5-81f3-5e84cfb171ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:00.253420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2dcce-0501-45f6-853b-285e0e4701ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:00.254233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2dcce-0501-45f6-853b-285e0e4701ba service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:00.254729 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2dcce-0501-45f6-853b-285e0e4701ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:00.255195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2dcce-0501-45f6-853b-285e0e4701ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:00.260212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7ce2dcce-0501-45f6-853b-285e0e4701ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:00.311701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-634a5a72-79b3-4ef5-81f3-5e84cfb171ec None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:00.315428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-634a5a72-79b3-4ef5-81f3-5e84cfb171ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:00.414720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2dcce-0501-45f6-853b-285e0e4701ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:00.416552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2dcce-0501-45f6-853b-285e0e4701ba service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:00.448559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 690/1374] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:06:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:00.526087 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 685/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:07:00.603733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2dcce-0501-45f6-853b-285e0e4701ba service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:00.605219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7ce2dcce-0501-45f6-853b-285e0e4701ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:00.698159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:00.759045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2dcce-0501-45f6-853b-285e0e4701ba service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:00.939187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf5e73-ec66-4c9e-a703-6cca85fc44d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:00.939989 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf5e73-ec66-4c9e-a703-6cca85fc44d2 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:00.940383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf5e73-ec66-4c9e-a703-6cca85fc44d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:00.940772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf5e73-ec66-4c9e-a703-6cca85fc44d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:00.943247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-88bf5e73-ec66-4c9e-a703-6cca85fc44d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:01.038888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:01.053236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf5e73-ec66-4c9e-a703-6cca85fc44d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:01.054944 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf5e73-ec66-4c9e-a703-6cca85fc44d2 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:01.076622 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 691/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:07:03.631168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425ab1d-57e9-4f18-af79-63efb27ebca2 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:03.631766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425ab1d-57e9-4f18-af79-63efb27ebca2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:03.631766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425ab1d-57e9-4f18-af79-63efb27ebca2 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:03.633146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 686/1377] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:03.639208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0046c-d848-4b6f-a6f9-cbd1238aff66 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:03.639939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0046c-d848-4b6f-a6f9-cbd1238aff66 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:03.639939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0046c-d848-4b6f-a6f9-cbd1238aff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:03.730118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cfd0046c-d848-4b6f-a6f9-cbd1238aff66 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:03.731536 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cfd0046c-d848-4b6f-a6f9-cbd1238aff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:03.859771 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 692/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:03.913081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425ab1d-57e9-4f18-af79-63efb27ebca2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:03.914691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6425ab1d-57e9-4f18-af79-63efb27ebca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:04.008756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:04.136868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425ab1d-57e9-4f18-af79-63efb27ebca2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:04.287882 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9bf6c-8148-4032-b02e-ac79251308c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:04.288871 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9bf6c-8148-4032-b02e-ac79251308c6 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:04.289443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9bf6c-8148-4032-b02e-ac79251308c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:04.289785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9bf6c-8148-4032-b02e-ac79251308c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:04.292258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1df9bf6c-8148-4032-b02e-ac79251308c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:04.313424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:04.491231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9bf6c-8148-4032-b02e-ac79251308c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:04.494646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9bf6c-8148-4032-b02e-ac79251308c6 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:04.528719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 687/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:06.970382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367c53e-c02a-4ab6-9845-0829f001ee13 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:06.971010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367c53e-c02a-4ab6-9845-0829f001ee13 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:06.971010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367c53e-c02a-4ab6-9845-0829f001ee13 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:06.972663 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 693/1380] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:06.979216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cefb05-17cc-4080-bc09-726f05ef0b29 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:06.979779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cefb05-17cc-4080-bc09-726f05ef0b29 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:06.980696 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cefb05-17cc-4080-bc09-726f05ef0b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:07.098397 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-95cefb05-17cc-4080-bc09-726f05ef0b29 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:07.099798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-95cefb05-17cc-4080-bc09-726f05ef0b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:07.215031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:07.241926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 688/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:07.301995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367c53e-c02a-4ab6-9845-0829f001ee13 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:07.303680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2367c53e-c02a-4ab6-9845-0829f001ee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:07.421513 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:07.574817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367c53e-c02a-4ab6-9845-0829f001ee13 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:07.730010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905de824-4961-4155-9751-55ed6698442d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:07.731068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905de824-4961-4155-9751-55ed6698442d service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:07.731523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905de824-4961-4155-9751-55ed6698442d service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:07.732009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905de824-4961-4155-9751-55ed6698442d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:07.734901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-905de824-4961-4155-9751-55ed6698442d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:07.781358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:07.892476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905de824-4961-4155-9751-55ed6698442d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:07.895841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905de824-4961-4155-9751-55ed6698442d service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:07.931837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 694/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:10.407315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233b9f-2f75-4ae9-85f0-831aecb142c2 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:10.408168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233b9f-2f75-4ae9-85f0-831aecb142c2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:10.408168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233b9f-2f75-4ae9-85f0-831aecb142c2 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:10.410462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 689/1383] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:07:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:07:10.418064 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d443200-8e95-484e-a561-9cbd5bcd06ec None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:10.418859 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d443200-8e95-484e-a561-9cbd5bcd06ec None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:10.418859 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d443200-8e95-484e-a561-9cbd5bcd06ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:10.549968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5d443200-8e95-484e-a561-9cbd5bcd06ec None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:10.552044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5d443200-8e95-484e-a561-9cbd5bcd06ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:10.685066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:10.689819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 695/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:10.736451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0233b9f-2f75-4ae9-85f0-831aecb142c2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:10.738257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c0233b9f-2f75-4ae9-85f0-831aecb142c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:10.978008 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0233b9f-2f75-4ae9-85f0-831aecb142c2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:11.067142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:11.146223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ecfb5-9e73-48cc-a114-fb23501322c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:11.147470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ecfb5-9e73-48cc-a114-fb23501322c5 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:11.147978 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ecfb5-9e73-48cc-a114-fb23501322c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:11.148514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ecfb5-9e73-48cc-a114-fb23501322c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:11.152414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a00ecfb5-9e73-48cc-a114-fb23501322c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:11.304388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ecfb5-9e73-48cc-a114-fb23501322c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:11.306176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ecfb5-9e73-48cc-a114-fb23501322c5 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:11.328102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 690/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:14.126010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660c7eb-5fb5-4b2d-a955-4dc4bb1b2bd1 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:14.126571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660c7eb-5fb5-4b2d-a955-4dc4bb1b2bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:14.126904 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660c7eb-5fb5-4b2d-a955-4dc4bb1b2bd1 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:14.130762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 696/1386] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:07:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:14.140434 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7d7f9-0539-49eb-8548-877885cc4985 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:14.141008 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7d7f9-0539-49eb-8548-877885cc4985 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:14.141481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7d7f9-0539-49eb-8548-877885cc4985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:14.264505 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-46a7d7f9-0539-49eb-8548-877885cc4985 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:14.266343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-46a7d7f9-0539-49eb-8548-877885cc4985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:14.316248 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:14.439056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 691/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:14.491792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660c7eb-5fb5-4b2d-a955-4dc4bb1b2bd1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:14.495792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0660c7eb-5fb5-4b2d-a955-4dc4bb1b2bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:14.772623 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660c7eb-5fb5-4b2d-a955-4dc4bb1b2bd1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:14.896206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:14.957778 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad699d15-2391-4438-9970-b85b86fa5bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:14.958982 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad699d15-2391-4438-9970-b85b86fa5bc0 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:14.959542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad699d15-2391-4438-9970-b85b86fa5bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:14.960005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad699d15-2391-4438-9970-b85b86fa5bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:14.963546 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ad699d15-2391-4438-9970-b85b86fa5bc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:15.083995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad699d15-2391-4438-9970-b85b86fa5bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:15.085585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad699d15-2391-4438-9970-b85b86fa5bc0 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:15.106316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 697/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:17.127479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cadf23-b30d-4347-9788-222d643242b8 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:17.128489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cadf23-b30d-4347-9788-222d643242b8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:17.128489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cadf23-b30d-4347-9788-222d643242b8 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:17.130552 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 692/1389] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:07:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:17.136480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca5d4a-7d0d-4b14-af5c-60af5888add4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:17.137283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca5d4a-7d0d-4b14-af5c-60af5888add4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:17.137283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca5d4a-7d0d-4b14-af5c-60af5888add4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:17.211957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-26ca5d4a-7d0d-4b14-af5c-60af5888add4 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:17.213288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-26ca5d4a-7d0d-4b14-af5c-60af5888add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:17.243587 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b8f66-69e7-49e5-aaf8-4d2536a67fe2 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:17.243837 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b8f66-69e7-49e5-aaf8-4d2536a67fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:17.244128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b8f66-69e7-49e5-aaf8-4d2536a67fe2 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:17.245526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 693/1390] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:07:17.251631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f0c6f-e613-45e7-8d9c-0d4b0f1a1991 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:17.252319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f0c6f-e613-45e7-8d9c-0d4b0f1a1991 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:17.252793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f0c6f-e613-45e7-8d9c-0d4b0f1a1991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:17.260840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:17.343182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 698/1391] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:17.372336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-332f0c6f-e613-45e7-8d9c-0d4b0f1a1991 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:17.374493 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-332f0c6f-e613-45e7-8d9c-0d4b0f1a1991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:17.404773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb7df-dadd-45ea-bf81-b7d1297b72cf None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:17.405245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb7df-dadd-45ea-bf81-b7d1297b72cf None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:17.405684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb7df-dadd-45ea-bf81-b7d1297b72cf None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:17.407915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 699/1392] 10.222.0.27 () {54 vars in 966 bytes} [Fri Aug 5 07:07:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:07:17.416767 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec731ab4-cf41-4652-8000-7edc669d2448 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:17.417629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec731ab4-cf41-4652-8000-7edc669d2448 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:17.417629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec731ab4-cf41-4652-8000-7edc669d2448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:17.511230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 694/1393] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:17.514536 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ec731ab4-cf41-4652-8000-7edc669d2448 None None] MFA Rules not processed for user `1c3d7cdad7f44f0f8df944ec7f69de26`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:17.515756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ec731ab4-cf41-4652-8000-7edc669d2448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:17.558499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f0c6f-e613-45e7-8d9c-0d4b0f1a1991 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:17.560067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-332f0c6f-e613-45e7-8d9c-0d4b0f1a1991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:17.568952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:17.601860 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 700/1394] 10.222.0.27 () {58 vars in 1063 bytes} [Fri Aug 5 07:07:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:07:17.613623 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec731ab4-cf41-4652-8000-7edc669d2448 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:17.622081 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec731ab4-cf41-4652-8000-7edc669d2448 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:17.651353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:17.692826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f0c6f-e613-45e7-8d9c-0d4b0f1a1991 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:17.713978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975ed8e-3255-402b-a284-d78ee58249bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c3d7cdad7f44f0f8df944ec7f69de26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:17.714605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975ed8e-3255-402b-a284-d78ee58249bf service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:17.714871 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975ed8e-3255-402b-a284-d78ee58249bf service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:17.715157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975ed8e-3255-402b-a284-d78ee58249bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:17.716819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5975ed8e-3255-402b-a284-d78ee58249bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:17.852648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dd55a-c4db-4678-b4a9-0a45f2470ea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:17.853303 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dd55a-c4db-4678-b4a9-0a45f2470ea9 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:17.853582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dd55a-c4db-4678-b4a9-0a45f2470ea9 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:17.853854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dd55a-c4db-4678-b4a9-0a45f2470ea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:17.855530 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b46dd55a-c4db-4678-b4a9-0a45f2470ea9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:17.857976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:17.864867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975ed8e-3255-402b-a284-d78ee58249bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:17.867571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975ed8e-3255-402b-a284-d78ee58249bf service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:17.893088 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 701/1395] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:07:17.991115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dd55a-c4db-4678-b4a9-0a45f2470ea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:17.993530 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dd55a-c4db-4678-b4a9-0a45f2470ea9 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:18.027326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 695/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:07:18.817175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec3103-8a41-4519-a510-e2ddbeb86478 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:18.817851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec3103-8a41-4519-a510-e2ddbeb86478 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:18.817851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec3103-8a41-4519-a510-e2ddbeb86478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:18.900683 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e1ec3103-8a41-4519-a510-e2ddbeb86478 None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:18.902928 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e1ec3103-8a41-4519-a510-e2ddbeb86478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:18.906560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:19.025699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 702/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:07:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:19.082051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e63dd-2212-4491-b085-b446c5f24e6c None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:19.082679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e63dd-2212-4491-b085-b446c5f24e6c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:19.082679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e63dd-2212-4491-b085-b446c5f24e6c None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:19.083946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 696/1398] 10.222.0.27 () {54 vars in 943 bytes} [Fri Aug 5 07:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:19.090833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17612a-5b95-4891-8596-dc24bc37f84e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:19.091115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17612a-5b95-4891-8596-dc24bc37f84e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:19.091399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17612a-5b95-4891-8596-dc24bc37f84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:19.177866 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4b17612a-5b95-4891-8596-dc24bc37f84e None None] MFA Rules not processed for user `8d83b456cec84bc5ab02a190099c0baf`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:19.179141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4b17612a-5b95-4891-8596-dc24bc37f84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:19.288453 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:19.324675 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 703/1399] 10.222.0.27 () {58 vars in 1040 bytes} [Fri Aug 5 07:07:19 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:19.336550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e63dd-2212-4491-b085-b446c5f24e6c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:19.338587 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1c5e63dd-2212-4491-b085-b446c5f24e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:19.488783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:19.497410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e63dd-2212-4491-b085-b446c5f24e6c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:19.642264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774c301-5ec7-4ff9-a3ae-cc630c891ac2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:19.642787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774c301-5ec7-4ff9-a3ae-cc630c891ac2 service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:19.643158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774c301-5ec7-4ff9-a3ae-cc630c891ac2 service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:19.643430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774c301-5ec7-4ff9-a3ae-cc630c891ac2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:19.645165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c774c301-5ec7-4ff9-a3ae-cc630c891ac2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:19.743038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774c301-5ec7-4ff9-a3ae-cc630c891ac2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:19.744651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774c301-5ec7-4ff9-a3ae-cc630c891ac2 service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:19.754424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 697/1400] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:07:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:07:20.212040 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51739fe9-9c74-4a3c-9be0-b1f88c20c079 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:20.212859 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51739fe9-9c74-4a3c-9be0-b1f88c20c079 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:20.212859 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51739fe9-9c74-4a3c-9be0-b1f88c20c079 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:20.214246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 704/1401] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:07:20.220865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9375b9-cbb9-45b2-9376-7fb1b1a1e1ff None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:20.221583 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9375b9-cbb9-45b2-9376-7fb1b1a1e1ff None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:20.221583 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9375b9-cbb9-45b2-9376-7fb1b1a1e1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:20.263946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:20.302480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0d9375b9-cbb9-45b2-9376-7fb1b1a1e1ff None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:20.309028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0d9375b9-cbb9-45b2-9376-7fb1b1a1e1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:20.473993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 698/1402] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:07:20.533816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51739fe9-9c74-4a3c-9be0-b1f88c20c079 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:20.535395 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-51739fe9-9c74-4a3c-9be0-b1f88c20c079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:20.727728 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51739fe9-9c74-4a3c-9be0-b1f88c20c079 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:20.835339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:20.938376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0be14-3943-4133-a2e0-a753c7e4b836 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:20.939378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0be14-3943-4133-a2e0-a753c7e4b836 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:20.939656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0be14-3943-4133-a2e0-a753c7e4b836 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:20.940056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0be14-3943-4133-a2e0-a753c7e4b836 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:20.943246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a4a0be14-3943-4133-a2e0-a753c7e4b836 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:21.080806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0be14-3943-4133-a2e0-a753c7e4b836 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:21.082418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0be14-3943-4133-a2e0-a753c7e4b836 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:21.113226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 705/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:23.254278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fcbee-4ec7-4824-a02f-24d002b954e6 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:23.254845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fcbee-4ec7-4824-a02f-24d002b954e6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:23.254845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fcbee-4ec7-4824-a02f-24d002b954e6 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:23.260434 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 699/1404] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:07:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:23.262408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a1541-d8f3-4653-b92a-cda1ea0fab55 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:23.263347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a1541-d8f3-4653-b92a-cda1ea0fab55 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:23.263879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a1541-d8f3-4653-b92a-cda1ea0fab55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:23.343912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-839a1541-d8f3-4653-b92a-cda1ea0fab55 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:23.345211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-839a1541-d8f3-4653-b92a-cda1ea0fab55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:23.360757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:23.460056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 706/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:23.504526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fcbee-4ec7-4824-a02f-24d002b954e6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:23.506101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d13fcbee-4ec7-4824-a02f-24d002b954e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:23.632780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:23.699825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fcbee-4ec7-4824-a02f-24d002b954e6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:23.866928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc3d33-3b68-4a17-ae8a-af782ffa95d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:23.867731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc3d33-3b68-4a17-ae8a-af782ffa95d6 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:23.868016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc3d33-3b68-4a17-ae8a-af782ffa95d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:23.868285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc3d33-3b68-4a17-ae8a-af782ffa95d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:23.870080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-66bc3d33-3b68-4a17-ae8a-af782ffa95d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:23.957431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:23.988976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc3d33-3b68-4a17-ae8a-af782ffa95d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:23.990721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc3d33-3b68-4a17-ae8a-af782ffa95d6 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:24.010198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 700/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:26.102823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587055-f248-4e97-b691-c5ff4cf8ec88 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:26.103341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587055-f248-4e97-b691-c5ff4cf8ec88 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:26.103341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587055-f248-4e97-b691-c5ff4cf8ec88 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:26.105203 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 707/1407] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:26.112397 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6637-a0d8-4114-801d-cdc757682b38 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:26.112981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6637-a0d8-4114-801d-cdc757682b38 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:26.112981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6637-a0d8-4114-801d-cdc757682b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:26.202265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-537e6637-a0d8-4114-801d-cdc757682b38 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:26.203553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-537e6637-a0d8-4114-801d-cdc757682b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:26.332595 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 701/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:26.379436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80587055-f248-4e97-b691-c5ff4cf8ec88 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:26.381047 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-80587055-f248-4e97-b691-c5ff4cf8ec88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:26.595531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:26.602479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80587055-f248-4e97-b691-c5ff4cf8ec88 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:26.785264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a45f7-dd37-40c4-8a4a-9f5f0d02998d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:26.786063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a45f7-dd37-40c4-8a4a-9f5f0d02998d service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:26.786352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a45f7-dd37-40c4-8a4a-9f5f0d02998d service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:26.786652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a45f7-dd37-40c4-8a4a-9f5f0d02998d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:26.788479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6a6a45f7-dd37-40c4-8a4a-9f5f0d02998d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:26.910462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a45f7-dd37-40c4-8a4a-9f5f0d02998d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:26.914535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a45f7-dd37-40c4-8a4a-9f5f0d02998d service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:26.935764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 708/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:36.330842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=81 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:36.932793 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:42.907539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003a65b-7a0c-492a-9ba4-773712966ceb None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:42.908146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003a65b-7a0c-492a-9ba4-773712966ceb None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:42.908146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003a65b-7a0c-492a-9ba4-773712966ceb None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:42.909503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 702/1410] 10.222.0.27 () {54 vars in 918 bytes} [Fri Aug 5 07:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:42.915242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a915f03-1932-40c3-b558-6712cc77a320 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:42.915693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a915f03-1932-40c3-b558-6712cc77a320 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:42.915787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a915f03-1932-40c3-b558-6712cc77a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:42.990081 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5a915f03-1932-40c3-b558-6712cc77a320 None None] MFA Rules not processed for user `33213d31b1394cdfb5b447f4f4952b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:42.991297 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5a915f03-1932-40c3-b558-6712cc77a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:43.104156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 709/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Aug 5 07:07:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:43.118961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598485a-2e7d-4c23-b3f3-e5f7ce219076 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:43.119246 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598485a-2e7d-4c23-b3f3-e5f7ce219076 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:43.119521 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598485a-2e7d-4c23-b3f3-e5f7ce219076 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:43.120879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 703/1412] 10.222.0.27 () {54 vars in 918 bytes} [Fri Aug 5 07:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:43.125971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf58ce4-6658-459a-8ba5-96c85f5774ba None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:43.126257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf58ce4-6658-459a-8ba5-96c85f5774ba None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:43.126531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf58ce4-6658-459a-8ba5-96c85f5774ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:43.203515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:43.206790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-edf58ce4-6658-459a-8ba5-96c85f5774ba None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:43.208591 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-edf58ce4-6658-459a-8ba5-96c85f5774ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:43.333611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 710/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Aug 5 07:07:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:45.825952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bac20-e994-4ab7-b13b-1e0fdb17fe96 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:45.826515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bac20-e994-4ab7-b13b-1e0fdb17fe96 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:45.826515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bac20-e994-4ab7-b13b-1e0fdb17fe96 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:45.827826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:45.833359 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d171a43-7dd3-46fe-98c5-da8154f0f9ce None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:45.833800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d171a43-7dd3-46fe-98c5-da8154f0f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:45.833937 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d171a43-7dd3-46fe-98c5-da8154f0f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:45.903472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7d171a43-7dd3-46fe-98c5-da8154f0f9ce None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:45.904677 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7d171a43-7dd3-46fe-98c5-da8154f0f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:45.961699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:46.004553 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:46.048540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bac20-e994-4ab7-b13b-1e0fdb17fe96 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:46.050027 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5b1bac20-e994-4ab7-b13b-1e0fdb17fe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:46.212365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bac20-e994-4ab7-b13b-1e0fdb17fe96 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:46.294494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:46.341346 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ada00-0ef0-4fbe-b7aa-3ecb6ba42876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:46.341845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ada00-0ef0-4fbe-b7aa-3ecb6ba42876 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:46.342125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ada00-0ef0-4fbe-b7aa-3ecb6ba42876 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:46.342392 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ada00-0ef0-4fbe-b7aa-3ecb6ba42876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:46.344042 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-311ada00-0ef0-4fbe-b7aa-3ecb6ba42876 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:46.458913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ada00-0ef0-4fbe-b7aa-3ecb6ba42876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:46.461132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ada00-0ef0-4fbe-b7aa-3ecb6ba42876 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:46.483745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 705/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:47.410224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721f388-fe9b-4ac9-b7dc-ee4cd3fe3609 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:47.410828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721f388-fe9b-4ac9-b7dc-ee4cd3fe3609 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:47.410828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721f388-fe9b-4ac9-b7dc-ee4cd3fe3609 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:47.412105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 07:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:47.418196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd14f5-0e3d-4115-abae-5bd2a6422a97 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:47.418828 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd14f5-0e3d-4115-abae-5bd2a6422a97 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:47.418828 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd14f5-0e3d-4115-abae-5bd2a6422a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:47.508227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9bfd14f5-0e3d-4115-abae-5bd2a6422a97 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:47.509512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9bfd14f5-0e3d-4115-abae-5bd2a6422a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:47.542159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:47.624644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 07:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:47.779144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721f388-fe9b-4ac9-b7dc-ee4cd3fe3609 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:47.781291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7721f388-fe9b-4ac9-b7dc-ee4cd3fe3609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:47.936293 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721f388-fe9b-4ac9-b7dc-ee4cd3fe3609 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:47.980287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:48.058425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b29a7e-89b1-47b1-ba4a-f046999c0af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:48.058953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29a7e-89b1-47b1-ba4a-f046999c0af0 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:48.059234 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29a7e-89b1-47b1-ba4a-f046999c0af0 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:48.059516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29a7e-89b1-47b1-ba4a-f046999c0af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:48.061173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-26b29a7e-89b1-47b1-ba4a-f046999c0af0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:48.156451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b29a7e-89b1-47b1-ba4a-f046999c0af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:48.158095 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b29a7e-89b1-47b1-ba4a-f046999c0af0 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:48.176609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 713/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:49.060639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420e0a9-8ba4-4c38-811d-3c9bb03e319f None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:49.061304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420e0a9-8ba4-4c38-811d-3c9bb03e319f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:49.061304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420e0a9-8ba4-4c38-811d-3c9bb03e319f None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:49.062571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 07:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:49.068094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4a483-6852-4032-ae08-99152009f558 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:49.068612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4a483-6852-4032-ae08-99152009f558 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:49.068612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4a483-6852-4032-ae08-99152009f558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:49.130700 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:49.151557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6ff4a483-6852-4032-ae08-99152009f558 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:49.152804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6ff4a483-6852-4032-ae08-99152009f558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:49.250223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 07:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:49.400747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420e0a9-8ba4-4c38-811d-3c9bb03e319f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:49.402559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1420e0a9-8ba4-4c38-811d-3c9bb03e319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:49.567476 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420e0a9-8ba4-4c38-811d-3c9bb03e319f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:49.579917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:49.685674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4d90c-f421-4ff6-a9e1-6848912944bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:49.686202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4d90c-f421-4ff6-a9e1-6848912944bd service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:49.686475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4d90c-f421-4ff6-a9e1-6848912944bd service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:49.686745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4d90c-f421-4ff6-a9e1-6848912944bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:49.688452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-96e4d90c-f421-4ff6-a9e1-6848912944bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:49.784789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4d90c-f421-4ff6-a9e1-6848912944bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:49.786493 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4d90c-f421-4ff6-a9e1-6848912944bd service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:49.807307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 708/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:50.699077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83484bb6-8d45-453d-a607-257b5aa8b099 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:50.699639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83484bb6-8d45-453d-a607-257b5aa8b099 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:50.699639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83484bb6-8d45-453d-a607-257b5aa8b099 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:50.700961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 07:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:50.706030 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa26b82-cebc-470e-9d99-7a967e54937b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:50.706462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa26b82-cebc-470e-9d99-7a967e54937b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:50.706571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa26b82-cebc-470e-9d99-7a967e54937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:50.727842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:50.791283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9fa26b82-cebc-470e-9d99-7a967e54937b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:50.792516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9fa26b82-cebc-470e-9d99-7a967e54937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:50.900931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 07:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:51.051711 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83484bb6-8d45-453d-a607-257b5aa8b099 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:51.053302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-83484bb6-8d45-453d-a607-257b5aa8b099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:51.170422 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:51.219247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83484bb6-8d45-453d-a607-257b5aa8b099 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:51.344556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b612f-a951-4470-b8d7-ce6269947627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:51.345126 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b612f-a951-4470-b8d7-ce6269947627 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:51.345424 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b612f-a951-4470-b8d7-ce6269947627 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:51.345682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b612f-a951-4470-b8d7-ce6269947627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:51.347364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ce0b612f-a951-4470-b8d7-ce6269947627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:51.429578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:51.444330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b612f-a951-4470-b8d7-ce6269947627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:51.445979 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b612f-a951-4470-b8d7-ce6269947627 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:51.464767 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 716/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:52.345414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737c0a-89af-4b2d-b249-5c503b15a7a7 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:52.346348 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737c0a-89af-4b2d-b249-5c503b15a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:52.346348 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737c0a-89af-4b2d-b249-5c503b15a7a7 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:52.348669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 07:07:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:52.354238 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db48749-59e6-46f8-8206-c0c890e2998a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:52.354744 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db48749-59e6-46f8-8206-c0c890e2998a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:52.354852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db48749-59e6-46f8-8206-c0c890e2998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:52.448633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9db48749-59e6-46f8-8206-c0c890e2998a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:52.449929 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9db48749-59e6-46f8-8206-c0c890e2998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:52.550882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 07:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:52.701138 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b737c0a-89af-4b2d-b249-5c503b15a7a7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:52.702723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2b737c0a-89af-4b2d-b249-5c503b15a7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:52.798252 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:52.864373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b737c0a-89af-4b2d-b249-5c503b15a7a7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:52.987264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c21e1b-9ce1-4024-ba27-b0fc3fdaa3b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:52.988314 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c21e1b-9ce1-4024-ba27-b0fc3fdaa3b1 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:52.988314 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c21e1b-9ce1-4024-ba27-b0fc3fdaa3b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:52.988569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c21e1b-9ce1-4024-ba27-b0fc3fdaa3b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:52.990355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a3c21e1b-9ce1-4024-ba27-b0fc3fdaa3b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:53.045229 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:53.087932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c21e1b-9ce1-4024-ba27-b0fc3fdaa3b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:53.089589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c21e1b-9ce1-4024-ba27-b0fc3fdaa3b1 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:53.108778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 711/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:53.916365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada45f2f-6dde-48dd-9bbc-74afdd86b09b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:53.916984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada45f2f-6dde-48dd-9bbc-74afdd86b09b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:53.916984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada45f2f-6dde-48dd-9bbc-74afdd86b09b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:53.918328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 07:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:53.923537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d625fd-ddd7-4e82-a3d8-b743a353645d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:53.923964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d625fd-ddd7-4e82-a3d8-b743a353645d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:53.924073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d625fd-ddd7-4e82-a3d8-b743a353645d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:54.001753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a4d625fd-ddd7-4e82-a3d8-b743a353645d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:54.002964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a4d625fd-ddd7-4e82-a3d8-b743a353645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:54.105783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 07:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:54.254876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada45f2f-6dde-48dd-9bbc-74afdd86b09b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:54.256430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ada45f2f-6dde-48dd-9bbc-74afdd86b09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:54.311505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:54.414042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada45f2f-6dde-48dd-9bbc-74afdd86b09b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:54.536195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efd0f7-921f-4f7c-8614-1d957167efb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:54.536825 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd0f7-921f-4f7c-8614-1d957167efb1 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:54.537134 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd0f7-921f-4f7c-8614-1d957167efb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:54.537399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd0f7-921f-4f7c-8614-1d957167efb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:54.539046 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-96efd0f7-921f-4f7c-8614-1d957167efb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:54.546263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:54.637198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efd0f7-921f-4f7c-8614-1d957167efb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:54.638833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efd0f7-921f-4f7c-8614-1d957167efb1 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:54.658601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 719/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:55.452124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58dd14-098f-4189-a991-3435d0b9cc99 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:55.452738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58dd14-098f-4189-a991-3435d0b9cc99 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:55.452738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58dd14-098f-4189-a991-3435d0b9cc99 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:55.454036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 07:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:55.459192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575b63a-5bac-4dd2-bc83-03ba623614c5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:55.459656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575b63a-5bac-4dd2-bc83-03ba623614c5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:55.459753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575b63a-5bac-4dd2-bc83-03ba623614c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:55.539309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c575b63a-5bac-4dd2-bc83-03ba623614c5 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:55.540453 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c575b63a-5bac-4dd2-bc83-03ba623614c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:55.614575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:55.646899 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 07:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:55.795348 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58dd14-098f-4189-a991-3435d0b9cc99 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:55.797388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fb58dd14-098f-4189-a991-3435d0b9cc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:55.817101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:55.959272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58dd14-098f-4189-a991-3435d0b9cc99 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:56.048221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:56.076048 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50379fc8-8a50-4d82-bedb-c214facc4676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:56.076684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50379fc8-8a50-4d82-bedb-c214facc4676 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:56.076989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50379fc8-8a50-4d82-bedb-c214facc4676 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:56.077264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50379fc8-8a50-4d82-bedb-c214facc4676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:56.079156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-50379fc8-8a50-4d82-bedb-c214facc4676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:56.174431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50379fc8-8a50-4d82-bedb-c214facc4676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:56.176070 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50379fc8-8a50-4d82-bedb-c214facc4676 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:56.195920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 714/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:57.006987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6b03-7904-40b6-b24a-d6acacebe2e5 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:57.007552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6b03-7904-40b6-b24a-d6acacebe2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:57.007552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6b03-7904-40b6-b24a-d6acacebe2e5 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:57.008939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 07:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:57.014306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38271c8f-dcff-48f2-b27f-393f48a82c49 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:57.014707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38271c8f-dcff-48f2-b27f-393f48a82c49 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:57.014849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38271c8f-dcff-48f2-b27f-393f48a82c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:57.095031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-38271c8f-dcff-48f2-b27f-393f48a82c49 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:57.096250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-38271c8f-dcff-48f2-b27f-393f48a82c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:57.139778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:57.198115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 07:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:57.353348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b6b03-7904-40b6-b24a-d6acacebe2e5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:57.355006 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fb5b6b03-7904-40b6-b24a-d6acacebe2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:57.513577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b6b03-7904-40b6-b24a-d6acacebe2e5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:57.583365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:57.648227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c185759-8057-4f18-81d8-81df20cda503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:57.648857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c185759-8057-4f18-81d8-81df20cda503 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:57.649139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c185759-8057-4f18-81d8-81df20cda503 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:57.649437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c185759-8057-4f18-81d8-81df20cda503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:57.651458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5c185759-8057-4f18-81d8-81df20cda503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:57.744318 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c185759-8057-4f18-81d8-81df20cda503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:57.746012 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c185759-8057-4f18-81d8-81df20cda503 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:57.765050 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 722/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:07:58.575104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0745-749e-4f24-920e-a6477fd24390 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:58.575719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0745-749e-4f24-920e-a6477fd24390 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:58.575719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c0745-749e-4f24-920e-a6477fd24390 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:58.577146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 07:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:07:58.584346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ea60-b06c-4e38-9d74-b14c63f182e7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:58.584807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ea60-b06c-4e38-9d74-b14c63f182e7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:58.585065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ea60-b06c-4e38-9d74-b14c63f182e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:58.667804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-41a2ea60-b06c-4e38-9d74-b14c63f182e7 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:07:58.669058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-41a2ea60-b06c-4e38-9d74-b14c63f182e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:58.671368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:58.792337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 07:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:07:58.944392 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c0745-749e-4f24-920e-a6477fd24390 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:07:58.945896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e61c0745-749e-4f24-920e-a6477fd24390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:59.106869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c0745-749e-4f24-920e-a6477fd24390 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:07:59.135031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:07:59.226004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9938d2-eb0b-4f08-878f-94c747ebb2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:07:59.226632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9938d2-eb0b-4f08-878f-94c747ebb2bb service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:07:59.226909 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9938d2-eb0b-4f08-878f-94c747ebb2bb service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:07:59.227182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9938d2-eb0b-4f08-878f-94c747ebb2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:07:59.228830 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2d9938d2-eb0b-4f08-878f-94c747ebb2bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:07:59.328169 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9938d2-eb0b-4f08-878f-94c747ebb2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:07:59.329806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9938d2-eb0b-4f08-878f-94c747ebb2bb service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:07:59.348162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 717/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:01.247986 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefb08-117c-4906-8c0d-fe5009776930 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:01.248620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefb08-117c-4906-8c0d-fe5009776930 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:01.248620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefb08-117c-4906-8c0d-fe5009776930 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:01.249970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:01.256250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bddfa-c936-4635-998f-6bd43dfa55d5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:01.256833 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bddfa-c936-4635-998f-6bd43dfa55d5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:01.256833 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bddfa-c936-4635-998f-6bd43dfa55d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:01.305029 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:01.334250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0f4bddfa-c936-4635-998f-6bd43dfa55d5 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:01.335493 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0f4bddfa-c936-4635-998f-6bd43dfa55d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:01.452158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:01.490700 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffefb08-117c-4906-8c0d-fe5009776930 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:01.492276 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3ffefb08-117c-4906-8c0d-fe5009776930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:01.603240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffefb08-117c-4906-8c0d-fe5009776930 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:01.637269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:01.683913 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe065076-1eb0-4a00-8568-daea1de9ce93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:01.684549 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe065076-1eb0-4a00-8568-daea1de9ce93 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:01.684834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe065076-1eb0-4a00-8568-daea1de9ce93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:01.685141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe065076-1eb0-4a00-8568-daea1de9ce93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:01.686843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fe065076-1eb0-4a00-8568-daea1de9ce93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:01.802844 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe065076-1eb0-4a00-8568-daea1de9ce93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:01.804414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe065076-1eb0-4a00-8568-daea1de9ce93 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:01.823894 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 725/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:03.976438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12349109-6ba2-49ba-b9e8-f0b1719ba921 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:03.977030 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12349109-6ba2-49ba-b9e8-f0b1719ba921 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:03.977030 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12349109-6ba2-49ba-b9e8-f0b1719ba921 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:03.978355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:03.983743 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34759327-1356-4f87-a858-13bdf33a8e26 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:03.984171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34759327-1356-4f87-a858-13bdf33a8e26 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:03.984263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34759327-1356-4f87-a858-13bdf33a8e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:04.052237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-34759327-1356-4f87-a858-13bdf33a8e26 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:04.053486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-34759327-1356-4f87-a858-13bdf33a8e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:04.067143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:04.154790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:04.193469 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12349109-6ba2-49ba-b9e8-f0b1719ba921 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:04.195171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-12349109-6ba2-49ba-b9e8-f0b1719ba921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:04.304367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12349109-6ba2-49ba-b9e8-f0b1719ba921 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:04.317887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:04.385454 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16edf83-ec76-42e4-9f4b-eaa28b54a875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:04.386082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16edf83-ec76-42e4-9f4b-eaa28b54a875 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:04.386357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16edf83-ec76-42e4-9f4b-eaa28b54a875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:04.386644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16edf83-ec76-42e4-9f4b-eaa28b54a875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:04.388308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f16edf83-ec76-42e4-9f4b-eaa28b54a875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:04.512570 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16edf83-ec76-42e4-9f4b-eaa28b54a875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:04.514114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16edf83-ec76-42e4-9f4b-eaa28b54a875 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:04.535807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 720/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:06.852075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9dad-ca91-44d9-bfe1-4e961df87e26 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:06.852720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9dad-ca91-44d9-bfe1-4e961df87e26 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:06.852720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af9dad-ca91-44d9-bfe1-4e961df87e26 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:06.854025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:06.859492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73abe3-52ce-44f4-95ce-e7573bba8e61 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:06.859909 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73abe3-52ce-44f4-95ce-e7573bba8e61 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:06.860040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73abe3-52ce-44f4-95ce-e7573bba8e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:06.913657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:06.932717 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9b73abe3-52ce-44f4-95ce-e7573bba8e61 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:06.933989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9b73abe3-52ce-44f4-95ce-e7573bba8e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:07.049714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:07.089649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af9dad-ca91-44d9-bfe1-4e961df87e26 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:07.091226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d5af9dad-ca91-44d9-bfe1-4e961df87e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:07.210232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af9dad-ca91-44d9-bfe1-4e961df87e26 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:07.251664 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:07.290643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aee350-5e30-4a60-b87c-59b5b0cd6725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:07.291335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee350-5e30-4a60-b87c-59b5b0cd6725 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:07.291614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee350-5e30-4a60-b87c-59b5b0cd6725 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:07.291905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee350-5e30-4a60-b87c-59b5b0cd6725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:07.293633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-87aee350-5e30-4a60-b87c-59b5b0cd6725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:07.411034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aee350-5e30-4a60-b87c-59b5b0cd6725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:07.412475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aee350-5e30-4a60-b87c-59b5b0cd6725 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:07.431369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 728/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:09.541743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bea53-9d74-4a8f-ab2c-1511869b8346 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:09.542523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bea53-9d74-4a8f-ab2c-1511869b8346 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:09.542523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bea53-9d74-4a8f-ab2c-1511869b8346 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:09.543806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:09.549839 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939176-06ec-481d-bd76-ec837223010c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:09.550321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939176-06ec-481d-bd76-ec837223010c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:09.550418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17939176-06ec-481d-bd76-ec837223010c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:09.628468 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-17939176-06ec-481d-bd76-ec837223010c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:09.629729 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-17939176-06ec-481d-bd76-ec837223010c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:09.653644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:09.745927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:09.789213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bea53-9d74-4a8f-ab2c-1511869b8346 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:09.790945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b98bea53-9d74-4a8f-ab2c-1511869b8346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:09.902356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bea53-9d74-4a8f-ab2c-1511869b8346 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:09.927091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:09.992810 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a79ee-ca9a-494f-b17b-e6e9ec80858c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:09.993467 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a79ee-ca9a-494f-b17b-e6e9ec80858c service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:09.993743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a79ee-ca9a-494f-b17b-e6e9ec80858c service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:09.994014 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a79ee-ca9a-494f-b17b-e6e9ec80858c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:09.995746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d40a79ee-ca9a-494f-b17b-e6e9ec80858c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:10.120341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a79ee-ca9a-494f-b17b-e6e9ec80858c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:10.121750 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a79ee-ca9a-494f-b17b-e6e9ec80858c service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:10.140965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 723/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:12.199552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af194b1a-7fcf-4cdf-8cee-95c2a19f455d None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:12.200121 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af194b1a-7fcf-4cdf-8cee-95c2a19f455d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:12.200121 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af194b1a-7fcf-4cdf-8cee-95c2a19f455d None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:12.201515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:12.207183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0c61e-4331-440c-ae62-35bc4722bd0a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:12.207656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0c61e-4331-440c-ae62-35bc4722bd0a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:12.207768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0c61e-4331-440c-ae62-35bc4722bd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:12.279606 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:12.283715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-56c0c61e-4331-440c-ae62-35bc4722bd0a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:12.285514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-56c0c61e-4331-440c-ae62-35bc4722bd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:12.390023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:12.429932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af194b1a-7fcf-4cdf-8cee-95c2a19f455d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:12.431504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-af194b1a-7fcf-4cdf-8cee-95c2a19f455d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:12.545944 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af194b1a-7fcf-4cdf-8cee-95c2a19f455d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:12.595744 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:12.622190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dee188-7960-4ca7-ab42-d61763d19d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:12.622816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dee188-7960-4ca7-ab42-d61763d19d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:12.623097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dee188-7960-4ca7-ab42-d61763d19d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:12.623373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dee188-7960-4ca7-ab42-d61763d19d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:12.625058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e2dee188-7960-4ca7-ab42-d61763d19d87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:12.747485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dee188-7960-4ca7-ab42-d61763d19d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:12.748947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dee188-7960-4ca7-ab42-d61763d19d87 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:12.767689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 731/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:14.881520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4603a5-226a-4fd1-a65d-0b5ed1d4a83b None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:14.882128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4603a5-226a-4fd1-a65d-0b5ed1d4a83b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:14.882128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4603a5-226a-4fd1-a65d-0b5ed1d4a83b None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:14.883600 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:14.889612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1bfb6-b3e7-4af9-b685-3f1156ada233 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:14.890104 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1bfb6-b3e7-4af9-b685-3f1156ada233 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:14.890211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1bfb6-b3e7-4af9-b685-3f1156ada233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:14.964556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d2c1bfb6-b3e7-4af9-b685-3f1156ada233 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:14.965865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d2c1bfb6-b3e7-4af9-b685-3f1156ada233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:15.125214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:15.199183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:15.237952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4603a5-226a-4fd1-a65d-0b5ed1d4a83b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:15.239535 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-dc4603a5-226a-4fd1-a65d-0b5ed1d4a83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:15.353550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4603a5-226a-4fd1-a65d-0b5ed1d4a83b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:15.389217 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:15.436483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771b3ca-e15e-47eb-af37-dd2a369b591a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:15.437139 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b3ca-e15e-47eb-af37-dd2a369b591a service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:15.437412 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b3ca-e15e-47eb-af37-dd2a369b591a service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:15.437681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b3ca-e15e-47eb-af37-dd2a369b591a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:15.439350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b771b3ca-e15e-47eb-af37-dd2a369b591a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:15.553890 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771b3ca-e15e-47eb-af37-dd2a369b591a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:15.555355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771b3ca-e15e-47eb-af37-dd2a369b591a service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:15.574430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 726/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:17.815712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3311-48be-4f93-8875-f57843b8f215 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:17.816348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3311-48be-4f93-8875-f57843b8f215 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:17.816348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3311-48be-4f93-8875-f57843b8f215 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:17.818163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:17.824979 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6ac63-8b62-4578-b8c5-5ee9d31a4627 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:17.825633 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6ac63-8b62-4578-b8c5-5ee9d31a4627 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:17.825633 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6ac63-8b62-4578-b8c5-5ee9d31a4627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:17.903361 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-17e6ac63-8b62-4578-b8c5-5ee9d31a4627 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:17.904566 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-17e6ac63-8b62-4578-b8c5-5ee9d31a4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:17.913436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:18.025037 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:08:18.064159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc3311-48be-4f93-8875-f57843b8f215 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:18.065864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fbfc3311-48be-4f93-8875-f57843b8f215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:18.188679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc3311-48be-4f93-8875-f57843b8f215 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:18.253496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:18.277260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaf497-c805-4281-bd51-339fa3876bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:18.278053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaf497-c805-4281-bd51-339fa3876bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:18.278327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaf497-c805-4281-bd51-339fa3876bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:18.278591 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaf497-c805-4281-bd51-339fa3876bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:18.281725 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9efaf497-c805-4281-bd51-339fa3876bc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:18.404246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaf497-c805-4281-bd51-339fa3876bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:18.405676 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaf497-c805-4281-bd51-339fa3876bc0 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:18.425803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 734/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:20.570010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393433f0-1fd7-4cc4-accb-65331e5056b4 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:20.570808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393433f0-1fd7-4cc4-accb-65331e5056b4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:20.570808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393433f0-1fd7-4cc4-accb-65331e5056b4 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:20.571874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:20.578696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7919-4c6c-433c-a8c2-4f799c50ccdc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:20.579253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7919-4c6c-433c-a8c2-4f799c50ccdc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:20.579253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7919-4c6c-433c-a8c2-4f799c50ccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:20.649455 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a6eb7919-4c6c-433c-a8c2-4f799c50ccdc None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:20.651103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a6eb7919-4c6c-433c-a8c2-4f799c50ccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:20.693981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:20.756596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:20.795903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393433f0-1fd7-4cc4-accb-65331e5056b4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:20.797552 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-393433f0-1fd7-4cc4-accb-65331e5056b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:20.923352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393433f0-1fd7-4cc4-accb-65331e5056b4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:20.978200 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:21.017882 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fa1e0-e84c-49ac-8b84-3cbe204fbc79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:21.018519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa1e0-e84c-49ac-8b84-3cbe204fbc79 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:21.018797 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa1e0-e84c-49ac-8b84-3cbe204fbc79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:21.019068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa1e0-e84c-49ac-8b84-3cbe204fbc79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:21.020753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ae5fa1e0-e84c-49ac-8b84-3cbe204fbc79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:21.141739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fa1e0-e84c-49ac-8b84-3cbe204fbc79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:21.143208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fa1e0-e84c-49ac-8b84-3cbe204fbc79 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:21.164670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 729/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:23.495614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3532fe5-7401-4ce0-af0f-df10d02e9f3a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:23.496258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3532fe5-7401-4ce0-af0f-df10d02e9f3a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:23.496258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3532fe5-7401-4ce0-af0f-df10d02e9f3a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:23.497688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:23.503913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575f9e-bbf8-4286-af2a-1c6e22c582c0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:23.504510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575f9e-bbf8-4286-af2a-1c6e22c582c0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:23.504510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575f9e-bbf8-4286-af2a-1c6e22c582c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:23.587607 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e4575f9e-bbf8-4286-af2a-1c6e22c582c0 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:23.588755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e4575f9e-bbf8-4286-af2a-1c6e22c582c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:23.611028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:23.703108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:23.740138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3532fe5-7401-4ce0-af0f-df10d02e9f3a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:23.742518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b3532fe5-7401-4ce0-af0f-df10d02e9f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:23.857609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3532fe5-7401-4ce0-af0f-df10d02e9f3a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:23.927129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:23.935304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda993a-0aef-4098-9a13-988bdf163b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:23.935932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda993a-0aef-4098-9a13-988bdf163b7d service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:23.936205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda993a-0aef-4098-9a13-988bdf163b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:23.936470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda993a-0aef-4098-9a13-988bdf163b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:23.938140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bfda993a-0aef-4098-9a13-988bdf163b7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:24.058227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda993a-0aef-4098-9a13-988bdf163b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:24.059678 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda993a-0aef-4098-9a13-988bdf163b7d service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:24.078586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 737/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:26.083993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37b105-bf57-424a-9200-bc6e0e8a8ba3 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:26.084558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37b105-bf57-424a-9200-bc6e0e8a8ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:26.084558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37b105-bf57-424a-9200-bc6e0e8a8ba3 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:26.085820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:08:26.091333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6bec4-f814-4909-b67f-27d2b209ee41 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:26.091792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6bec4-f814-4909-b67f-27d2b209ee41 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:26.091908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6bec4-f814-4909-b67f-27d2b209ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:26.164656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-69e6bec4-f814-4909-b67f-27d2b209ee41 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:26.166752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-69e6bec4-f814-4909-b67f-27d2b209ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:26.216812 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:26.267656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:26.305461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37b105-bf57-424a-9200-bc6e0e8a8ba3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:26.306995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bd37b105-bf57-424a-9200-bc6e0e8a8ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:26.416999 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37b105-bf57-424a-9200-bc6e0e8a8ba3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:26.470865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:26.502991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448541ec-eb1e-48a7-83a2-d060ce4f479a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:26.503727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448541ec-eb1e-48a7-83a2-d060ce4f479a service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:26.504009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448541ec-eb1e-48a7-83a2-d060ce4f479a service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:26.504283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448541ec-eb1e-48a7-83a2-d060ce4f479a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:26.506067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-448541ec-eb1e-48a7-83a2-d060ce4f479a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:26.633581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448541ec-eb1e-48a7-83a2-d060ce4f479a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:26.635108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448541ec-eb1e-48a7-83a2-d060ce4f479a service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:26.657055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 732/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:36.265816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=22 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:36.654465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=66 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:46.747798 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f186-ccc8-407d-90e7-3e5f26e70fbd None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:46.748371 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f186-ccc8-407d-90e7-3e5f26e70fbd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:46.748371 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f186-ccc8-407d-90e7-3e5f26e70fbd None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:46.749760 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 739/1471] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:46.755253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6d96e-651e-4e13-a001-0d8652b0d23f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:46.755743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6d96e-651e-4e13-a001-0d8652b0d23f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:46.755846 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6d96e-651e-4e13-a001-0d8652b0d23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:46.826925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-1bb6d96e-651e-4e13-a001-0d8652b0d23f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:46.828076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1bb6d96e-651e-4e13-a001-0d8652b0d23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:46.931841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 733/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:47.019368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78927950-2e4d-4fb2-a7cc-3e535b77274e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:47.019653 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78927950-2e4d-4fb2-a7cc-3e535b77274e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:47.019926 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78927950-2e4d-4fb2-a7cc-3e535b77274e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:47.021338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 740/1473] 10.222.0.27 () {54 vars in 966 bytes} [Fri Aug 5 07:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:47.026225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ea0cf-ade8-4ad4-b693-47ad82428d95 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:47.026522 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ea0cf-ade8-4ad4-b693-47ad82428d95 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:47.026811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ea0cf-ade8-4ad4-b693-47ad82428d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:47.105688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-385ea0cf-ade8-4ad4-b693-47ad82428d95 None None] MFA Rules not processed for user `1c3d7cdad7f44f0f8df944ec7f69de26`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:47.106928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-385ea0cf-ade8-4ad4-b693-47ad82428d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:47.128305 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:47.188623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 734/1474] 10.222.0.27 () {58 vars in 1063 bytes} [Fri Aug 5 07:08:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:47.196294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78927950-2e4d-4fb2-a7cc-3e535b77274e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:47.197954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-78927950-2e4d-4fb2-a7cc-3e535b77274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:47.308485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78927950-2e4d-4fb2-a7cc-3e535b77274e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:47.385353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd947f84-6cba-477f-ae30-2fea12d895ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c3d7cdad7f44f0f8df944ec7f69de26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:47.385984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd947f84-6cba-477f-ae30-2fea12d895ae service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:47.386257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd947f84-6cba-477f-ae30-2fea12d895ae service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:47.386521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd947f84-6cba-477f-ae30-2fea12d895ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:47.388176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fd947f84-6cba-477f-ae30-2fea12d895ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:47.451683 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:47.511470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd947f84-6cba-477f-ae30-2fea12d895ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:47.512924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd947f84-6cba-477f-ae30-2fea12d895ae service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:47.533138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 741/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:49.626747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b69635-5578-4896-b275-62288be6aef0 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:49.627342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b69635-5578-4896-b275-62288be6aef0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:49.627342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b69635-5578-4896-b275-62288be6aef0 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:49.628929 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 735/1476] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:49.634956 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f0aa0-300c-47c3-9572-628200e501b1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:49.635450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f0aa0-300c-47c3-9572-628200e501b1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:49.635553 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f0aa0-300c-47c3-9572-628200e501b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:49.712587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c63f0aa0-300c-47c3-9572-628200e501b1 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:49.713852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c63f0aa0-300c-47c3-9572-628200e501b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:49.830512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 742/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:49.855333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b69635-5578-4896-b275-62288be6aef0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:49.857022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-01b69635-5578-4896-b275-62288be6aef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:49.994939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b69635-5578-4896-b275-62288be6aef0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:50.047478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:50.097062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f38476-7729-4ee5-b388-48f989e6345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:50.097690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38476-7729-4ee5-b388-48f989e6345e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:50.097972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38476-7729-4ee5-b388-48f989e6345e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:50.098247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38476-7729-4ee5-b388-48f989e6345e admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:50.098941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38476-7729-4ee5-b388-48f989e6345e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:50.100716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-b7f38476-7729-4ee5-b388-48f989e6345e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:08:50.100716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Aug 05 07:08:50.100716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: Aug 05 07:08:50.101903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38476-7729-4ee5-b388-48f989e6345e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:50.125482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 736/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Aug 5 07:08:49 2022] GET /identity/v3/projects => generated 2553 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:08:52.186149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d46caa-b25e-4f56-8d71-a44a97947b82 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:52.186755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d46caa-b25e-4f56-8d71-a44a97947b82 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:52.186755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d46caa-b25e-4f56-8d71-a44a97947b82 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:52.188061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 743/1479] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:52.193728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10690c-0067-4c6f-b349-7ac1320e5af3 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:52.194222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10690c-0067-4c6f-b349-7ac1320e5af3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:52.194222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10690c-0067-4c6f-b349-7ac1320e5af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:52.270466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ec10690c-0067-4c6f-b349-7ac1320e5af3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:52.271714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ec10690c-0067-4c6f-b349-7ac1320e5af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:52.379495 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 737/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:52.423752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d46caa-b25e-4f56-8d71-a44a97947b82 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:52.425382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-35d46caa-b25e-4f56-8d71-a44a97947b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:52.435881 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:52.594335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d46caa-b25e-4f56-8d71-a44a97947b82 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:52.681963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:52.715908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f410e-07e8-47ae-a67a-cd8effaa4dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:52.716517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f410e-07e8-47ae-a67a-cd8effaa4dac service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:52.716796 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f410e-07e8-47ae-a67a-cd8effaa4dac service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:52.717124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f410e-07e8-47ae-a67a-cd8effaa4dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:52.718754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-166f410e-07e8-47ae-a67a-cd8effaa4dac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:52.814001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f410e-07e8-47ae-a67a-cd8effaa4dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:52.815604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f410e-07e8-47ae-a67a-cd8effaa4dac service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:52.834072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 744/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:55.022723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecafc83-81d1-4afe-82a8-038c6287e611 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:55.023362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecafc83-81d1-4afe-82a8-038c6287e611 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:55.023362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecafc83-81d1-4afe-82a8-038c6287e611 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:55.024649 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 738/1482] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:55.030451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0b977-88d4-457b-ae2c-ba370ee0aaed None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:55.030905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0b977-88d4-457b-ae2c-ba370ee0aaed None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:55.031016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0b977-88d4-457b-ae2c-ba370ee0aaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:55.099099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e1e0b977-88d4-457b-ae2c-ba370ee0aaed None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:55.100332 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e1e0b977-88d4-457b-ae2c-ba370ee0aaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:55.151346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:55.206103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 745/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:55.243238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecafc83-81d1-4afe-82a8-038c6287e611 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:55.244925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3ecafc83-81d1-4afe-82a8-038c6287e611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:55.269651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:55.364466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecafc83-81d1-4afe-82a8-038c6287e611 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:55.452149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c6d69-ed10-4142-84b4-0cc15b6317af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:55.452789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c6d69-ed10-4142-84b4-0cc15b6317af service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:55.453104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c6d69-ed10-4142-84b4-0cc15b6317af service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:55.453381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c6d69-ed10-4142-84b4-0cc15b6317af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:55.455112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-584c6d69-ed10-4142-84b4-0cc15b6317af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:55.538482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:55.578738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c6d69-ed10-4142-84b4-0cc15b6317af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:55.580201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c6d69-ed10-4142-84b4-0cc15b6317af service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:55.601664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 739/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:08:57.656257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79371a93-7b9e-464a-b0ee-eaea6c708b72 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:57.656854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79371a93-7b9e-464a-b0ee-eaea6c708b72 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:57.656854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79371a93-7b9e-464a-b0ee-eaea6c708b72 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:57.658263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 746/1485] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:08:57.663583 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19266762-dd9d-4ba3-897c-1122b5bdfd36 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:57.664036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19266762-dd9d-4ba3-897c-1122b5bdfd36 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:57.664135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19266762-dd9d-4ba3-897c-1122b5bdfd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:57.735080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-19266762-dd9d-4ba3-897c-1122b5bdfd36 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:08:57.736345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-19266762-dd9d-4ba3-897c-1122b5bdfd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:57.845557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 740/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:08:57.884249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79371a93-7b9e-464a-b0ee-eaea6c708b72 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:08:57.885915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-79371a93-7b9e-464a-b0ee-eaea6c708b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:57.997074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79371a93-7b9e-464a-b0ee-eaea6c708b72 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:08:58.072611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:08:58.074702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32526364-4ad0-4640-b526-9bf49cffa3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:08:58.075406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32526364-4ad0-4640-b526-9bf49cffa3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:08:58.075692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32526364-4ad0-4640-b526-9bf49cffa3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:08:58.076007 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32526364-4ad0-4640-b526-9bf49cffa3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:08:58.078313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-32526364-4ad0-4640-b526-9bf49cffa3f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:08:58.192120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32526364-4ad0-4640-b526-9bf49cffa3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:08:58.193523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32526364-4ad0-4640-b526-9bf49cffa3f1 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:08:58.212351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 747/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:09:00.375519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74eb98-a83a-40a3-8a66-10944fa17f32 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:09:00.376152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74eb98-a83a-40a3-8a66-10944fa17f32 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:09:00.376152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74eb98-a83a-40a3-8a66-10944fa17f32 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:09:00.377503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 741/1488] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:09:00.384087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59852dd2-12a5-45e8-9cde-a0782d50400c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:09:00.384747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59852dd2-12a5-45e8-9cde-a0782d50400c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:09:00.384937 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59852dd2-12a5-45e8-9cde-a0782d50400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:09:00.460649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-59852dd2-12a5-45e8-9cde-a0782d50400c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:09:00.461935 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-59852dd2-12a5-45e8-9cde-a0782d50400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:09:00.516918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:09:00.565658 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 748/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:09:00.608373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74eb98-a83a-40a3-8a66-10944fa17f32 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:09:00.609973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cc74eb98-a83a-40a3-8a66-10944fa17f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:09:00.650517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:09:00.734979 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74eb98-a83a-40a3-8a66-10944fa17f32 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:09:00.816946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0d749-a273-4abb-a3b4-10c1aded9075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:09:00.817499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0d749-a273-4abb-a3b4-10c1aded9075 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:09:00.817757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0d749-a273-4abb-a3b4-10c1aded9075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:09:00.818012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0d749-a273-4abb-a3b4-10c1aded9075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:09:00.819653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9de0d749-a273-4abb-a3b4-10c1aded9075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:09:00.903380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:09:00.935362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0d749-a273-4abb-a3b4-10c1aded9075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:09:00.936816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0d749-a273-4abb-a3b4-10c1aded9075 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:09:00.955288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 742/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:09:03.234054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7bb44-bb1f-4e1f-aeb9-cbad401e48ba None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:09:03.234962 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7bb44-bb1f-4e1f-aeb9-cbad401e48ba None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:09:03.234962 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7bb44-bb1f-4e1f-aeb9-cbad401e48ba None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:09:03.236623 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 749/1491] 10.222.0.27 () {54 vars in 927 bytes} [Fri Aug 5 07:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:09:03.242873 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b27e2-f2d1-4c67-87a9-cc0bbb32ce62 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:09:03.243582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b27e2-f2d1-4c67-87a9-cc0bbb32ce62 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:09:03.243582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b27e2-f2d1-4c67-87a9-cc0bbb32ce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:09:03.323575 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-902b27e2-f2d1-4c67-87a9-cc0bbb32ce62 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:09:03.324858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-902b27e2-f2d1-4c67-87a9-cc0bbb32ce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:09:03.433567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 743/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Aug 5 07:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:09:03.476841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7bb44-bb1f-4e1f-aeb9-cbad401e48ba None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:09:03.479869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-21d7bb44-bb1f-4e1f-aeb9-cbad401e48ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:09:03.674856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7bb44-bb1f-4e1f-aeb9-cbad401e48ba None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:09:03.809506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47006f47-2938-4bcd-a13f-bd3db534f92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:09:03.810603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47006f47-2938-4bcd-a13f-bd3db534f92a service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:09:03.811088 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47006f47-2938-4bcd-a13f-bd3db534f92a service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:09:03.811584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47006f47-2938-4bcd-a13f-bd3db534f92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:09:03.814625 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-47006f47-2938-4bcd-a13f-bd3db534f92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:09:03.831042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:09:04.020747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47006f47-2938-4bcd-a13f-bd3db534f92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:09:04.023501 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47006f47-2938-4bcd-a13f-bd3db534f92a service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:09:04.057720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 750/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:09:13.431538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=82 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:09:14.053399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=50 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:10:19.159042 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d50fe-c1dc-44df-8cd4-b7ddb1ddcdae None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:19.159670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d50fe-c1dc-44df-8cd4-b7ddb1ddcdae None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:19.159670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d50fe-c1dc-44df-8cd4-b7ddb1ddcdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:19.249767 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-de3d50fe-c1dc-44df-8cd4-b7ddb1ddcdae None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:10:19.250990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-de3d50fe-c1dc-44df-8cd4-b7ddb1ddcdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:19.351901 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 744/1494] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:10:19.360741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec7b45-122f-43dc-82ba-975c4cb2d20d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:19.361303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec7b45-122f-43dc-82ba-975c4cb2d20d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:19.361396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec7b45-122f-43dc-82ba-975c4cb2d20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:19.446628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f5ec7b45-122f-43dc-82ba-975c4cb2d20d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:10:19.447781 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f5ec7b45-122f-43dc-82ba-975c4cb2d20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:19.549012 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 751/1495] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:10:19.554079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d50fe-c1dc-44df-8cd4-b7ddb1ddcdae None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:10:19.555366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-de3d50fe-c1dc-44df-8cd4-b7ddb1ddcdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:19.567214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d50fe-c1dc-44df-8cd4-b7ddb1ddcdae None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:10:19.631948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:10:19.668196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c897720-5335-419b-ae26-d96ed5220aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:10:19.668816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c897720-5335-419b-ae26-d96ed5220aac admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:19.669124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c897720-5335-419b-ae26-d96ed5220aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:19.669393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c897720-5335-419b-ae26-d96ed5220aac admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:19.670102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c897720-5335-419b-ae26-d96ed5220aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:10:19.670405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c897720-5335-419b-ae26-d96ed5220aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:10:19.671427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-1c897720-5335-419b-ae26-d96ed5220aac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:10:19.671427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Aug 05 07:10:19.671427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: Aug 05 07:10:19.672293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c897720-5335-419b-ae26-d96ed5220aac admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:10:19.684504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 745/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:10:19.693087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec7b45-122f-43dc-82ba-975c4cb2d20d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:10:19.703216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec7b45-122f-43dc-82ba-975c4cb2d20d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:10:19.771209 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:10:19.810613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab2ff9-c519-4558-9ada-f1eb6c981987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:10:19.811244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab2ff9-c519-4558-9ada-f1eb6c981987 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:19.811518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab2ff9-c519-4558-9ada-f1eb6c981987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:19.811786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab2ff9-c519-4558-9ada-f1eb6c981987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:19.812452 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab2ff9-c519-4558-9ada-f1eb6c981987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:10:19.814253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-41ab2ff9-c519-4558-9ada-f1eb6c981987 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:10:19.814253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: warnings.warn(msg) Aug 05 07:10:19.814253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: Aug 05 07:10:19.815456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab2ff9-c519-4558-9ada-f1eb6c981987 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:10:19.874537 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 752/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:10:19 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:10:19.878943 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c897720-5335-419b-ae26-d96ed5220aac admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:10:19.880489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1c897720-5335-419b-ae26-d96ed5220aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:19.915868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c897720-5335-419b-ae26-d96ed5220aac admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:10:20.016684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cc426-f043-48c5-be86-d6b9ae8d0a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:10:20.017334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cc426-f043-48c5-be86-d6b9ae8d0a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:20.017620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cc426-f043-48c5-be86-d6b9ae8d0a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:20.017865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cc426-f043-48c5-be86-d6b9ae8d0a57 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:20.018556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cc426-f043-48c5-be86-d6b9ae8d0a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:10:20.019582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-951cc426-f043-48c5-be86-d6b9ae8d0a57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:10:20.019582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Aug 05 07:10:20.019582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: Aug 05 07:10:20.020941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cc426-f043-48c5-be86-d6b9ae8d0a57 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:10:20.070917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 746/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:10:19 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:10:20.075288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab2ff9-c519-4558-9ada-f1eb6c981987 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:10:20.076886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-41ab2ff9-c519-4558-9ada-f1eb6c981987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:20.140403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab2ff9-c519-4558-9ada-f1eb6c981987 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:10:20.228941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:10:20.243606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e05d2-7891-49e0-b17a-1119e8f9c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:10:20.244699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e05d2-7891-49e0-b17a-1119e8f9c704 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:20.245018 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e05d2-7891-49e0-b17a-1119e8f9c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:20.245299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e05d2-7891-49e0-b17a-1119e8f9c704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:20.246024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e05d2-7891-49e0-b17a-1119e8f9c704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:10:20.247057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-f88e05d2-7891-49e0-b17a-1119e8f9c704 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:10:20.247057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: warnings.warn(msg) Aug 05 07:10:20.247057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: Aug 05 07:10:20.247954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e05d2-7891-49e0-b17a-1119e8f9c704 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:10:20.264513 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 753/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:10:20.266068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cc426-f043-48c5-be86-d6b9ae8d0a57 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:10:20.267682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-951cc426-f043-48c5-be86-d6b9ae8d0a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:20.280187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cc426-f043-48c5-be86-d6b9ae8d0a57 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:10:20.309081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:10:20.382547 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfcb1c-9c79-4888-84a5-3f32e7171069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:10:20.383174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfcb1c-9c79-4888-84a5-3f32e7171069 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:20.383443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfcb1c-9c79-4888-84a5-3f32e7171069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:20.383708 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfcb1c-9c79-4888-84a5-3f32e7171069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:20.384407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfcb1c-9c79-4888-84a5-3f32e7171069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:10:20.385494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-d1bfcb1c-9c79-4888-84a5-3f32e7171069 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:10:20.385494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Aug 05 07:10:20.385494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: Aug 05 07:10:20.386460 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfcb1c-9c79-4888-84a5-3f32e7171069 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:10:20.399259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 747/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:10:20.403822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e05d2-7891-49e0-b17a-1119e8f9c704 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:10:20.405782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f88e05d2-7891-49e0-b17a-1119e8f9c704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:20.441140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e05d2-7891-49e0-b17a-1119e8f9c704 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:10:20.544394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863c388-5bd6-4406-882a-36c249ceb25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:10:20.545019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863c388-5bd6-4406-882a-36c249ceb25e admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:20.545302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863c388-5bd6-4406-882a-36c249ceb25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:20.545575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863c388-5bd6-4406-882a-36c249ceb25e admin admin] PATH_INFO: `/v3/projects/e6de3a5b84d442ecae58864d6c49b0b8/users/6aa201f6cfa94842bba0baf1737d4000/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:20.569854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863c388-5bd6-4406-882a-36c249ceb25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6de3a5b84d442ecae58864d6c49b0b8, user_id=6aa201f6cfa94842bba0baf1737d4000, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:10:20.570907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-5863c388-5bd6-4406-882a-36c249ceb25e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:10:20.570907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: warnings.warn(msg) Aug 05 07:10:20.570907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: Aug 05 07:10:20.572884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863c388-5bd6-4406-882a-36c249ceb25e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:10:20.599566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 754/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:10:20 2022] PUT /identity/v3/projects/e6de3a5b84d442ecae58864d6c49b0b8/users/6aa201f6cfa94842bba0baf1737d4000/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:10:20.612351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5b585-77f3-4453-82d0-eadc789766dc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:20.612613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5b585-77f3-4453-82d0-eadc789766dc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:20.612943 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5b585-77f3-4453-82d0-eadc789766dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:20.671448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-82b5b585-77f3-4453-82d0-eadc789766dc None None] MFA Rules not processed for user `6aa201f6cfa94842bba0baf1737d4000`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:10:20.672663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-82b5b585-77f3-4453-82d0-eadc789766dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:20.749744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 748/1502] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:10:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:10:20.763644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6d1cd-562c-4fd0-b55d-e04c4002ad3e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:20.763965 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6d1cd-562c-4fd0-b55d-e04c4002ad3e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:20.764248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6d1cd-562c-4fd0-b55d-e04c4002ad3e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:20.765651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 755/1503] 10.222.0.27 () {54 vars in 964 bytes} [Fri Aug 5 07:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:10:20.770589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21422236-f5f9-4d3e-b856-146a860b36ad None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:20.770875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21422236-f5f9-4d3e-b856-146a860b36ad None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:20.771190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21422236-f5f9-4d3e-b856-146a860b36ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:20.803398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:10:20.852455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-21422236-f5f9-4d3e-b856-146a860b36ad None None] MFA Rules not processed for user `d44bcb27daeb4116835bbfb5dcb1dc33`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:10:20.853745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-21422236-f5f9-4d3e-b856-146a860b36ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:20.936187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 749/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Aug 5 07:10:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:10:20.944342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6d1cd-562c-4fd0-b55d-e04c4002ad3e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:10:20.945901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-54b6d1cd-562c-4fd0-b55d-e04c4002ad3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:21.000253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:10:21.059407 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6d1cd-562c-4fd0-b55d-e04c4002ad3e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:10:21.138700 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f18bf5-6860-4471-a76a-c28d627ff061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:10:21.139330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f18bf5-6860-4471-a76a-c28d627ff061 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:21.139604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f18bf5-6860-4471-a76a-c28d627ff061 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:21.139882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f18bf5-6860-4471-a76a-c28d627ff061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:21.141534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c1f18bf5-6860-4471-a76a-c28d627ff061 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:21.242479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f18bf5-6860-4471-a76a-c28d627ff061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:10:21.244074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f18bf5-6860-4471-a76a-c28d627ff061 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:10:21.247970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:10:21.265090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 756/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:10:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:10:21.315704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dd543-0c9d-4bec-ae68-43847f0d3c37 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:21.316193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dd543-0c9d-4bec-ae68-43847f0d3c37 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:21.316193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dd543-0c9d-4bec-ae68-43847f0d3c37 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:21.317568 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 750/1506] 10.222.0.27 () {52 vars in 830 bytes} [Fri Aug 5 07:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:10:21.321361 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f18bf5-6860-4471-a76a-c28d627ff061 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:10:21.322680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c1f18bf5-6860-4471-a76a-c28d627ff061 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:21.451720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f18bf5-6860-4471-a76a-c28d627ff061 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:10:21.548433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:10:21.549112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:21.549392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:21.549662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] PATH_INFO: `/v3/users/6aa201f6cfa94842bba0baf1737d4000` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:21.562239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aa201f6cfa94842bba0baf1737d4000)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:10:21.563226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:10:21.563226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: warnings.warn(msg) Aug 05 07:10:21.563226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: Aug 05 07:10:21.564443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:10:21.574542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:10:21.631755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aa201f6cfa94842bba0baf1737d4000'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:10:21.632203 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aa201f6cfa94842bba0baf1737d4000'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:10:21.643323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aa201f6cfa94842bba0baf1737d4000'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:10:21.643841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aa201f6cfa94842bba0baf1737d4000'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:10:21.669469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aa201f6cfa94842bba0baf1737d4000'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:10:21.692083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 757/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:10:21 2022] DELETE /identity/v3/users/6aa201f6cfa94842bba0baf1737d4000 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:10:21.696964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be7adf-c787-42b7-bcc9-10965e97d5d2 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:21.697248 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be7adf-c787-42b7-bcc9-10965e97d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:21.697506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be7adf-c787-42b7-bcc9-10965e97d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:21.764087 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-98be7adf-c787-42b7-bcc9-10965e97d5d2 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:10:21.765930 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-98be7adf-c787-42b7-bcc9-10965e97d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:21.852388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:10:21.873686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 751/1508] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:10:21.885546 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:10:21.887355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:21.992004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596865dc-525e-4698-a5ac-eaa95de9072a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:10:22.058848 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:10:22.080366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e589e-620f-49f2-9136-91302fc664c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:10:22.081025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e589e-620f-49f2-9136-91302fc664c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:22.081305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e589e-620f-49f2-9136-91302fc664c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:22.081580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e589e-620f-49f2-9136-91302fc664c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:22.083234 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-166e589e-620f-49f2-9136-91302fc664c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:22.198317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e589e-620f-49f2-9136-91302fc664c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:10:22.199921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e589e-620f-49f2-9136-91302fc664c5 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:10:22.218497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 758/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:10:22.584859 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be7adf-c787-42b7-bcc9-10965e97d5d2 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:10:22.587112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-98be7adf-c787-42b7-bcc9-10965e97d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:10:22.606228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be7adf-c787-42b7-bcc9-10965e97d5d2 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:10:22.716532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:10:22.717129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:10:22.717411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:10:22.717643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] PATH_INFO: `/v3/projects/e6de3a5b84d442ecae58864d6c49b0b8` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:10:22.728656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6de3a5b84d442ecae58864d6c49b0b8)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:10:22.729735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:10:22.729735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Aug 05 07:10:22.729735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: Aug 05 07:10:22.730954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:10:22.793738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6de3a5b84d442ecae58864d6c49b0b8', 'request_id': 'req-27e91733-d7b8-4fec-9e89-65eb459f0e3e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:10:22.808612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6de3a5b84d442ecae58864d6c49b0b8', 'request_id': 'req-27e91733-d7b8-4fec-9e89-65eb459f0e3e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:10:22.815719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6de3a5b84d442ecae58864d6c49b0b8', 'request_id': 'req-27e91733-d7b8-4fec-9e89-65eb459f0e3e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:10:22.847558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] The token cache is being invalidate because project e6de3a5b84d442ecae58864d6c49b0b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:10:22.847893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:10:22.848475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-27e91733-d7b8-4fec-9e89-65eb459f0e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:10:22.849965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 752/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:10:22 2022] DELETE /identity/v3/projects/e6de3a5b84d442ecae58864d6c49b0b8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:10:32.215947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=62 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:10:32.845099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:11:52.901607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c83d9e-af84-494a-910c-730e9c21e38a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:11:52.902254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c83d9e-af84-494a-910c-730e9c21e38a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:11:52.902254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c83d9e-af84-494a-910c-730e9c21e38a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:11:52.903701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 07:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:11:52.909671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf15ef0-1efc-4441-bf46-1f4ee75d795a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:11:52.910251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf15ef0-1efc-4441-bf46-1f4ee75d795a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:11:52.910251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf15ef0-1efc-4441-bf46-1f4ee75d795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:11:53.004391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2bf15ef0-1efc-4441-bf46-1f4ee75d795a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:11:53.005663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2bf15ef0-1efc-4441-bf46-1f4ee75d795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:11:53.125813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 07:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:11:53.284876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c83d9e-af84-494a-910c-730e9c21e38a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:11:53.288338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f8c83d9e-af84-494a-910c-730e9c21e38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:11:53.431472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c83d9e-af84-494a-910c-730e9c21e38a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:11:53.437569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4c93d-4271-4e71-9c42-48423cca02c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:11:53.438217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4c93d-4271-4e71-9c42-48423cca02c2 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:11:53.438498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4c93d-4271-4e71-9c42-48423cca02c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:11:53.438774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4c93d-4271-4e71-9c42-48423cca02c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:11:53.448064 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4c93d-4271-4e71-9c42-48423cca02c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:11:53.457344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4c93d-4271-4e71-9c42-48423cca02c2 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:11:53.474968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 760/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:11:54.338532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe375973-2952-4606-accd-7860f1c20781 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:11:54.339142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe375973-2952-4606-accd-7860f1c20781 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:11:54.339142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe375973-2952-4606-accd-7860f1c20781 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:11:54.340580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 07:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:11:54.346086 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5fafe-f29e-48c6-b1be-4562473055fe None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:11:54.346697 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5fafe-f29e-48c6-b1be-4562473055fe None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:11:54.346697 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5fafe-f29e-48c6-b1be-4562473055fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:11:54.367310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3ef5fafe-f29e-48c6-b1be-4562473055fe None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:11:54.368540 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3ef5fafe-f29e-48c6-b1be-4562473055fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:11:54.377015 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 07:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:11:54.530674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe375973-2952-4606-accd-7860f1c20781 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:11:54.546173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe375973-2952-4606-accd-7860f1c20781 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:11:54.552115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04975f04-cd39-4c7f-b347-7a48bfc71df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:11:54.552779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04975f04-cd39-4c7f-b347-7a48bfc71df2 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:11:54.553166 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04975f04-cd39-4c7f-b347-7a48bfc71df2 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:11:54.553433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04975f04-cd39-4c7f-b347-7a48bfc71df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:11:54.564153 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04975f04-cd39-4c7f-b347-7a48bfc71df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:11:54.565820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04975f04-cd39-4c7f-b347-7a48bfc71df2 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:11:54.576159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 755/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:11:55.221401 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd639bab-1757-4b58-8b85-0d66a45a6a70 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:11:55.221661 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd639bab-1757-4b58-8b85-0d66a45a6a70 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:11:55.221831 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd639bab-1757-4b58-8b85-0d66a45a6a70 None None] PATH_INFO: `/v3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:11:55.223194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 762/1517] 10.222.0.44 () {54 vars in 925 bytes} [Fri Aug 5 07:11:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:11:55.230720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eb11e-a875-497f-89cd-d7cef692ee33 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:11:55.230977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eb11e-a875-497f-89cd-d7cef692ee33 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:11:55.231258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eb11e-a875-497f-89cd-d7cef692ee33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:11:55.303064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-261eb11e-a875-497f-89cd-d7cef692ee33 None None] MFA Rules not processed for user `33213d31b1394cdfb5b447f4f4952b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:11:55.304319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-261eb11e-a875-497f-89cd-d7cef692ee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:11:55.322521 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:11:55.381303 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 756/1518] 10.222.0.44 () {58 vars in 1015 bytes} [Fri Aug 5 07:11:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:12:04.362028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=56 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:12:04.698946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51e9d-278e-4796-b069-c5b26a9df75b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:04.699235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51e9d-278e-4796-b069-c5b26a9df75b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:04.699523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e51e9d-278e-4796-b069-c5b26a9df75b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:04.701158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 763/1519] 10.222.0.27 () {54 vars in 961 bytes} [Fri Aug 5 07:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:12:04.707416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f7038-618e-4b2f-a80b-f7e3439ea1c6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:04.708035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f7038-618e-4b2f-a80b-f7e3439ea1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:04.708035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f7038-618e-4b2f-a80b-f7e3439ea1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:04.730453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0a1f7038-618e-4b2f-a80b-f7e3439ea1c6 None None] MFA Rules not processed for user `33213d31b1394cdfb5b447f4f4952b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:12:04.731766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0a1f7038-618e-4b2f-a80b-f7e3439ea1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:12:04.741057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 757/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Aug 5 07:12:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:12:04.749467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51e9d-278e-4796-b069-c5b26a9df75b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:12:04.765073 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e51e9d-278e-4796-b069-c5b26a9df75b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:12:04.771123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da90996-e250-464c-b0e1-873e55520bef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:12:04.771817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da90996-e250-464c-b0e1-873e55520bef service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:04.772300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da90996-e250-464c-b0e1-873e55520bef service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:04.772635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da90996-e250-464c-b0e1-873e55520bef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:04.783422 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da90996-e250-464c-b0e1-873e55520bef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:12:04.785308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da90996-e250-464c-b0e1-873e55520bef service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:12:04.797202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 764/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:12:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:12:06.011070 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980964e-13c8-431e-be22-dde47e0fc536 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:06.012068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980964e-13c8-431e-be22-dde47e0fc536 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:06.012068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980964e-13c8-431e-be22-dde47e0fc536 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:06.013187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 07:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:12:06.018621 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d0dd5-c29d-4660-af2c-e49f53f96c0d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:06.019167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d0dd5-c29d-4660-af2c-e49f53f96c0d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:06.019167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d0dd5-c29d-4660-af2c-e49f53f96c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:06.040923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5b9d0dd5-c29d-4660-af2c-e49f53f96c0d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:12:06.042358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5b9d0dd5-c29d-4660-af2c-e49f53f96c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:12:06.052378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 07:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:12:06.224760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980964e-13c8-431e-be22-dde47e0fc536 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:12:06.250789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980964e-13c8-431e-be22-dde47e0fc536 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:12:06.257681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2114470-8889-4a99-b1e0-0b487a3067cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:12:06.258314 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2114470-8889-4a99-b1e0-0b487a3067cd service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:06.258594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2114470-8889-4a99-b1e0-0b487a3067cd service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:06.258864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2114470-8889-4a99-b1e0-0b487a3067cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:06.268558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2114470-8889-4a99-b1e0-0b487a3067cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:12:06.270287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2114470-8889-4a99-b1e0-0b487a3067cd service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:12:06.281485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 759/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:12:07.146713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ff84-a3aa-400e-8f02-54748c630232 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:07.147386 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ff84-a3aa-400e-8f02-54748c630232 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:07.147386 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ff84-a3aa-400e-8f02-54748c630232 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:07.148718 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 07:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:12:07.154612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9508457-0350-4734-8008-b17953b9cf2f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:07.155663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9508457-0350-4734-8008-b17953b9cf2f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:07.155663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9508457-0350-4734-8008-b17953b9cf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:07.177260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d9508457-0350-4734-8008-b17953b9cf2f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:12:07.178559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d9508457-0350-4734-8008-b17953b9cf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:12:07.187677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 07:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:12:07.368133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ff84-a3aa-400e-8f02-54748c630232 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:12:07.388180 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ff84-a3aa-400e-8f02-54748c630232 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:12:07.395295 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ee328-eeee-4ecc-878b-b62596cd4b94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:12:07.396044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ee328-eeee-4ecc-878b-b62596cd4b94 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:07.396337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ee328-eeee-4ecc-878b-b62596cd4b94 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:07.396632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ee328-eeee-4ecc-878b-b62596cd4b94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:07.407483 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ee328-eeee-4ecc-878b-b62596cd4b94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:12:07.409206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ee328-eeee-4ecc-878b-b62596cd4b94 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:12:07.420866 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 767/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:12:11.348568 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccfed3-0fb0-43a4-8b8b-9b3b0a9e5f96 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:11.349208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccfed3-0fb0-43a4-8b8b-9b3b0a9e5f96 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:11.349585 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccfed3-0fb0-43a4-8b8b-9b3b0a9e5f96 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:11.352154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:12:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:12:11.357896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6904ac-c73e-40f4-8a48-2b1faad079b1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:11.358415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6904ac-c73e-40f4-8a48-2b1faad079b1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:11.358415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6904ac-c73e-40f4-8a48-2b1faad079b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:11.379234 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1c6904ac-c73e-40f4-8a48-2b1faad079b1 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:12:11.380470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1c6904ac-c73e-40f4-8a48-2b1faad079b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:12:11.389150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:12:11.469111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccfed3-0fb0-43a4-8b8b-9b3b0a9e5f96 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:12:11.471187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f2ccfed3-0fb0-43a4-8b8b-9b3b0a9e5f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:12:11.562012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccfed3-0fb0-43a4-8b8b-9b3b0a9e5f96 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:12:11.565805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe1d17-e6a5-449c-a223-6894ea43ce1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:12:11.566471 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe1d17-e6a5-449c-a223-6894ea43ce1a service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:11.566752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe1d17-e6a5-449c-a223-6894ea43ce1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:11.567014 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe1d17-e6a5-449c-a223-6894ea43ce1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:11.577700 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe1d17-e6a5-449c-a223-6894ea43ce1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:12:11.579189 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe1d17-e6a5-449c-a223-6894ea43ce1a service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:12:11.591061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 762/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:12:13.677616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb6b3-de5c-4edf-8b1a-b0777460c806 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:13.678199 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb6b3-de5c-4edf-8b1a-b0777460c806 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:13.678199 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb6b3-de5c-4edf-8b1a-b0777460c806 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:13.679430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:12:13.685370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28121405-9058-46a1-8fd7-09ed3a036ec6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:13.685975 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28121405-9058-46a1-8fd7-09ed3a036ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:13.685975 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28121405-9058-46a1-8fd7-09ed3a036ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:13.706973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-28121405-9058-46a1-8fd7-09ed3a036ec6 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:12:13.708215 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-28121405-9058-46a1-8fd7-09ed3a036ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:12:13.718980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:12:13.767313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cb6b3-de5c-4edf-8b1a-b0777460c806 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:12:13.769267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-334cb6b3-de5c-4edf-8b1a-b0777460c806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:12:13.785822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cb6b3-de5c-4edf-8b1a-b0777460c806 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:12:13.790055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95177103-a337-4e43-97a2-1afad7dd2128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:12:13.790696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95177103-a337-4e43-97a2-1afad7dd2128 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:13.790976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95177103-a337-4e43-97a2-1afad7dd2128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:13.791250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95177103-a337-4e43-97a2-1afad7dd2128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:13.804366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95177103-a337-4e43-97a2-1afad7dd2128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:12:13.805865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95177103-a337-4e43-97a2-1afad7dd2128 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:12:13.816250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 770/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:12:17.378460 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2e013-2282-4ebd-81e5-528303246a80 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:17.379006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2e013-2282-4ebd-81e5-528303246a80 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:17.379125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2e013-2282-4ebd-81e5-528303246a80 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:17.380548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:12:17.386486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c3210-75e4-4362-a756-2b847ed1eb2c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:17.387357 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c3210-75e4-4362-a756-2b847ed1eb2c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:17.387518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c3210-75e4-4362-a756-2b847ed1eb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:17.408913 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d04c3210-75e4-4362-a756-2b847ed1eb2c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:12:17.410432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d04c3210-75e4-4362-a756-2b847ed1eb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:12:17.419917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:12:17.734804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2e013-2282-4ebd-81e5-528303246a80 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:12:17.736557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a5b2e013-2282-4ebd-81e5-528303246a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:12:17.807095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:12:17.822982 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2e013-2282-4ebd-81e5-528303246a80 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:12:17.826977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348fa5d-71b3-4140-8c2f-80041af3f882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:12:17.827601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348fa5d-71b3-4140-8c2f-80041af3f882 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:17.827876 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348fa5d-71b3-4140-8c2f-80041af3f882 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:17.828176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348fa5d-71b3-4140-8c2f-80041af3f882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:17.838584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348fa5d-71b3-4140-8c2f-80041af3f882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:12:17.840034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348fa5d-71b3-4140-8c2f-80041af3f882 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:12:17.851070 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 765/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:12:19.917174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48781ae-ab0a-489a-89dd-e92d5c6dc825 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:19.917883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48781ae-ab0a-489a-89dd-e92d5c6dc825 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:19.917883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48781ae-ab0a-489a-89dd-e92d5c6dc825 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:19.919241 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 07:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:12:19.924809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f465b52-cf85-4fb9-ba03-ae8d34831bb4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:19.925389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f465b52-cf85-4fb9-ba03-ae8d34831bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:19.925389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f465b52-cf85-4fb9-ba03-ae8d34831bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:19.953248 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8f465b52-cf85-4fb9-ba03-ae8d34831bb4 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:12:19.954881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8f465b52-cf85-4fb9-ba03-ae8d34831bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:12:19.963796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 07:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:12:20.273836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48781ae-ab0a-489a-89dd-e92d5c6dc825 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:12:20.276331 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d48781ae-ab0a-489a-89dd-e92d5c6dc825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:12:20.297257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48781ae-ab0a-489a-89dd-e92d5c6dc825 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:12:20.303209 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270e6fa-fefa-419f-8ddd-8df754a0c6a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:12:20.303901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270e6fa-fefa-419f-8ddd-8df754a0c6a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:12:20.304241 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270e6fa-fefa-419f-8ddd-8df754a0c6a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:12:20.304552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270e6fa-fefa-419f-8ddd-8df754a0c6a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:12:20.315385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270e6fa-fefa-419f-8ddd-8df754a0c6a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:12:20.316841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270e6fa-fefa-419f-8ddd-8df754a0c6a6 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:12:20.328017 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 773/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:12:29.945818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=11 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:12:30.322780 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=33 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:44.934969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226a2fc-de46-4d3d-9ed8-da64a2036f42 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:44.937495 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226a2fc-de46-4d3d-9ed8-da64a2036f42 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:44.937495 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226a2fc-de46-4d3d-9ed8-da64a2036f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:44.971451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2226a2fc-de46-4d3d-9ed8-da64a2036f42 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:44.973910 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2226a2fc-de46-4d3d-9ed8-da64a2036f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:44.989205 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 767/1540] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:44.997943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1239a-7b00-4a81-8cfa-adcc4b0280d6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:44.998557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1239a-7b00-4a81-8cfa-adcc4b0280d6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:44.998557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1239a-7b00-4a81-8cfa-adcc4b0280d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.033995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9aa1239a-7b00-4a81-8cfa-adcc4b0280d6 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.035243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9aa1239a-7b00-4a81-8cfa-adcc4b0280d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.048400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 774/1541] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.052762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226a2fc-de46-4d3d-9ed8-da64a2036f42 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.067053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226a2fc-de46-4d3d-9ed8-da64a2036f42 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.076543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0967a5-964f-472f-a9cc-2903b359faba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.077758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0967a5-964f-472f-a9cc-2903b359faba admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.078267 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0967a5-964f-472f-a9cc-2903b359faba admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.078785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0967a5-964f-472f-a9cc-2903b359faba admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.079854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0967a5-964f-472f-a9cc-2903b359faba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:13:45.080403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0967a5-964f-472f-a9cc-2903b359faba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.082470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0967a5-964f-472f-a9cc-2903b359faba admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.103107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 768/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:13:45.112034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1239a-7b00-4a81-8cfa-adcc4b0280d6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.124943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1239a-7b00-4a81-8cfa-adcc4b0280d6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.132758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ac679-9dd2-423d-910f-179165a6c9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.133436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ac679-9dd2-423d-910f-179165a6c9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.133720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ac679-9dd2-423d-910f-179165a6c9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.133994 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ac679-9dd2-423d-910f-179165a6c9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.134675 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ac679-9dd2-423d-910f-179165a6c9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.136650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ac679-9dd2-423d-910f-179165a6c9b5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.159921 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22a5a7-ad80-41fc-b9b5-f6ab6ef4d8b4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.160589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22a5a7-ad80-41fc-b9b5-f6ab6ef4d8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.161231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22a5a7-ad80-41fc-b9b5-f6ab6ef4d8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.193385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-dc22a5a7-ad80-41fc-b9b5-f6ab6ef4d8b4 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.195018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-dc22a5a7-ad80-41fc-b9b5-f6ab6ef4d8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.203299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 775/1543] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/projects => generated 363 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:45.207266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ac679-9dd2-423d-910f-179165a6c9b5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.213339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 769/1544] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:13:45.215035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f0b3-0cbb-4ead-9a6e-405e03548042 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.215732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f0b3-0cbb-4ead-9a6e-405e03548042 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.216242 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56f0b3-0cbb-4ead-9a6e-405e03548042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.280404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ae56f0b3-0cbb-4ead-9a6e-405e03548042 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.280404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ae56f0b3-0cbb-4ead-9a6e-405e03548042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.330337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ac679-9dd2-423d-910f-179165a6c9b5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.344165 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c7cf6-502f-4c54-9b58-02227e5d1647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.345171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7cf6-502f-4c54-9b58-02227e5d1647 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.345637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7cf6-502f-4c54-9b58-02227e5d1647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.346134 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7cf6-502f-4c54-9b58-02227e5d1647 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.347243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c7cf6-502f-4c54-9b58-02227e5d1647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.349434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-767c7cf6-502f-4c54-9b58-02227e5d1647 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:13:45.349434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: warnings.warn(msg) Aug 05 07:13:45.349434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: Aug 05 07:13:45.352704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c7cf6-502f-4c54-9b58-02227e5d1647 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.398455 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 776/1545] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/users => generated 282 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:13:45.402733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2448-e9a6-4cbc-9ce9-cc23f384c80c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.403382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2448-e9a6-4cbc-9ce9-cc23f384c80c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.403818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb2448-e9a6-4cbc-9ce9-cc23f384c80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.428785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 770/1546] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.432693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-addb2448-e9a6-4cbc-9ce9-cc23f384c80c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.434141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-addb2448-e9a6-4cbc-9ce9-cc23f384c80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.434490 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ca7be-639b-4b14-8e9f-b26c83738f69 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.434879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ca7be-639b-4b14-8e9f-b26c83738f69 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.435250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ca7be-639b-4b14-8e9f-b26c83738f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.447485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 777/1547] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.448602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb2448-e9a6-4cbc-9ce9-cc23f384c80c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.458774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb2448-e9a6-4cbc-9ce9-cc23f384c80c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.460278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a45ca7be-639b-4b14-8e9f-b26c83738f69 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.461524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a45ca7be-639b-4b14-8e9f-b26c83738f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.463515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cb4bd-88d4-4cb4-90e6-5c9a3bb0e258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.464340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cb4bd-88d4-4cb4-90e6-5c9a3bb0e258 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.464562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cb4bd-88d4-4cb4-90e6-5c9a3bb0e258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.464828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cb4bd-88d4-4cb4-90e6-5c9a3bb0e258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.465605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cb4bd-88d4-4cb4-90e6-5c9a3bb0e258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.467419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cb4bd-88d4-4cb4-90e6-5c9a3bb0e258 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.470304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 771/1548] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.471794 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29081145-a9e9-4bd5-bb8b-195c440da872 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.472084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29081145-a9e9-4bd5-bb8b-195c440da872 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.472361 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29081145-a9e9-4bd5-bb8b-195c440da872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.488484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 778/1549] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:45.491162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea5cea-2e43-4848-8fa4-7e9c76e6df8f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.491668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea5cea-2e43-4848-8fa4-7e9c76e6df8f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.492140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea5cea-2e43-4848-8fa4-7e9c76e6df8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.494796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-29081145-a9e9-4bd5-bb8b-195c440da872 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.496019 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-29081145-a9e9-4bd5-bb8b-195c440da872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.505456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 772/1550] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.507339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d7ce6-59b0-47e0-899b-76d536e59466 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.507689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d7ce6-59b0-47e0-899b-76d536e59466 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.507968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d7ce6-59b0-47e0-899b-76d536e59466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.512274 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-46ea5cea-2e43-4848-8fa4-7e9c76e6df8f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.513608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-46ea5cea-2e43-4848-8fa4-7e9c76e6df8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.523538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 779/1551] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.525262 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af98bd-1aa9-4769-86ce-3d9913f5004c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.525545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af98bd-1aa9-4769-86ce-3d9913f5004c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.525820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af98bd-1aa9-4769-86ce-3d9913f5004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.528113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d09d7ce6-59b0-47e0-899b-76d536e59466 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.529727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d09d7ce6-59b0-47e0-899b-76d536e59466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.538058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 773/1552] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.539061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d7ce6-59b0-47e0-899b-76d536e59466 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.546184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-39af98bd-1aa9-4769-86ce-3d9913f5004c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.547400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-39af98bd-1aa9-4769-86ce-3d9913f5004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.550784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d7ce6-59b0-47e0-899b-76d536e59466 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.555322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 780/1553] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.555626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d21d6b-c5a4-4dd6-938a-93449936f372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.556118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d21d6b-c5a4-4dd6-938a-93449936f372 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.556438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d21d6b-c5a4-4dd6-938a-93449936f372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.556552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6d4b6-8fc9-4eb9-a175-ac32ce997964 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.556716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d21d6b-c5a4-4dd6-938a-93449936f372 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.556821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6d4b6-8fc9-4eb9-a175-ac32ce997964 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.557067 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6d4b6-8fc9-4eb9-a175-ac32ce997964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.557505 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d21d6b-c5a4-4dd6-938a-93449936f372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:13:45.557812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d21d6b-c5a4-4dd6-938a-93449936f372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.559445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d21d6b-c5a4-4dd6-938a-93449936f372 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.572443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 774/1554] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:13:45.572443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d21d6b-c5a4-4dd6-938a-93449936f372 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.580133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-31e6d4b6-8fc9-4eb9-a175-ac32ce997964 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.580239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-31e6d4b6-8fc9-4eb9-a175-ac32ce997964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.583863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d21d6b-c5a4-4dd6-938a-93449936f372 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.588222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 781/1555] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.588994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd21ae-7063-4bf5-b3f6-f1c0974f6e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.589472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2538b-d75a-4c77-8a05-80a211739780 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.589622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd21ae-7063-4bf5-b3f6-f1c0974f6e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.589752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2538b-d75a-4c77-8a05-80a211739780 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.589904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd21ae-7063-4bf5-b3f6-f1c0974f6e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.590025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2538b-d75a-4c77-8a05-80a211739780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.590178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd21ae-7063-4bf5-b3f6-f1c0974f6e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.590905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd21ae-7063-4bf5-b3f6-f1c0974f6e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.592645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd21ae-7063-4bf5-b3f6-f1c0974f6e1e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.603754 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 775/1556] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:45.605179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51937d4-1f8f-4b80-a45c-d0ec3b4bd501 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.605466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51937d4-1f8f-4b80-a45c-d0ec3b4bd501 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.605741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51937d4-1f8f-4b80-a45c-d0ec3b4bd501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.610379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bcb2538b-d75a-4c77-8a05-80a211739780 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.611636 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bcb2538b-d75a-4c77-8a05-80a211739780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.620124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 782/1557] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.621237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4b18d-7298-4354-86c1-76228e62b0e9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.621528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4b18d-7298-4354-86c1-76228e62b0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.621803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4b18d-7298-4354-86c1-76228e62b0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.627387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d51937d4-1f8f-4b80-a45c-d0ec3b4bd501 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.628644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d51937d4-1f8f-4b80-a45c-d0ec3b4bd501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.638718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 776/1558] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.639654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51937d4-1f8f-4b80-a45c-d0ec3b4bd501 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.643819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-19b4b18d-7298-4354-86c1-76228e62b0e9 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.645066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-19b4b18d-7298-4354-86c1-76228e62b0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.650629 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51937d4-1f8f-4b80-a45c-d0ec3b4bd501 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.653274 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 783/1559] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.656537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709792ef-d7eb-4773-9da3-2f1131c79a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.657286 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709792ef-d7eb-4773-9da3-2f1131c79a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.657557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709792ef-d7eb-4773-9da3-2f1131c79a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.657824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709792ef-d7eb-4773-9da3-2f1131c79a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.658357 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8057f-3f76-4a4d-8393-2ace0323e511 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.658524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709792ef-d7eb-4773-9da3-2f1131c79a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:13:45.658636 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8057f-3f76-4a4d-8393-2ace0323e511 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.658823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709792ef-d7eb-4773-9da3-2f1131c79a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.658927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8057f-3f76-4a4d-8393-2ace0323e511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.660433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709792ef-d7eb-4773-9da3-2f1131c79a2f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.680767 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 777/1560] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:13:45.680767 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709792ef-d7eb-4773-9da3-2f1131c79a2f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.681522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-62c8057f-3f76-4a4d-8393-2ace0323e511 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.682739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-62c8057f-3f76-4a4d-8393-2ace0323e511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.686689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709792ef-d7eb-4773-9da3-2f1131c79a2f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.691221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 784/1561] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.694949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23fd6-00e8-4f07-95b8-db62b54b48bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.695099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8057f-3f76-4a4d-8393-2ace0323e511 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.695214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23fd6-00e8-4f07-95b8-db62b54b48bd admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.695214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23fd6-00e8-4f07-95b8-db62b54b48bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.695214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23fd6-00e8-4f07-95b8-db62b54b48bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.695214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f23fd6-00e8-4f07-95b8-db62b54b48bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.695214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-94f23fd6-00e8-4f07-95b8-db62b54b48bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:13:45.695214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Aug 05 07:13:45.695214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: Aug 05 07:13:45.695790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f23fd6-00e8-4f07-95b8-db62b54b48bd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.705476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8057f-3f76-4a4d-8393-2ace0323e511 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.710996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ee73a-9b6a-4a51-8cf0-95efd0a11735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.711622 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ee73a-9b6a-4a51-8cf0-95efd0a11735 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.711899 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ee73a-9b6a-4a51-8cf0-95efd0a11735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.712172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ee73a-9b6a-4a51-8cf0-95efd0a11735 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.712875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ee73a-9b6a-4a51-8cf0-95efd0a11735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:13:45.713216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ee73a-9b6a-4a51-8cf0-95efd0a11735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.714238 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-1e3ee73a-9b6a-4a51-8cf0-95efd0a11735 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:13:45.714238 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: warnings.warn(msg) Aug 05 07:13:45.714238 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: Aug 05 07:13:45.715143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ee73a-9b6a-4a51-8cf0-95efd0a11735 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.728615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 778/1562] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:45.728615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23fd6-00e8-4f07-95b8-db62b54b48bd admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.730878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 785/1563] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:13:45.732170 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ebc4c-2e42-4aa2-852f-2be20dcda3b1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.732457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ebc4c-2e42-4aa2-852f-2be20dcda3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.732737 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ebc4c-2e42-4aa2-852f-2be20dcda3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.754290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-128ebc4c-2e42-4aa2-852f-2be20dcda3b1 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:45.755507 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-128ebc4c-2e42-4aa2-852f-2be20dcda3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:45.775627 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:45.791060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23fd6-00e8-4f07-95b8-db62b54b48bd admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.795518 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed370e62-57e8-410a-891c-83f4af906e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.795738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:45.795971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed370e62-57e8-410a-891c-83f4af906e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.796284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed370e62-57e8-410a-891c-83f4af906e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.796563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed370e62-57e8-410a-891c-83f4af906e23 admin admin] PATH_INFO: `/v3/projects/10ee756b53524736aeeb3254bdaeaf6c/users/24efa5390f7e4d939eedf92c09e10495/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.812669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed370e62-57e8-410a-891c-83f4af906e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ee756b53524736aeeb3254bdaeaf6c, user_id=24efa5390f7e4d939eedf92c09e10495, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.813758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-ed370e62-57e8-410a-891c-83f4af906e23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:13:45.813758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Aug 05 07:13:45.813758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: Aug 05 07:13:45.815716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed370e62-57e8-410a-891c-83f4af906e23 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.817638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 786/1564] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:45.818484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ebc4c-2e42-4aa2-852f-2be20dcda3b1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.827987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ebc4c-2e42-4aa2-852f-2be20dcda3b1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.833540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 779/1565] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:45 2022] PUT /identity/v3/projects/10ee756b53524736aeeb3254bdaeaf6c/users/24efa5390f7e4d939eedf92c09e10495/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:45.834487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed370e62-57e8-410a-891c-83f4af906e23 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.886994 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825ac81-bcd6-48e2-a5f8-dafbdd1c04b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.887631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825ac81-bcd6-48e2-a5f8-dafbdd1c04b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.888026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825ac81-bcd6-48e2-a5f8-dafbdd1c04b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.888305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825ac81-bcd6-48e2-a5f8-dafbdd1c04b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.889034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825ac81-bcd6-48e2-a5f8-dafbdd1c04b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:13:45.889336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825ac81-bcd6-48e2-a5f8-dafbdd1c04b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.891250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825ac81-bcd6-48e2-a5f8-dafbdd1c04b2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.897266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed370e62-57e8-410a-891c-83f4af906e23 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.902727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fd70a-e980-43ec-83fb-a275f519a36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.903202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 787/1566] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:13:45.903350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fd70a-e980-43ec-83fb-a275f519a36d admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.903622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fd70a-e980-43ec-83fb-a275f519a36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.904401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fd70a-e980-43ec-83fb-a275f519a36d admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.904509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825ac81-bcd6-48e2-a5f8-dafbdd1c04b2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.905136 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fd70a-e980-43ec-83fb-a275f519a36d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:13:45.905449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fd70a-e980-43ec-83fb-a275f519a36d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.907293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fd70a-e980-43ec-83fb-a275f519a36d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.914450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825ac81-bcd6-48e2-a5f8-dafbdd1c04b2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.918980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2470eca-f2b1-44f8-abc3-4051e76b4348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.919590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2470eca-f2b1-44f8-abc3-4051e76b4348 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.919864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2470eca-f2b1-44f8-abc3-4051e76b4348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.927185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 780/1567] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:13:45.927333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2470eca-f2b1-44f8-abc3-4051e76b4348 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.927333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2470eca-f2b1-44f8-abc3-4051e76b4348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.927531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fd70a-e980-43ec-83fb-a275f519a36d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.927630 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2470eca-f2b1-44f8-abc3-4051e76b4348 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.931045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fd70a-e980-43ec-83fb-a275f519a36d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:45.936083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba840fa-7a03-40ad-aff1-71e496b1de73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:45.936764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba840fa-7a03-40ad-aff1-71e496b1de73 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:45.937088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba840fa-7a03-40ad-aff1-71e496b1de73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:45.937364 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba840fa-7a03-40ad-aff1-71e496b1de73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:45.938096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba840fa-7a03-40ad-aff1-71e496b1de73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:13:45.938610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba840fa-7a03-40ad-aff1-71e496b1de73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:45.940208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba840fa-7a03-40ad-aff1-71e496b1de73 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:45.953378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 788/1568] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:45.960815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 781/1569] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:13:45.961033 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2470eca-f2b1-44f8-abc3-4051e76b4348 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.961145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba840fa-7a03-40ad-aff1-71e496b1de73 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:45.967022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba840fa-7a03-40ad-aff1-71e496b1de73 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.022446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2470eca-f2b1-44f8-abc3-4051e76b4348 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.027597 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3da84c-4e80-4d7e-8e2a-e9265b538c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.027788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1e9bc-f055-41cc-9195-e436db1e3628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.028368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3da84c-4e80-4d7e-8e2a-e9265b538c0e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.028499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e9bc-f055-41cc-9195-e436db1e3628 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.028656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e9bc-f055-41cc-9195-e436db1e3628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.028827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3da84c-4e80-4d7e-8e2a-e9265b538c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.029339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e9bc-f055-41cc-9195-e436db1e3628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.029491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3da84c-4e80-4d7e-8e2a-e9265b538c0e admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.030096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1e9bc-f055-41cc-9195-e436db1e3628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.030215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3da84c-4e80-4d7e-8e2a-e9265b538c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.031988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1e9bc-f055-41cc-9195-e436db1e3628 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.032144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3da84c-4e80-4d7e-8e2a-e9265b538c0e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.058003 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 789/1570] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.058003 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3da84c-4e80-4d7e-8e2a-e9265b538c0e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.070724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 782/1571] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:45 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.070724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493a811-2393-4d08-9f40-2de85a2aacee None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.070724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493a811-2393-4d08-9f40-2de85a2aacee None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.070724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493a811-2393-4d08-9f40-2de85a2aacee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.075759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3da84c-4e80-4d7e-8e2a-e9265b538c0e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.099457 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9493a811-2393-4d08-9f40-2de85a2aacee None None] MFA Rules not processed for user `24efa5390f7e4d939eedf92c09e10495`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:46.100710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9493a811-2393-4d08-9f40-2de85a2aacee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:46.120340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:46.130699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:46.137469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af371453-5389-4a56-a70b-a01db2c14d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.138125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af371453-5389-4a56-a70b-a01db2c14d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.138378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af371453-5389-4a56-a70b-a01db2c14d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.138661 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af371453-5389-4a56-a70b-a01db2c14d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.139434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af371453-5389-4a56-a70b-a01db2c14d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:13:46.139768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af371453-5389-4a56-a70b-a01db2c14d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.141451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af371453-5389-4a56-a70b-a01db2c14d03 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.155084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 790/1572] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:13:46.156034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af371453-5389-4a56-a70b-a01db2c14d03 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.166261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af371453-5389-4a56-a70b-a01db2c14d03 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.170990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ce0d2-0bd0-4449-8241-fc797c62991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.171604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ce0d2-0bd0-4449-8241-fc797c62991e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.171902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ce0d2-0bd0-4449-8241-fc797c62991e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.172175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ce0d2-0bd0-4449-8241-fc797c62991e admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.172978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ce0d2-0bd0-4449-8241-fc797c62991e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.174789 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ce0d2-0bd0-4449-8241-fc797c62991e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.174921 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 783/1573] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:46.175961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493a811-2393-4d08-9f40-2de85a2aacee None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.186920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493a811-2393-4d08-9f40-2de85a2aacee None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.191729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b6e8e-4d57-4f15-815c-69c644db0a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.192355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b6e8e-4d57-4f15-815c-69c644db0a9e admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.192631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b6e8e-4d57-4f15-815c-69c644db0a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.192924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b6e8e-4d57-4f15-815c-69c644db0a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.193677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b6e8e-4d57-4f15-815c-69c644db0a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.195874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b6e8e-4d57-4f15-815c-69c644db0a9e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.204861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 791/1574] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.208884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ce0d2-0bd0-4449-8241-fc797c62991e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.226487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 784/1575] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.226487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b6e8e-4d57-4f15-815c-69c644db0a9e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.275075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ce0d2-0bd0-4449-8241-fc797c62991e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.293291 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b6e8e-4d57-4f15-815c-69c644db0a9e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.298693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65673e-8f95-4f1b-ae7e-9809533b0962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.299331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65673e-8f95-4f1b-ae7e-9809533b0962 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.299624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65673e-8f95-4f1b-ae7e-9809533b0962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.299894 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65673e-8f95-4f1b-ae7e-9809533b0962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.300572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65673e-8f95-4f1b-ae7e-9809533b0962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.302542 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65673e-8f95-4f1b-ae7e-9809533b0962 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.335375 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12799a4-24ab-4f62-aee8-b5b478922a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.338916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 785/1576] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.339078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12799a4-24ab-4f62-aee8-b5b478922a33 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.339078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12799a4-24ab-4f62-aee8-b5b478922a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.339249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65673e-8f95-4f1b-ae7e-9809533b0962 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.339350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12799a4-24ab-4f62-aee8-b5b478922a33 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.339350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12799a4-24ab-4f62-aee8-b5b478922a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.339655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12799a4-24ab-4f62-aee8-b5b478922a33 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.363196 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 792/1577] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.364262 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12799a4-24ab-4f62-aee8-b5b478922a33 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.374024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12799a4-24ab-4f62-aee8-b5b478922a33 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.402625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65673e-8f95-4f1b-ae7e-9809533b0962 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.407781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b013b33-fe6b-43cc-996c-1b4f92989bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.408417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013b33-fe6b-43cc-996c-1b4f92989bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.408750 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013b33-fe6b-43cc-996c-1b4f92989bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.409230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013b33-fe6b-43cc-996c-1b4f92989bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.409949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b013b33-fe6b-43cc-996c-1b4f92989bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.411576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b013b33-fe6b-43cc-996c-1b4f92989bc7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.422138 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 786/1578] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:46.423100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b013b33-fe6b-43cc-996c-1b4f92989bc7 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.426881 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:46.434184 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b013b33-fe6b-43cc-996c-1b4f92989bc7 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.437726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d7ddd-2897-4966-8578-b529349e5297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.438361 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d7ddd-2897-4966-8578-b529349e5297 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.438644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d7ddd-2897-4966-8578-b529349e5297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.438914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d7ddd-2897-4966-8578-b529349e5297 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.439353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9b0a4-0d58-484c-9cfc-82cea7a6de07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.439596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d7ddd-2897-4966-8578-b529349e5297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.440146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9b0a4-0d58-484c-9cfc-82cea7a6de07 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.440425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9b0a4-0d58-484c-9cfc-82cea7a6de07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.440698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9b0a4-0d58-484c-9cfc-82cea7a6de07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.441423 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9b0a4-0d58-484c-9cfc-82cea7a6de07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.441675 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d7ddd-2897-4966-8578-b529349e5297 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.443337 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9b0a4-0d58-484c-9cfc-82cea7a6de07 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.465023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 793/1579] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.465714 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d7ddd-2897-4966-8578-b529349e5297 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.475445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 787/1580] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.475785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d7ddd-2897-4966-8578-b529349e5297 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.476268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9b0a4-0d58-484c-9cfc-82cea7a6de07 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.482682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:46.534874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8ec2b-f6c4-4779-8dba-bd3c35b7f844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.535605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8ec2b-f6c4-4779-8dba-bd3c35b7f844 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.535957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8ec2b-f6c4-4779-8dba-bd3c35b7f844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.536305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8ec2b-f6c4-4779-8dba-bd3c35b7f844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.537076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8ec2b-f6c4-4779-8dba-bd3c35b7f844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.539074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8ec2b-f6c4-4779-8dba-bd3c35b7f844 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.541758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9b0a4-0d58-484c-9cfc-82cea7a6de07 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.546679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e150bfe-8438-45b4-a058-3cfedcbfc1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.547313 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e150bfe-8438-45b4-a058-3cfedcbfc1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.547592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e150bfe-8438-45b4-a058-3cfedcbfc1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.547865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e150bfe-8438-45b4-a058-3cfedcbfc1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.548539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e150bfe-8438-45b4-a058-3cfedcbfc1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.550534 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e150bfe-8438-45b4-a058-3cfedcbfc1c5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.573595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 794/1581] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.573595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8ec2b-f6c4-4779-8dba-bd3c35b7f844 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.575783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 788/1582] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.576605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e150bfe-8438-45b4-a058-3cfedcbfc1c5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.587011 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e150bfe-8438-45b4-a058-3cfedcbfc1c5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.644121 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8ec2b-f6c4-4779-8dba-bd3c35b7f844 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.649583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d67e3d-28c7-41e8-852b-dbf81cefd0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.650221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d67e3d-28c7-41e8-852b-dbf81cefd0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.651024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d67e3d-28c7-41e8-852b-dbf81cefd0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.651024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d67e3d-28c7-41e8-852b-dbf81cefd0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.651463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d67e3d-28c7-41e8-852b-dbf81cefd0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.653753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d67e3d-28c7-41e8-852b-dbf81cefd0e4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.661049 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883f726-041e-425e-9732-aeae286f7a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.662888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883f726-041e-425e-9732-aeae286f7a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.663172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883f726-041e-425e-9732-aeae286f7a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.663449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883f726-041e-425e-9732-aeae286f7a1d admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.664137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883f726-041e-425e-9732-aeae286f7a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.666118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883f726-041e-425e-9732-aeae286f7a1d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.681384 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 795/1583] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.682464 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d67e3d-28c7-41e8-852b-dbf81cefd0e4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.694598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d67e3d-28c7-41e8-852b-dbf81cefd0e4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.696009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 789/1584] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.699528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883f726-041e-425e-9732-aeae286f7a1d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.703340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b0c3d-2a83-48bc-9c4e-0ffefb175c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.703974 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b0c3d-2a83-48bc-9c4e-0ffefb175c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.704253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b0c3d-2a83-48bc-9c4e-0ffefb175c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.704533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b0c3d-2a83-48bc-9c4e-0ffefb175c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.705308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b0c3d-2a83-48bc-9c4e-0ffefb175c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.707311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b0c3d-2a83-48bc-9c4e-0ffefb175c60 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.709144 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883f726-041e-425e-9732-aeae286f7a1d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.715704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741c58c-545d-458a-aea6-90df4637ab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.716452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741c58c-545d-458a-aea6-90df4637ab8c admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.716733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741c58c-545d-458a-aea6-90df4637ab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.717046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741c58c-545d-458a-aea6-90df4637ab8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.717843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741c58c-545d-458a-aea6-90df4637ab8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.723357 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 796/1585] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:46.723591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741c58c-545d-458a-aea6-90df4637ab8c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.723756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b0c3d-2a83-48bc-9c4e-0ffefb175c60 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.730267 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 790/1586] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:46.731096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741c58c-545d-458a-aea6-90df4637ab8c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.731942 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b0c3d-2a83-48bc-9c4e-0ffefb175c60 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.737985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88212272-de68-47b4-aa58-a02c57148349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.738551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88212272-de68-47b4-aa58-a02c57148349 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.738833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88212272-de68-47b4-aa58-a02c57148349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.739123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88212272-de68-47b4-aa58-a02c57148349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.739810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88212272-de68-47b4-aa58-a02c57148349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.741526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88212272-de68-47b4-aa58-a02c57148349 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.741651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741c58c-545d-458a-aea6-90df4637ab8c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.746386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcb2bd-ab08-4a02-94f0-a2c6ae41b7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.747018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcb2bd-ab08-4a02-94f0-a2c6ae41b7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.747299 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcb2bd-ab08-4a02-94f0-a2c6ae41b7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.747577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcb2bd-ab08-4a02-94f0-a2c6ae41b7c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.748246 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcb2bd-ab08-4a02-94f0-a2c6ae41b7c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.750328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcb2bd-ab08-4a02-94f0-a2c6ae41b7c4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.753695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 797/1587] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:46.754595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88212272-de68-47b4-aa58-a02c57148349 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.765895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88212272-de68-47b4-aa58-a02c57148349 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.771215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413beb4-e049-44c1-9e85-8147cbf457ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.771957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413beb4-e049-44c1-9e85-8147cbf457ab admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.772331 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413beb4-e049-44c1-9e85-8147cbf457ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.772656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413beb4-e049-44c1-9e85-8147cbf457ab admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.773432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413beb4-e049-44c1-9e85-8147cbf457ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.775436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413beb4-e049-44c1-9e85-8147cbf457ab admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.777273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 791/1588] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/users => generated 291 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.777877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcb2bd-ab08-4a02-94f0-a2c6ae41b7c4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.789041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcb2bd-ab08-4a02-94f0-a2c6ae41b7c4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.794034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aaaf2-e16a-4ada-a6a5-0035245e5196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.794661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aaaf2-e16a-4ada-a6a5-0035245e5196 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.794941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aaaf2-e16a-4ada-a6a5-0035245e5196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.795213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aaaf2-e16a-4ada-a6a5-0035245e5196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.795946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27aaaf2-e16a-4ada-a6a5-0035245e5196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.797604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27aaaf2-e16a-4ada-a6a5-0035245e5196 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.802285 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 798/1589] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:13:46 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:46.802285 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413beb4-e049-44c1-9e85-8147cbf457ab admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.811053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413beb4-e049-44c1-9e85-8147cbf457ab admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.812628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 792/1590] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:46.813588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aaaf2-e16a-4ada-a6a5-0035245e5196 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.819851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72918d65-0baa-4bda-b816-2565c5868202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.820493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72918d65-0baa-4bda-b816-2565c5868202 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.820771 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72918d65-0baa-4bda-b816-2565c5868202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.821091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72918d65-0baa-4bda-b816-2565c5868202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.821801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72918d65-0baa-4bda-b816-2565c5868202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.823420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72918d65-0baa-4bda-b816-2565c5868202 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.824040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aaaf2-e16a-4ada-a6a5-0035245e5196 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.828797 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac06673-4e09-4136-b276-8add1d47dc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.829458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac06673-4e09-4136-b276-8add1d47dc55 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.829737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac06673-4e09-4136-b276-8add1d47dc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.830040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac06673-4e09-4136-b276-8add1d47dc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.830809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac06673-4e09-4136-b276-8add1d47dc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.832439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac06673-4e09-4136-b276-8add1d47dc55 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.835481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 799/1591] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:46.836361 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72918d65-0baa-4bda-b816-2565c5868202 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.846451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 793/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:46.846451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac06673-4e09-4136-b276-8add1d47dc55 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.853426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72918d65-0baa-4bda-b816-2565c5868202 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.854759 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac06673-4e09-4136-b276-8add1d47dc55 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.859549 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83221f-956f-4d6a-b939-3365b3791b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.859693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2392b53-4ac9-4e00-902f-320789636808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.860215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83221f-956f-4d6a-b939-3365b3791b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.860344 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2392b53-4ac9-4e00-902f-320789636808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.860494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83221f-956f-4d6a-b939-3365b3791b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.860655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2392b53-4ac9-4e00-902f-320789636808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.860752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2392b53-4ac9-4e00-902f-320789636808 admin admin] PATH_INFO: `/v3/projects/61bf4a49abd8479f895e68d4954412b2/users/096d0da1a0bc401c95bfbb8fc150a27b/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.860867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83221f-956f-4d6a-b939-3365b3791b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.861498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83221f-956f-4d6a-b939-3365b3791b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.863108 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83221f-956f-4d6a-b939-3365b3791b05 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.864636 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:46.881375 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 800/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:46.881375 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83221f-956f-4d6a-b939-3365b3791b05 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.884113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2392b53-4ac9-4e00-902f-320789636808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61bf4a49abd8479f895e68d4954412b2, user_id=096d0da1a0bc401c95bfbb8fc150a27b, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.887132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2392b53-4ac9-4e00-902f-320789636808 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.889857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83221f-956f-4d6a-b939-3365b3791b05 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.895608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a945e1e-7b3d-439b-b46b-22e1d0a1c8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.896544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a945e1e-7b3d-439b-b46b-22e1d0a1c8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.897023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a945e1e-7b3d-439b-b46b-22e1d0a1c8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.897341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a945e1e-7b3d-439b-b46b-22e1d0a1c8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.898711 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a945e1e-7b3d-439b-b46b-22e1d0a1c8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.900417 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a945e1e-7b3d-439b-b46b-22e1d0a1c8e3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.903529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 794/1594] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:46 2022] PUT /identity/v3/projects/61bf4a49abd8479f895e68d4954412b2/users/096d0da1a0bc401c95bfbb8fc150a27b/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:46.904912 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2392b53-4ac9-4e00-902f-320789636808 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.915957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 801/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:46.915957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a945e1e-7b3d-439b-b46b-22e1d0a1c8e3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:46.916274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:46.926591 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a945e1e-7b3d-439b-b46b-22e1d0a1c8e3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.975055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2392b53-4ac9-4e00-902f-320789636808 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:46.979917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca3892-cc75-49e7-bae9-7ea8d87b339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.980546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca3892-cc75-49e7-bae9-7ea8d87b339e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.980834 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca3892-cc75-49e7-bae9-7ea8d87b339e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.981134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca3892-cc75-49e7-bae9-7ea8d87b339e admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.981838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca3892-cc75-49e7-bae9-7ea8d87b339e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.983550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca3892-cc75-49e7-bae9-7ea8d87b339e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.989440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1504c0-0ff2-466e-ab18-1bcaa49a664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:46.989995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1504c0-0ff2-466e-ab18-1bcaa49a664b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:46.990278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1504c0-0ff2-466e-ab18-1bcaa49a664b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:46.990541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1504c0-0ff2-466e-ab18-1bcaa49a664b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:46.991258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1504c0-0ff2-466e-ab18-1bcaa49a664b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:46.992867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1504c0-0ff2-466e-ab18-1bcaa49a664b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:46.994861 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 795/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:46.995727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca3892-cc75-49e7-bae9-7ea8d87b339e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.004256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 802/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:47.005929 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca3892-cc75-49e7-bae9-7ea8d87b339e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.006642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1504c0-0ff2-466e-ab18-1bcaa49a664b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.011187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a434e-b907-405d-b9a9-44782a0b7e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.011902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a434e-b907-405d-b9a9-44782a0b7e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.012084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a434e-b907-405d-b9a9-44782a0b7e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.012336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a434e-b907-405d-b9a9-44782a0b7e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.013516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a434e-b907-405d-b9a9-44782a0b7e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.015472 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a434e-b907-405d-b9a9-44782a0b7e0c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.023828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1504c0-0ff2-466e-ab18-1bcaa49a664b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.027485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 796/1598] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:47.028152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a434e-b907-405d-b9a9-44782a0b7e0c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.030122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9f9a6-df65-4da4-a038-34f89271e6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.030781 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9f9a6-df65-4da4-a038-34f89271e6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.031067 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9f9a6-df65-4da4-a038-34f89271e6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.031347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9f9a6-df65-4da4-a038-34f89271e6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.032048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9f9a6-df65-4da4-a038-34f89271e6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.033956 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9f9a6-df65-4da4-a038-34f89271e6e5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.040557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a434e-b907-405d-b9a9-44782a0b7e0c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.045365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a070d2-bab2-4562-ae5a-12c4ebba9e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.046061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a070d2-bab2-4562-ae5a-12c4ebba9e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.046335 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a070d2-bab2-4562-ae5a-12c4ebba9e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.046604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a070d2-bab2-4562-ae5a-12c4ebba9e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.047300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a070d2-bab2-4562-ae5a-12c4ebba9e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.048945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a070d2-bab2-4562-ae5a-12c4ebba9e90 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.058922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 803/1599] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:47.059777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9f9a6-df65-4da4-a038-34f89271e6e5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.067304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 797/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:47.070490 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9f9a6-df65-4da4-a038-34f89271e6e5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.070756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce8ab4-85d6-49c6-9984-832e8fb0cb0d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.071266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce8ab4-85d6-49c6-9984-832e8fb0cb0d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.071765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce8ab4-85d6-49c6-9984-832e8fb0cb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.075370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce674e-0d08-42d0-bccf-8d6a1c7b168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.076342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce674e-0d08-42d0-bccf-8d6a1c7b168d admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.076794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce674e-0d08-42d0-bccf-8d6a1c7b168d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.077124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce674e-0d08-42d0-bccf-8d6a1c7b168d admin admin] PATH_INFO: `/v3/projects/fd750a5a13ab4cb690b328abdd67872c/users/fbd4cecd32204f9fa60348534afa5217/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.094331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-64ce8ab4-85d6-49c6-9984-832e8fb0cb0d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:47.095021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce674e-0d08-42d0-bccf-8d6a1c7b168d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd750a5a13ab4cb690b328abdd67872c, user_id=fbd4cecd32204f9fa60348534afa5217, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.095603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-64ce8ab4-85d6-49c6-9984-832e8fb0cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:47.097866 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce674e-0d08-42d0-bccf-8d6a1c7b168d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.117639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 804/1601] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:47 2022] PUT /identity/v3/projects/fd750a5a13ab4cb690b328abdd67872c/users/fbd4cecd32204f9fa60348534afa5217/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:47.118539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce674e-0d08-42d0-bccf-8d6a1c7b168d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.118854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 798/1602] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:47.121531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce8ab4-85d6-49c6-9984-832e8fb0cb0d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.133955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce8ab4-85d6-49c6-9984-832e8fb0cb0d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.202131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbb910-33b0-4873-bf28-e6f2d1f0bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.202761 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbb910-33b0-4873-bf28-e6f2d1f0bffd admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.203035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbb910-33b0-4873-bf28-e6f2d1f0bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.203303 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbb910-33b0-4873-bf28-e6f2d1f0bffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.204005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbb910-33b0-4873-bf28-e6f2d1f0bffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.205448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce674e-0d08-42d0-bccf-8d6a1c7b168d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.205642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbb910-33b0-4873-bf28-e6f2d1f0bffd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.210813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece2b6a-8f6b-4924-b43c-01e6307842d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.211494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece2b6a-8f6b-4924-b43c-01e6307842d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.211772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece2b6a-8f6b-4924-b43c-01e6307842d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.212048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece2b6a-8f6b-4924-b43c-01e6307842d5 admin admin] PATH_INFO: `/v3/projects/fe39edf907ff48518759474a800b949d/users/2ce8bf4f0ab64010b3855193f55971d2/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.215916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 799/1603] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:47.219387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbb910-33b0-4873-bf28-e6f2d1f0bffd admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.226632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbb910-33b0-4873-bf28-e6f2d1f0bffd admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.229100 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece2b6a-8f6b-4924-b43c-01e6307842d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe39edf907ff48518759474a800b949d, user_id=2ce8bf4f0ab64010b3855193f55971d2, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.231466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181f0a8-bf62-4f94-ba66-8d299c353fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.231801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece2b6a-8f6b-4924-b43c-01e6307842d5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.232142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181f0a8-bf62-4f94-ba66-8d299c353fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.232422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181f0a8-bf62-4f94-ba66-8d299c353fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.232700 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181f0a8-bf62-4f94-ba66-8d299c353fa4 admin admin] PATH_INFO: `/v3/projects/2222eb5a023a406aa5767bd10edfdec9/users/7e16b95fde6b4e10b245bd2fa030b88d/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.246847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 805/1604] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:47 2022] PUT /identity/v3/projects/fe39edf907ff48518759474a800b949d/users/2ce8bf4f0ab64010b3855193f55971d2/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:47.247943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece2b6a-8f6b-4924-b43c-01e6307842d5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.254754 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181f0a8-bf62-4f94-ba66-8d299c353fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2222eb5a023a406aa5767bd10edfdec9, user_id=7e16b95fde6b4e10b245bd2fa030b88d, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.258004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181f0a8-bf62-4f94-ba66-8d299c353fa4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.273811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 800/1605] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:47 2022] PUT /identity/v3/projects/2222eb5a023a406aa5767bd10edfdec9/users/7e16b95fde6b4e10b245bd2fa030b88d/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:47.274640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181f0a8-bf62-4f94-ba66-8d299c353fa4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.285944 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:47.331216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece2b6a-8f6b-4924-b43c-01e6307842d5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.346225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:47.361685 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181f0a8-bf62-4f94-ba66-8d299c353fa4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.367033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738dde1-9718-4200-bfd3-5d6ce888db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.367764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738dde1-9718-4200-bfd3-5d6ce888db42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.368046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738dde1-9718-4200-bfd3-5d6ce888db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.368329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738dde1-9718-4200-bfd3-5d6ce888db42 admin admin] PATH_INFO: `/v3/projects/ab8827c8710749d387f23d4ce8b35fd4/users/9cedcecb65ea45aa8b37797907d69009/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.384714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738dde1-9718-4200-bfd3-5d6ce888db42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8827c8710749d387f23d4ce8b35fd4, user_id=9cedcecb65ea45aa8b37797907d69009, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.387576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738dde1-9718-4200-bfd3-5d6ce888db42 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.398928 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b4aaa-2f9a-430b-82fa-f959f6227084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.399622 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b4aaa-2f9a-430b-82fa-f959f6227084 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.399905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b4aaa-2f9a-430b-82fa-f959f6227084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.400177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b4aaa-2f9a-430b-82fa-f959f6227084 admin admin] PATH_INFO: `/v3/projects/efa588d5331d4d0b9ade4c0af72eac8d/users/fd2a5862bd074a548ca0189107777cc9/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.402982 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 801/1606] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:47 2022] PUT /identity/v3/projects/ab8827c8710749d387f23d4ce8b35fd4/users/9cedcecb65ea45aa8b37797907d69009/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:47.403803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738dde1-9718-4200-bfd3-5d6ce888db42 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.419637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b4aaa-2f9a-430b-82fa-f959f6227084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa588d5331d4d0b9ade4c0af72eac8d, user_id=fd2a5862bd074a548ca0189107777cc9, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.423239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b4aaa-2f9a-430b-82fa-f959f6227084 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.439385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 806/1607] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:47 2022] PUT /identity/v3/projects/efa588d5331d4d0b9ade4c0af72eac8d/users/fd2a5862bd074a548ca0189107777cc9/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:47.440679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfd979-1659-40d4-894d-0f507881e021 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.440990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfd979-1659-40d4-894d-0f507881e021 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.441410 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfd979-1659-40d4-894d-0f507881e021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.478882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b6cfd979-1659-40d4-894d-0f507881e021 None None] MFA Rules not processed for user `fbd4cecd32204f9fa60348534afa5217`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:47.480124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b6cfd979-1659-40d4-894d-0f507881e021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:47.501034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738dde1-9718-4200-bfd3-5d6ce888db42 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.559751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649226c7-a84f-454e-ae8d-f41c7e060789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.560445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649226c7-a84f-454e-ae8d-f41c7e060789 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.560710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649226c7-a84f-454e-ae8d-f41c7e060789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.561013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649226c7-a84f-454e-ae8d-f41c7e060789 admin admin] PATH_INFO: `/v3/projects/92e23c5c336e486f995f88c12b72b2c5/users/02c685b300874351ab2dbd62bea1a669/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.572487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 807/1608] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:47.573409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfd979-1659-40d4-894d-0f507881e021 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.581606 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649226c7-a84f-454e-ae8d-f41c7e060789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e23c5c336e486f995f88c12b72b2c5, user_id=02c685b300874351ab2dbd62bea1a669, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.584317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649226c7-a84f-454e-ae8d-f41c7e060789 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.600537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 802/1609] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:47 2022] PUT /identity/v3/projects/92e23c5c336e486f995f88c12b72b2c5/users/02c685b300874351ab2dbd62bea1a669/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:47.601310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649226c7-a84f-454e-ae8d-f41c7e060789 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.632822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:47.637465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfd979-1659-40d4-894d-0f507881e021 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.669933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649226c7-a84f-454e-ae8d-f41c7e060789 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.674621 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06347cf-50e4-4bb3-87df-6a4cb6cf99b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.675298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06347cf-50e4-4bb3-87df-6a4cb6cf99b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.675574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06347cf-50e4-4bb3-87df-6a4cb6cf99b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.675845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06347cf-50e4-4bb3-87df-6a4cb6cf99b5 admin admin] PATH_INFO: `/v3/projects/609be8cfbee24416a0cb50d1551bf9c5/users/bc86aa22af8548cfb4147d85e71487d4/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.679362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:47.688210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb943c2e-eb6f-4ea5-ae48-b60dd2d67bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.688820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb943c2e-eb6f-4ea5-ae48-b60dd2d67bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.689144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb943c2e-eb6f-4ea5-ae48-b60dd2d67bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.689458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb943c2e-eb6f-4ea5-ae48-b60dd2d67bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.693592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06347cf-50e4-4bb3-87df-6a4cb6cf99b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=609be8cfbee24416a0cb50d1551bf9c5, user_id=bc86aa22af8548cfb4147d85e71487d4, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.696292 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06347cf-50e4-4bb3-87df-6a4cb6cf99b5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.699272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb943c2e-eb6f-4ea5-ae48-b60dd2d67bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.700822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb943c2e-eb6f-4ea5-ae48-b60dd2d67bf3 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.710756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 803/1610] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:47 2022] PUT /identity/v3/projects/609be8cfbee24416a0cb50d1551bf9c5/users/bc86aa22af8548cfb4147d85e71487d4/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:47.711610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 808/1611] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:47.712063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56330c3-472f-49eb-89dd-d6536bb763bf None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.712224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb943c2e-eb6f-4ea5-ae48-b60dd2d67bf3 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.712362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56330c3-472f-49eb-89dd-d6536bb763bf None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.712612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56330c3-472f-49eb-89dd-d6536bb763bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.722328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb943c2e-eb6f-4ea5-ae48-b60dd2d67bf3 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.740404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d56330c3-472f-49eb-89dd-d6536bb763bf None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:47.741914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d56330c3-472f-49eb-89dd-d6536bb763bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:47.804411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd56a6-a656-434a-9d7f-e2fb5c89c06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.805079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd56a6-a656-434a-9d7f-e2fb5c89c06d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.805389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd56a6-a656-434a-9d7f-e2fb5c89c06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.805663 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd56a6-a656-434a-9d7f-e2fb5c89c06d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.806420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd56a6-a656-434a-9d7f-e2fb5c89c06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.808323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd56a6-a656-434a-9d7f-e2fb5c89c06d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.821038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 804/1612] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:47.821251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 809/1613] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:47.822452 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de890-c034-43e0-bdb6-5a86da79a40e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.822593 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ade4e-88b3-4645-af7b-34105b5d66cd None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.822813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ade4e-88b3-4645-af7b-34105b5d66cd None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.822970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de890-c034-43e0-bdb6-5a86da79a40e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.823061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ade4e-88b3-4645-af7b-34105b5d66cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.823137 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de890-c034-43e0-bdb6-5a86da79a40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.848721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c95ade4e-88b3-4645-af7b-34105b5d66cd None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:47.850208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c95ade4e-88b3-4645-af7b-34105b5d66cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:47.854978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-059de890-c034-43e0-bdb6-5a86da79a40e None None] MFA Rules not processed for user `fd2a5862bd074a548ca0189107777cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:47.856161 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-059de890-c034-43e0-bdb6-5a86da79a40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:47.859823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 805/1614] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:47.861304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95032a3a-c12a-46a7-abae-aa7c6359bf2d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.861677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95032a3a-c12a-46a7-abae-aa7c6359bf2d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.862211 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95032a3a-c12a-46a7-abae-aa7c6359bf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.886592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-95032a3a-c12a-46a7-abae-aa7c6359bf2d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:47.888184 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-95032a3a-c12a-46a7-abae-aa7c6359bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:47.899212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 806/1615] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:47.901051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1546d8-6ad0-403f-b9a1-857e697f8deb None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.901335 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1546d8-6ad0-403f-b9a1-857e697f8deb None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.901610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1546d8-6ad0-403f-b9a1-857e697f8deb None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.903269 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 807/1616] 10.222.0.27 () {54 vars in 962 bytes} [Fri Aug 5 07:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:13:47.904822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df02b70-9101-4aff-bf94-2c22bfc6606f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.905124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df02b70-9101-4aff-bf94-2c22bfc6606f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.905451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df02b70-9101-4aff-bf94-2c22bfc6606f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.938201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-3df02b70-9101-4aff-bf94-2c22bfc6606f None None] MFA Rules not processed for user `bc86aa22af8548cfb4147d85e71487d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:47.939547 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3df02b70-9101-4aff-bf94-2c22bfc6606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:47.941840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 810/1617] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:47.943227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de890-c034-43e0-bdb6-5a86da79a40e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:47.957673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de890-c034-43e0-bdb6-5a86da79a40e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:47.965442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6aabf-0230-4253-bd3c-b501f478c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:47.966537 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6aabf-0230-4253-bd3c-b501f478c29b admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:47.966912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6aabf-0230-4253-bd3c-b501f478c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:47.967313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6aabf-0230-4253-bd3c-b501f478c29b admin admin] PATH_INFO: `/v3/projects/2222eb5a023a406aa5767bd10edfdec9/users/7e16b95fde6b4e10b245bd2fa030b88d/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:47.969984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6aabf-0230-4253-bd3c-b501f478c29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2222eb5a023a406aa5767bd10edfdec9, user_id=7e16b95fde6b4e10b245bd2fa030b88d, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:47.973913 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6aabf-0230-4253-bd3c-b501f478c29b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:47.991735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 811/1618] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:47 2022] PUT /identity/v3/projects/2222eb5a023a406aa5767bd10edfdec9/users/7e16b95fde6b4e10b245bd2fa030b88d/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:47.993279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6aabf-0230-4253-bd3c-b501f478c29b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:48.017216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 808/1619] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:48.017216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df02b70-9101-4aff-bf94-2c22bfc6606f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:48.019583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:48.062324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6aabf-0230-4253-bd3c-b501f478c29b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:48.067691 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac0562-1fd9-441e-9174-699e3014a158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:48.068325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac0562-1fd9-441e-9174-699e3014a158 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.068599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac0562-1fd9-441e-9174-699e3014a158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.068868 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac0562-1fd9-441e-9174-699e3014a158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.086641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df02b70-9101-4aff-bf94-2c22bfc6606f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:48.091092 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f2205-6ef2-4a9e-ad8b-50dcefd8afd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:48.091777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f2205-6ef2-4a9e-ad8b-50dcefd8afd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.092062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f2205-6ef2-4a9e-ad8b-50dcefd8afd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.092440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f2205-6ef2-4a9e-ad8b-50dcefd8afd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.121275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:48.172316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac0562-1fd9-441e-9174-699e3014a158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:48.174115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac0562-1fd9-441e-9174-699e3014a158 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:48.195643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f2205-6ef2-4a9e-ad8b-50dcefd8afd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:48.198516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 812/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:48.199315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f2205-6ef2-4a9e-ad8b-50dcefd8afd3 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:48.200738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bae6e-6b32-4071-83f2-4e3cd16368f8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.200738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bae6e-6b32-4071-83f2-4e3cd16368f8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.200738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bae6e-6b32-4071-83f2-4e3cd16368f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.218665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 809/1621] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:48.219689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f2205-6ef2-4a9e-ad8b-50dcefd8afd3 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:48.230994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f2205-6ef2-4a9e-ad8b-50dcefd8afd3 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:48.235082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152ca51-04a6-4cf8-8630-07a4eb0ddfaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:48.237059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152ca51-04a6-4cf8-8630-07a4eb0ddfaf service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.237349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152ca51-04a6-4cf8-8630-07a4eb0ddfaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.237708 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152ca51-04a6-4cf8-8630-07a4eb0ddfaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.252934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152ca51-04a6-4cf8-8630-07a4eb0ddfaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:48.253262 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3b1bae6e-6b32-4071-83f2-4e3cd16368f8 None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:48.254415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152ca51-04a6-4cf8-8630-07a4eb0ddfaf service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:48.254681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3b1bae6e-6b32-4071-83f2-4e3cd16368f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:48.269188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 810/1622] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:48.270352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591ff12-6dc9-41ae-a076-efab1637bbca None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.270724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591ff12-6dc9-41ae-a076-efab1637bbca None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.271100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591ff12-6dc9-41ae-a076-efab1637bbca None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.272494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 811/1623] 10.222.0.27 () {54 vars in 962 bytes} [Fri Aug 5 07:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:13:48.273677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7211-ecad-4673-8382-6a3dbcba899b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.274052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7211-ecad-4673-8382-6a3dbcba899b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.274433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7211-ecad-4673-8382-6a3dbcba899b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.321160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-175c7211-ecad-4673-8382-6a3dbcba899b None None] MFA Rules not processed for user `7e16b95fde6b4e10b245bd2fa030b88d`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:48.322601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-175c7211-ecad-4673-8382-6a3dbcba899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:48.355019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 813/1624] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Aug 5 07:13:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:48.356044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bae6e-6b32-4071-83f2-4e3cd16368f8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:48.378499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bae6e-6b32-4071-83f2-4e3cd16368f8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:48.386304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea732a-1cdf-4060-a3c5-8102112b1d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:48.387152 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea732a-1cdf-4060-a3c5-8102112b1d91 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.388516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea732a-1cdf-4060-a3c5-8102112b1d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.388516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea732a-1cdf-4060-a3c5-8102112b1d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.388516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea732a-1cdf-4060-a3c5-8102112b1d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:48.390718 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea732a-1cdf-4060-a3c5-8102112b1d91 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:48.424789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 812/1625] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:48.426479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fc7d8-ff31-4465-bccd-7c9535cf93ec None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.427198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fc7d8-ff31-4465-bccd-7c9535cf93ec None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.427611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fc7d8-ff31-4465-bccd-7c9535cf93ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.427957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 814/1626] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:48 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:48.428948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea732a-1cdf-4060-a3c5-8102112b1d91 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:48.453533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-558fc7d8-ff31-4465-bccd-7c9535cf93ec None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:48.455183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-558fc7d8-ff31-4465-bccd-7c9535cf93ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:48.477741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:48.543530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea732a-1cdf-4060-a3c5-8102112b1d91 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:48.548760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 813/1627] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Aug 5 07:13:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:48.549863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fc7d8-ff31-4465-bccd-7c9535cf93ec None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:48.551092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209f934-2521-481f-a408-17bd9b3bf72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:48.553649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209f934-2521-481f-a408-17bd9b3bf72a service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.553921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209f934-2521-481f-a408-17bd9b3bf72a service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.554195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209f934-2521-481f-a408-17bd9b3bf72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.574143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:48.630219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209f934-2521-481f-a408-17bd9b3bf72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:48.632278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209f934-2521-481f-a408-17bd9b3bf72a service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:48.637215 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fc7d8-ff31-4465-bccd-7c9535cf93ec None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:48.642915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d0e05-4509-41ed-b5e6-c1794f117d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:48.643683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d0e05-4509-41ed-b5e6-c1794f117d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.643969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d0e05-4509-41ed-b5e6-c1794f117d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.644228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d0e05-4509-41ed-b5e6-c1794f117d5c admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.644460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 815/1628] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:48.645425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209f934-2521-481f-a408-17bd9b3bf72a service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:48.654267 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d0e05-4509-41ed-b5e6-c1794f117d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:48.656958 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d0e05-4509-41ed-b5e6-c1794f117d5c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:48.697841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 814/1629] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:13:48 2022] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:48.700448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d0e05-4509-41ed-b5e6-c1794f117d5c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:48.719676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d0e05-4509-41ed-b5e6-c1794f117d5c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:48.731179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56473754-6e0f-4c4f-aaa6-ba62b12265e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:48.731968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56473754-6e0f-4c4f-aaa6-ba62b12265e2 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.732463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56473754-6e0f-4c4f-aaa6-ba62b12265e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.733020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56473754-6e0f-4c4f-aaa6-ba62b12265e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.735188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209f934-2521-481f-a408-17bd9b3bf72a service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:48.740413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2174c56-6de6-4135-bd30-9048d5e77e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:48.741726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2174c56-6de6-4135-bd30-9048d5e77e90 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.742242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2174c56-6de6-4135-bd30-9048d5e77e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.742624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2174c56-6de6-4135-bd30-9048d5e77e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.827098 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2174c56-6de6-4135-bd30-9048d5e77e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:48.827497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56473754-6e0f-4c4f-aaa6-ba62b12265e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:48.828908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2174c56-6de6-4135-bd30-9048d5e77e90 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:48.829214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56473754-6e0f-4c4f-aaa6-ba62b12265e2 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:48.840764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 816/1630] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:48.842028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2174c56-6de6-4135-bd30-9048d5e77e90 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:48.853036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 815/1631] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:48.854524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2174c56-6de6-4135-bd30-9048d5e77e90 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:48.866217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b856d-bcd0-4ba1-b689-7444d56279bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:48.868169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b856d-bcd0-4ba1-b689-7444d56279bd admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.868521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b856d-bcd0-4ba1-b689-7444d56279bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.869393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b856d-bcd0-4ba1-b689-7444d56279bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.871325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b856d-bcd0-4ba1-b689-7444d56279bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:48.874345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b856d-bcd0-4ba1-b689-7444d56279bd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:48.911417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56473754-6e0f-4c4f-aaa6-ba62b12265e2 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:48.923108 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 817/1632] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:48.925796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56473754-6e0f-4c4f-aaa6-ba62b12265e2 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:48.932495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32517-3da0-48a6-a8ce-6fcfe3c7304b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.932864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32517-3da0-48a6-a8ce-6fcfe3c7304b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.933211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32517-3da0-48a6-a8ce-6fcfe3c7304b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.934856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 818/1633] 10.222.0.27 () {54 vars in 912 bytes} [Fri Aug 5 07:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:13:48.937736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789c34f-54d0-4210-90c3-8e16392da0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:48.938444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789c34f-54d0-4210-90c3-8e16392da0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.938725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789c34f-54d0-4210-90c3-8e16392da0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.939091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789c34f-54d0-4210-90c3-8e16392da0e6 admin admin] PATH_INFO: `/v3/projects/0b6dc0e56919427cb92fc5906b967ce9/users/7b2fa34e6a704803aac380e1ce74e8e5/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.942968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187da54-5dc0-46f7-afb2-e0ed0fc5c6fd None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:48.943281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187da54-5dc0-46f7-afb2-e0ed0fc5c6fd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:48.943598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187da54-5dc0-46f7-afb2-e0ed0fc5c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:48.953861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:48.964540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789c34f-54d0-4210-90c3-8e16392da0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6dc0e56919427cb92fc5906b967ce9, user_id=7b2fa34e6a704803aac380e1ce74e8e5, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:48.968283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789c34f-54d0-4210-90c3-8e16392da0e6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:48.979498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e187da54-5dc0-46f7-afb2-e0ed0fc5c6fd None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:48.982643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e187da54-5dc0-46f7-afb2-e0ed0fc5c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:48.993671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 816/1634] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:48 2022] PUT /identity/v3/projects/0b6dc0e56919427cb92fc5906b967ce9/users/7b2fa34e6a704803aac380e1ce74e8e5/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:49.008444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789c34f-54d0-4210-90c3-8e16392da0e6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:49.078567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789c34f-54d0-4210-90c3-8e16392da0e6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:49.084432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a9d45-96c2-4953-8bcb-d5ef65aec662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:49.085160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a9d45-96c2-4953-8bcb-d5ef65aec662 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:49.085442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a9d45-96c2-4953-8bcb-d5ef65aec662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:49.085718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a9d45-96c2-4953-8bcb-d5ef65aec662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:49.086429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a9d45-96c2-4953-8bcb-d5ef65aec662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:49.088168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a9d45-96c2-4953-8bcb-d5ef65aec662 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:49.100088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 817/1635] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:49.101175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a9d45-96c2-4953-8bcb-d5ef65aec662 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:49.103304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 819/1636] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:13:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:13:49.104333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187da54-5dc0-46f7-afb2-e0ed0fc5c6fd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:49.122236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187da54-5dc0-46f7-afb2-e0ed0fc5c6fd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:49.128403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60c9b-ff58-4010-8992-b836bd1374fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:49.129461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60c9b-ff58-4010-8992-b836bd1374fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:49.129839 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60c9b-ff58-4010-8992-b836bd1374fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:49.130311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd60c9b-ff58-4010-8992-b836bd1374fd admin admin] PATH_INFO: `/v3/projects/0b6dc0e56919427cb92fc5906b967ce9/users/7b2fa34e6a704803aac380e1ce74e8e5/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:49.137984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd60c9b-ff58-4010-8992-b836bd1374fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6dc0e56919427cb92fc5906b967ce9, user_id=7b2fa34e6a704803aac380e1ce74e8e5, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:49.139218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:49.143005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd60c9b-ff58-4010-8992-b836bd1374fd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:49.166224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 820/1637] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:49 2022] PUT /identity/v3/projects/0b6dc0e56919427cb92fc5906b967ce9/users/7b2fa34e6a704803aac380e1ce74e8e5/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:49.168187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60c9b-ff58-4010-8992-b836bd1374fd admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:49.259391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd60c9b-ff58-4010-8992-b836bd1374fd admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:49.264227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1463e43-3846-486e-b844-84997d2bdb29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:49.265199 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1463e43-3846-486e-b844-84997d2bdb29 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:49.265824 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1463e43-3846-486e-b844-84997d2bdb29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:49.266143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1463e43-3846-486e-b844-84997d2bdb29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:49.272104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a9d45-96c2-4953-8bcb-d5ef65aec662 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:49.284569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3061b46-4e76-43c0-bd3e-3676778ac87b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:49.286008 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3061b46-4e76-43c0-bd3e-3676778ac87b service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:49.286513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3061b46-4e76-43c0-bd3e-3676778ac87b service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:49.286806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3061b46-4e76-43c0-bd3e-3676778ac87b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:49.399405 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1463e43-3846-486e-b844-84997d2bdb29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:49.401277 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1463e43-3846-486e-b844-84997d2bdb29 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:49.421862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3061b46-4e76-43c0-bd3e-3676778ac87b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:49.423780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3061b46-4e76-43c0-bd3e-3676778ac87b service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:49.440684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 821/1638] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:49.447892 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37adf-f711-4922-8af0-78e5a7dd95fc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:49.448499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37adf-f711-4922-8af0-78e5a7dd95fc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:49.450224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d37adf-f711-4922-8af0-78e5a7dd95fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:49.460295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 818/1639] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:49.461796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9f68b-a9bd-4c32-b89f-c419474b7659 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:49.465077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9f68b-a9bd-4c32-b89f-c419474b7659 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:49.465932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9f68b-a9bd-4c32-b89f-c419474b7659 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:49.472318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 819/1640] 10.222.0.27 () {54 vars in 912 bytes} [Fri Aug 5 07:13:49 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:13:49.477394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed977439-f685-4817-bb5e-3d356e07c935 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:49.478784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed977439-f685-4817-bb5e-3d356e07c935 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:49.480428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed977439-f685-4817-bb5e-3d356e07c935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:49.531547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a4d37adf-f711-4922-8af0-78e5a7dd95fc None None] MFA Rules not processed for user `7b2fa34e6a704803aac380e1ce74e8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:49.532878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a4d37adf-f711-4922-8af0-78e5a7dd95fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:49.541190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ed977439-f685-4817-bb5e-3d356e07c935 None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:49.543239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ed977439-f685-4817-bb5e-3d356e07c935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:49.568813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:49.586536 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 820/1641] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:13:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:49.724456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 822/1642] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:49.865405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed977439-f685-4817-bb5e-3d356e07c935 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:49.879080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed977439-f685-4817-bb5e-3d356e07c935 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:49.892211 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dc81f-c0b3-4fbc-bb39-39c9dadedb3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:49.895077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dc81f-c0b3-4fbc-bb39-39c9dadedb3b service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:49.895368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dc81f-c0b3-4fbc-bb39-39c9dadedb3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:49.895652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dc81f-c0b3-4fbc-bb39-39c9dadedb3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:49.935746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dc81f-c0b3-4fbc-bb39-39c9dadedb3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:49.942485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dc81f-c0b3-4fbc-bb39-39c9dadedb3b service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:49.971629 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 821/1643] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:50.168365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37adf-f711-4922-8af0-78e5a7dd95fc None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:50.181111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d37adf-f711-4922-8af0-78e5a7dd95fc None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:50.193032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d31184-268b-490e-b64a-d804d62bd26e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:50.197323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d31184-268b-490e-b64a-d804d62bd26e service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:50.197323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d31184-268b-490e-b64a-d804d62bd26e service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:50.197323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d31184-268b-490e-b64a-d804d62bd26e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:50.209652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d31184-268b-490e-b64a-d804d62bd26e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:50.211275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d31184-268b-490e-b64a-d804d62bd26e service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:50.241614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 823/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:50.470666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dc81f-c0b3-4fbc-bb39-39c9dadedb3b service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:50.489264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dc81f-c0b3-4fbc-bb39-39c9dadedb3b service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:50.499751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2c16a-3d4d-49cc-8525-34a577983f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:50.501065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2c16a-3d4d-49cc-8525-34a577983f57 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:50.502611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2c16a-3d4d-49cc-8525-34a577983f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:50.504086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2c16a-3d4d-49cc-8525-34a577983f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:50.684955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2c16a-3d4d-49cc-8525-34a577983f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:50.688973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2c16a-3d4d-49cc-8525-34a577983f57 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:50.734802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 822/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:50.810510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d31184-268b-490e-b64a-d804d62bd26e service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:51.033158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d31184-268b-490e-b64a-d804d62bd26e service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:51.050883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:51.052854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:51.053614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:51.054081 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] PATH_INFO: `/v3/users/fd2a5862bd074a548ca0189107777cc9` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:51.056024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2a5862bd074a548ca0189107777cc9)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:51.168353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:51.242564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2a5862bd074a548ca0189107777cc9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:51.244696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2a5862bd074a548ca0189107777cc9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:51.268832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2a5862bd074a548ca0189107777cc9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:51.271194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2a5862bd074a548ca0189107777cc9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:51.300647 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2a5862bd074a548ca0189107777cc9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:51.334964 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 824/1646] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:13:50 2022] DELETE /identity/v3/users/fd2a5862bd074a548ca0189107777cc9 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:51.339753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96585b-af3a-497e-a14c-9d0457f25f7f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:51.340298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96585b-af3a-497e-a14c-9d0457f25f7f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:51.340674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96585b-af3a-497e-a14c-9d0457f25f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:51.367582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0e96585b-af3a-497e-a14c-9d0457f25f7f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:51.369659 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0e96585b-af3a-497e-a14c-9d0457f25f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:51.469013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:51.501277 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 823/1647] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:51.619010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:51.621981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:51.644467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:51.755676 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c7c82-feaa-4dab-aa67-3a498239f84a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:51.763149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378454fd-6363-4853-83c8-dd7576494e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:51.763844 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378454fd-6363-4853-83c8-dd7576494e21 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:51.764123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378454fd-6363-4853-83c8-dd7576494e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:51.767162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378454fd-6363-4853-83c8-dd7576494e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:51.779477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378454fd-6363-4853-83c8-dd7576494e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:51.781049 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378454fd-6363-4853-83c8-dd7576494e21 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:51.793474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 825/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:53.223458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96585b-af3a-497e-a14c-9d0457f25f7f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:53.225789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0e96585b-af3a-497e-a14c-9d0457f25f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:53.240874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96585b-af3a-497e-a14c-9d0457f25f7f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:53.246534 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:53.247914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:53.248395 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:53.249462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] PATH_INFO: `/v3/users/24efa5390f7e4d939eedf92c09e10495` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:53.251695 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24efa5390f7e4d939eedf92c09e10495)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:53.253465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: WARNING py.warnings [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:13:53.253465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: warnings.warn(msg) Aug 05 07:13:53.253465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: Aug 05 07:13:53.255045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:53.415565 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24efa5390f7e4d939eedf92c09e10495'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:53.443196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24efa5390f7e4d939eedf92c09e10495'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:53.469960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24efa5390f7e4d939eedf92c09e10495'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:53.470869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24efa5390f7e4d939eedf92c09e10495'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:53.520957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24efa5390f7e4d939eedf92c09e10495'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:53.543870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600519f8-b0ee-4e32-a936-7625e0ff33bf None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:53.546473 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600519f8-b0ee-4e32-a936-7625e0ff33bf None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:53.547012 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600519f8-b0ee-4e32-a936-7625e0ff33bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:53.549399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 824/1649] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:13:53 2022] DELETE /identity/v3/users/24efa5390f7e4d939eedf92c09e10495 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:53.601594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-600519f8-b0ee-4e32-a936-7625e0ff33bf None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:53.602886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-600519f8-b0ee-4e32-a936-7625e0ff33bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:53.746188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 826/1650] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:13:53.824139 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:53.827915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:53.883617 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600519f8-b0ee-4e32-a936-7625e0ff33bf None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:53.885464 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-600519f8-b0ee-4e32-a936-7625e0ff33bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:53.906688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600519f8-b0ee-4e32-a936-7625e0ff33bf None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:53.918013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:53.918749 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:53.919099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:53.919377 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] PATH_INFO: `/v3/projects/efa588d5331d4d0b9ade4c0af72eac8d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:53.922556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa588d5331d4d0b9ade4c0af72eac8d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:53.923614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 07:13:53.923614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: warnings.warn(msg) Aug 05 07:13:53.923614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: Aug 05 07:13:53.927572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:54.057624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa588d5331d4d0b9ade4c0af72eac8d', 'request_id': 'req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:54.079056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa588d5331d4d0b9ade4c0af72eac8d', 'request_id': 'req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:54.094850 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d28a1-b6f3-4bf6-9fbd-8e5f72612000 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:54.096113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa588d5331d4d0b9ade4c0af72eac8d', 'request_id': 'req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:54.144798 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] The token cache is being invalidate because project efa588d5331d4d0b9ade4c0af72eac8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:13:54.145127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:54.146235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ade63e84-7ab8-4986-b0ec-3b06f2e49b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:54.150531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 827/1651] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:13:53 2022] DELETE /identity/v3/projects/efa588d5331d4d0b9ade4c0af72eac8d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:54.155573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c8792-49de-4022-93dd-deef7845b56b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:54.155859 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c8792-49de-4022-93dd-deef7845b56b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:54.156138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c8792-49de-4022-93dd-deef7845b56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:54.207019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5b9c8792-49de-4022-93dd-deef7845b56b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:54.208304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5b9c8792-49de-4022-93dd-deef7845b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:54.230374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863b29c-2647-4bec-a33b-1fde2bd7a111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:54.231818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863b29c-2647-4bec-a33b-1fde2bd7a111 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:54.232169 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863b29c-2647-4bec-a33b-1fde2bd7a111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:54.232356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863b29c-2647-4bec-a33b-1fde2bd7a111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:54.240235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8863b29c-2647-4bec-a33b-1fde2bd7a111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:54.317442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:54.320318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:54.384089 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 828/1652] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:13:54.393373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b30d8-344e-4ea5-b3d4-c995f1cfaa30 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:54.393373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b30d8-344e-4ea5-b3d4-c995f1cfaa30 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:54.394084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b30d8-344e-4ea5-b3d4-c995f1cfaa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:54.430783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863b29c-2647-4bec-a33b-1fde2bd7a111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:54.432379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863b29c-2647-4bec-a33b-1fde2bd7a111 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:54.438149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e40b30d8-344e-4ea5-b3d4-c995f1cfaa30 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:54.440381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e40b30d8-344e-4ea5-b3d4-c995f1cfaa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:54.456323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 829/1653] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:54.460749 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b30d8-344e-4ea5-b3d4-c995f1cfaa30 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:54.467170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 825/1654] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:54.477572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b30d8-344e-4ea5-b3d4-c995f1cfaa30 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:54.484180 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36aeba-1e0b-41aa-931d-5ed7ed2914d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:54.484877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36aeba-1e0b-41aa-931d-5ed7ed2914d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:54.485222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36aeba-1e0b-41aa-931d-5ed7ed2914d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:54.485455 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36aeba-1e0b-41aa-931d-5ed7ed2914d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:54.486695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36aeba-1e0b-41aa-931d-5ed7ed2914d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:13:54.487084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36aeba-1e0b-41aa-931d-5ed7ed2914d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:54.490298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36aeba-1e0b-41aa-931d-5ed7ed2914d7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:54.509317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 830/1655] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:13:54.513890 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863b29c-2647-4bec-a33b-1fde2bd7a111 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:54.526783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863b29c-2647-4bec-a33b-1fde2bd7a111 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:54.542934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5643b-574c-42c4-b608-4cf09118a8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:54.543709 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5643b-574c-42c4-b608-4cf09118a8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:54.544645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5643b-574c-42c4-b608-4cf09118a8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:54.544645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5643b-574c-42c4-b608-4cf09118a8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:54.545325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5643b-574c-42c4-b608-4cf09118a8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:54.548305 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb5643b-574c-42c4-b608-4cf09118a8e1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:54.603297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 826/1656] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:54 2022] POST /identity/v3/projects => generated 403 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:13:54.603874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36aeba-1e0b-41aa-931d-5ed7ed2914d7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:54.619821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36aeba-1e0b-41aa-931d-5ed7ed2914d7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:54.750738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5643b-574c-42c4-b608-4cf09118a8e1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:54.752669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fdb5643b-574c-42c4-b608-4cf09118a8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:54.769390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991349a-551b-4492-91bc-4d588f83d8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:54.770417 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991349a-551b-4492-91bc-4d588f83d8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:54.770417 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991349a-551b-4492-91bc-4d588f83d8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:54.770600 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991349a-551b-4492-91bc-4d588f83d8e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:54.774763 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991349a-551b-4492-91bc-4d588f83d8e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:54.775976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5643b-574c-42c4-b608-4cf09118a8e1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:54.777947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991349a-551b-4492-91bc-4d588f83d8e4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:54.802344 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893230e-0b0d-434c-b81d-a934413bb177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:54.803113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893230e-0b0d-434c-b81d-a934413bb177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:54.803526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893230e-0b0d-434c-b81d-a934413bb177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:54.803808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893230e-0b0d-434c-b81d-a934413bb177 admin admin] PATH_INFO: `/v3/users/fbd4cecd32204f9fa60348534afa5217` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:54.810974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893230e-0b0d-434c-b81d-a934413bb177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd4cecd32204f9fa60348534afa5217)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:54.817311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893230e-0b0d-434c-b81d-a934413bb177 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:54.830607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 831/1657] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:13:54 2022] POST /identity/v3/users => generated 302 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:54.835106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991349a-551b-4492-91bc-4d588f83d8e4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:54.869191 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991349a-551b-4492-91bc-4d588f83d8e4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:54.889111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be98fa-fad7-4f75-8e62-ea2cbbc89b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:54.889757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be98fa-fad7-4f75-8e62-ea2cbbc89b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:54.890074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be98fa-fad7-4f75-8e62-ea2cbbc89b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:54.890350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be98fa-fad7-4f75-8e62-ea2cbbc89b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:54.891211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be98fa-fad7-4f75-8e62-ea2cbbc89b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:54.892684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be98fa-fad7-4f75-8e62-ea2cbbc89b90 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:54.915780 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 832/1658] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:54.919722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be98fa-fad7-4f75-8e62-ea2cbbc89b90 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:54.937748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6893230e-0b0d-434c-b81d-a934413bb177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd4cecd32204f9fa60348534afa5217'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:54.939171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be98fa-fad7-4f75-8e62-ea2cbbc89b90 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:54.944556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce57f1e-b1d0-4beb-bc29-4c9ba2a42f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:54.945528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce57f1e-b1d0-4beb-bc29-4c9ba2a42f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:54.946000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce57f1e-b1d0-4beb-bc29-4c9ba2a42f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:54.946369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce57f1e-b1d0-4beb-bc29-4c9ba2a42f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:54.947305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce57f1e-b1d0-4beb-bc29-4c9ba2a42f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:54.948502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6893230e-0b0d-434c-b81d-a934413bb177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd4cecd32204f9fa60348534afa5217'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:54.950103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce57f1e-b1d0-4beb-bc29-4c9ba2a42f4c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:54.966287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 833/1659] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:54.969758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6893230e-0b0d-434c-b81d-a934413bb177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd4cecd32204f9fa60348534afa5217'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:54.970718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6893230e-0b0d-434c-b81d-a934413bb177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd4cecd32204f9fa60348534afa5217'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:54.970830 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce57f1e-b1d0-4beb-bc29-4c9ba2a42f4c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:54.989662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce57f1e-b1d0-4beb-bc29-4c9ba2a42f4c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:55.000755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed28225-f92b-4d40-9f38-f03db0d1c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:55.001669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6893230e-0b0d-434c-b81d-a934413bb177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd4cecd32204f9fa60348534afa5217'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:55.001822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed28225-f92b-4d40-9f38-f03db0d1c6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:55.002232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed28225-f92b-4d40-9f38-f03db0d1c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:55.002613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed28225-f92b-4d40-9f38-f03db0d1c6e7 admin admin] PATH_INFO: `/v3/projects/329af868e9fd4ebba224241aa9e576f0/users/1a1bda7ed40242749e7caf03c882c501/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:55.013756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 827/1660] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:13:54 2022] DELETE /identity/v3/users/fbd4cecd32204f9fa60348534afa5217 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:55.019601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc7a1-066d-4f45-8837-a0c47b82cc50 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:55.020191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc7a1-066d-4f45-8837-a0c47b82cc50 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:55.020615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc7a1-066d-4f45-8837-a0c47b82cc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:55.032143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed28225-f92b-4d40-9f38-f03db0d1c6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=329af868e9fd4ebba224241aa9e576f0, user_id=1a1bda7ed40242749e7caf03c882c501, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:55.036720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed28225-f92b-4d40-9f38-f03db0d1c6e7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:55.052431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8ccbc7a1-066d-4f45-8837-a0c47b82cc50 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:55.055707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8ccbc7a1-066d-4f45-8837-a0c47b82cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:55.063114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 834/1661] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:54 2022] PUT /identity/v3/projects/329af868e9fd4ebba224241aa9e576f0/users/1a1bda7ed40242749e7caf03c882c501/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:13:55.068478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2370-0e28-4fe3-80b7-9e7f1a93284f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:55.068885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2370-0e28-4fe3-80b7-9e7f1a93284f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:55.069276 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2370-0e28-4fe3-80b7-9e7f1a93284f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:55.101522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-616d2370-0e28-4fe3-80b7-9e7f1a93284f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:55.105159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-616d2370-0e28-4fe3-80b7-9e7f1a93284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:55.194117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 828/1662] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:55.233231 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 835/1663] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:13:55.315890 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc7a1-066d-4f45-8837-a0c47b82cc50 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:55.318430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8ccbc7a1-066d-4f45-8837-a0c47b82cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:55.361198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:55.414723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2370-0e28-4fe3-80b7-9e7f1a93284f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:55.416202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-616d2370-0e28-4fe3-80b7-9e7f1a93284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:55.425872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:55.514843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc7a1-066d-4f45-8837-a0c47b82cc50 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:55.524212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466125e-bd76-41dd-8124-a95a87db01b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:55.525087 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466125e-bd76-41dd-8124-a95a87db01b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:55.526922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466125e-bd76-41dd-8124-a95a87db01b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:55.527614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466125e-bd76-41dd-8124-a95a87db01b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:55.564257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466125e-bd76-41dd-8124-a95a87db01b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:55.565902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466125e-bd76-41dd-8124-a95a87db01b8 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:55.604344 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 829/1664] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:55.647777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2370-0e28-4fe3-80b7-9e7f1a93284f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:55.659780 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df158963-3ac7-4381-9118-bf8a353546c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:55.660873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df158963-3ac7-4381-9118-bf8a353546c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:55.663389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df158963-3ac7-4381-9118-bf8a353546c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:55.664142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df158963-3ac7-4381-9118-bf8a353546c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:55.686097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df158963-3ac7-4381-9118-bf8a353546c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:55.687821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df158963-3ac7-4381-9118-bf8a353546c7 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:55.704529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 836/1665] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:13:56.922037 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad5f41-faf0-46de-b7e7-8e71ece20512 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:56.922507 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad5f41-faf0-46de-b7e7-8e71ece20512 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:56.922684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad5f41-faf0-46de-b7e7-8e71ece20512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:56.972302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-69ad5f41-faf0-46de-b7e7-8e71ece20512 None None] MFA Rules not processed for user `096d0da1a0bc401c95bfbb8fc150a27b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:56.977377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-69ad5f41-faf0-46de-b7e7-8e71ece20512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:57.167363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 830/1666] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:57.185821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df158963-3ac7-4381-9118-bf8a353546c7 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:57.187487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-df158963-3ac7-4381-9118-bf8a353546c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:57.369355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df158963-3ac7-4381-9118-bf8a353546c7 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:57.377995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ec4ae-f722-494f-9dad-cff626de9346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:57.379033 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec4ae-f722-494f-9dad-cff626de9346 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:57.379519 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec4ae-f722-494f-9dad-cff626de9346 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:57.380045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ec4ae-f722-494f-9dad-cff626de9346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:57.397271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ec4ae-f722-494f-9dad-cff626de9346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:57.399315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ec4ae-f722-494f-9dad-cff626de9346 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:57.416937 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 837/1667] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:13:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:13:57.902397 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad5f41-faf0-46de-b7e7-8e71ece20512 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:57.905521 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-69ad5f41-faf0-46de-b7e7-8e71ece20512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:57.952968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad5f41-faf0-46de-b7e7-8e71ece20512 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:57.964006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:57.965309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:57.966747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:57.967261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] PATH_INFO: `/v3/projects/10ee756b53524736aeeb3254bdaeaf6c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:57.970335 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ee756b53524736aeeb3254bdaeaf6c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:57.975638 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:58.161316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ee756b53524736aeeb3254bdaeaf6c', 'request_id': 'req-3578a6b4-12e1-43ab-b29c-8fc3dd935877'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.173355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ee756b53524736aeeb3254bdaeaf6c', 'request_id': 'req-3578a6b4-12e1-43ab-b29c-8fc3dd935877'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.186341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ee756b53524736aeeb3254bdaeaf6c', 'request_id': 'req-3578a6b4-12e1-43ab-b29c-8fc3dd935877'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.206071 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ec4ae-f722-494f-9dad-cff626de9346 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:58.209193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7a0ec4ae-f722-494f-9dad-cff626de9346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:58.215923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] The token cache is being invalidate because project 10ee756b53524736aeeb3254bdaeaf6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:13:58.218670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.219545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.221276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 831/1668] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:13:57 2022] DELETE /identity/v3/projects/10ee756b53524736aeeb3254bdaeaf6c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:58.226729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:58.234822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:58.249869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ec4ae-f722-494f-9dad-cff626de9346 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:58.353887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:58.467465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578a6b4-12e1-43ab-b29c-8fc3dd935877 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:58.472743 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b465e5a-6803-4d40-92bb-7a2c00001261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:58.473492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465e5a-6803-4d40-92bb-7a2c00001261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:58.473776 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465e5a-6803-4d40-92bb-7a2c00001261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:58.474054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b465e5a-6803-4d40-92bb-7a2c00001261 admin admin] PATH_INFO: `/v3/projects/fd750a5a13ab4cb690b328abdd67872c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:58.476919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b465e5a-6803-4d40-92bb-7a2c00001261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd750a5a13ab4cb690b328abdd67872c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:58.478935 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b465e5a-6803-4d40-92bb-7a2c00001261 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:58.484076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5297cbe-0f3b-4dba-a771-0bbd4125a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:58.484925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5297cbe-0f3b-4dba-a771-0bbd4125a6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:58.485218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5297cbe-0f3b-4dba-a771-0bbd4125a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:58.485499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5297cbe-0f3b-4dba-a771-0bbd4125a6fc admin admin] PATH_INFO: `/v3/users/7e16b95fde6b4e10b245bd2fa030b88d` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:58.487112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5297cbe-0f3b-4dba-a771-0bbd4125a6fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e16b95fde6b4e10b245bd2fa030b88d)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:58.497383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5297cbe-0f3b-4dba-a771-0bbd4125a6fc admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:58.601018 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:58.611523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b5297cbe-0f3b-4dba-a771-0bbd4125a6fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e16b95fde6b4e10b245bd2fa030b88d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.639256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4b465e5a-6803-4d40-92bb-7a2c00001261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd750a5a13ab4cb690b328abdd67872c', 'request_id': 'req-4b465e5a-6803-4d40-92bb-7a2c00001261'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.643707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b5297cbe-0f3b-4dba-a771-0bbd4125a6fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e16b95fde6b4e10b245bd2fa030b88d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.662521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4b465e5a-6803-4d40-92bb-7a2c00001261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd750a5a13ab4cb690b328abdd67872c', 'request_id': 'req-4b465e5a-6803-4d40-92bb-7a2c00001261'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.665966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b5297cbe-0f3b-4dba-a771-0bbd4125a6fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e16b95fde6b4e10b245bd2fa030b88d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.666631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b5297cbe-0f3b-4dba-a771-0bbd4125a6fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e16b95fde6b4e10b245bd2fa030b88d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.694743 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4b465e5a-6803-4d40-92bb-7a2c00001261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd750a5a13ab4cb690b328abdd67872c', 'request_id': 'req-4b465e5a-6803-4d40-92bb-7a2c00001261'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.716974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b5297cbe-0f3b-4dba-a771-0bbd4125a6fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e16b95fde6b4e10b245bd2fa030b88d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.734596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4b465e5a-6803-4d40-92bb-7a2c00001261 admin admin] The token cache is being invalidate because project fd750a5a13ab4cb690b328abdd67872c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:13:58.735111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4b465e5a-6803-4d40-92bb-7a2c00001261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.736465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4b465e5a-6803-4d40-92bb-7a2c00001261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:13:58.738084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 832/1669] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:13:58 2022] DELETE /identity/v3/users/7e16b95fde6b4e10b245bd2fa030b88d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:13:58.744570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 838/1670] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:13:58 2022] DELETE /identity/v3/projects/fd750a5a13ab4cb690b328abdd67872c => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:13:58.754881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f306713-049f-4b16-a01e-4cd37c8dc332 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:58.755510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f306713-049f-4b16-a01e-4cd37c8dc332 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:58.755993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f306713-049f-4b16-a01e-4cd37c8dc332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:58.796755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7f306713-049f-4b16-a01e-4cd37c8dc332 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:58.798190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7f306713-049f-4b16-a01e-4cd37c8dc332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:58.940698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 833/1671] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:58.945241 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073c975-6318-4854-b1b2-ef1f629b550c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:58.946275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073c975-6318-4854-b1b2-ef1f629b550c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:58.947026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073c975-6318-4854-b1b2-ef1f629b550c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:59.037587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4073c975-6318-4854-b1b2-ef1f629b550c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:59.043533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4073c975-6318-4854-b1b2-ef1f629b550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:59.072148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 839/1672] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:59.077174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f306713-049f-4b16-a01e-4cd37c8dc332 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:59.093362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f306713-049f-4b16-a01e-4cd37c8dc332 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:59.125132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016e260-2e0b-41af-bac3-1258eb1a2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:59.126894 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016e260-2e0b-41af-bac3-1258eb1a2dad admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:59.129086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016e260-2e0b-41af-bac3-1258eb1a2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:59.130211 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016e260-2e0b-41af-bac3-1258eb1a2dad admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:59.131786 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016e260-2e0b-41af-bac3-1258eb1a2dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:13:59.134371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016e260-2e0b-41af-bac3-1258eb1a2dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:59.136161 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016e260-2e0b-41af-bac3-1258eb1a2dad admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:59.166678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 834/1673] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:13:59.172271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073c975-6318-4854-b1b2-ef1f629b550c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:59.186138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073c975-6318-4854-b1b2-ef1f629b550c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:59.191984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4fb31-f5fb-4206-a07d-3e10372661bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:59.192954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4fb31-f5fb-4206-a07d-3e10372661bc admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:59.193429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4fb31-f5fb-4206-a07d-3e10372661bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:59.193852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4fb31-f5fb-4206-a07d-3e10372661bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:59.194714 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4fb31-f5fb-4206-a07d-3e10372661bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:59.197142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4fb31-f5fb-4206-a07d-3e10372661bc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:59.285876 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016e260-2e0b-41af-bac3-1258eb1a2dad admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:59.298448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 840/1674] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:59 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:59.301629 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016e260-2e0b-41af-bac3-1258eb1a2dad admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:59.372864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:13:59.414075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6767c1-25bd-4151-ba15-bb2f25ac9a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:59.414320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6767c1-25bd-4151-ba15-bb2f25ac9a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:59.414575 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6767c1-25bd-4151-ba15-bb2f25ac9a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:59.414848 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6767c1-25bd-4151-ba15-bb2f25ac9a9a admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:59.415546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6767c1-25bd-4151-ba15-bb2f25ac9a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:59.417798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6767c1-25bd-4151-ba15-bb2f25ac9a9a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:59.454264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 835/1675] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:13:59 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:13:59.460586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4fb31-f5fb-4206-a07d-3e10372661bc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:59.477777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4fb31-f5fb-4206-a07d-3e10372661bc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:59.486700 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db01b3-c234-4ac6-b279-20b6ee899dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:59.487874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db01b3-c234-4ac6-b279-20b6ee899dfc admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:59.488333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db01b3-c234-4ac6-b279-20b6ee899dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:59.488816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db01b3-c234-4ac6-b279-20b6ee899dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:59.490166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db01b3-c234-4ac6-b279-20b6ee899dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:59.493334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db01b3-c234-4ac6-b279-20b6ee899dfc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:59.517781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6767c1-25bd-4151-ba15-bb2f25ac9a9a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:59.522419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 841/1676] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:59.540294 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6767c1-25bd-4151-ba15-bb2f25ac9a9a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:59.546394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7457eb-8136-444e-a2c5-1890c33b2f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:59.547052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7457eb-8136-444e-a2c5-1890c33b2f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:59.547485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7457eb-8136-444e-a2c5-1890c33b2f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:59.547930 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7457eb-8136-444e-a2c5-1890c33b2f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:59.548719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7457eb-8136-444e-a2c5-1890c33b2f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:59.550424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7457eb-8136-444e-a2c5-1890c33b2f15 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:59.568699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 836/1677] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:13:59.568992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db01b3-c234-4ac6-b279-20b6ee899dfc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:59.582834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db01b3-c234-4ac6-b279-20b6ee899dfc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:59.601112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b18848-c9ec-4550-b5c4-94e61a2dba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:13:59.602059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b18848-c9ec-4550-b5c4-94e61a2dba09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:59.602413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b18848-c9ec-4550-b5c4-94e61a2dba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:59.602740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b18848-c9ec-4550-b5c4-94e61a2dba09 admin admin] PATH_INFO: `/v3/projects/d89e58634d36449a9869ddb6d5fdef16/users/1b9238c6911c44d4a48ac7ad91d251dd/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:59.626422 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b18848-c9ec-4550-b5c4-94e61a2dba09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89e58634d36449a9869ddb6d5fdef16, user_id=1b9238c6911c44d4a48ac7ad91d251dd, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:13:59.631026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b18848-c9ec-4550-b5c4-94e61a2dba09 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:13:59.678320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20c1ef-614e-454b-81dd-663f1cd33c5c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:13:59.678924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20c1ef-614e-454b-81dd-663f1cd33c5c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:13:59.679352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20c1ef-614e-454b-81dd-663f1cd33c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:13:59.687718 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 842/1678] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:13:59 2022] PUT /identity/v3/projects/d89e58634d36449a9869ddb6d5fdef16/users/1b9238c6911c44d4a48ac7ad91d251dd/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:13:59.721879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2e20c1ef-614e-454b-81dd-663f1cd33c5c None None] MFA Rules not processed for user `1b9238c6911c44d4a48ac7ad91d251dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:13:59.723550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2e20c1ef-614e-454b-81dd-663f1cd33c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:59.757460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b18848-c9ec-4550-b5c4-94e61a2dba09 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:59.760376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-06b18848-c9ec-4550-b5c4-94e61a2dba09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:13:59.963483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 837/1679] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:13:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:13:59.964529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20c1ef-614e-454b-81dd-663f1cd33c5c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:13:59.991235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b18848-c9ec-4550-b5c4-94e61a2dba09 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:13:59.994180 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20c1ef-614e-454b-81dd-663f1cd33c5c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:00.002379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaba10f-3aba-465b-a5c1-520cbe6c315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:00.004612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be6176-0dd1-4580-abc3-4b9bdcbd2777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:00.005337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaba10f-3aba-465b-a5c1-520cbe6c315a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:00.005616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaba10f-3aba-465b-a5c1-520cbe6c315a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:00.005892 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaba10f-3aba-465b-a5c1-520cbe6c315a admin admin] PATH_INFO: `/v3/projects/2222eb5a023a406aa5767bd10edfdec9` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:00.007261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be6176-0dd1-4580-abc3-4b9bdcbd2777 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:00.008217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaba10f-3aba-465b-a5c1-520cbe6c315a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2222eb5a023a406aa5767bd10edfdec9)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:00.008598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be6176-0dd1-4580-abc3-4b9bdcbd2777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:00.009193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be6176-0dd1-4580-abc3-4b9bdcbd2777 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:00.009898 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be6176-0dd1-4580-abc3-4b9bdcbd2777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:00.012941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaba10f-3aba-465b-a5c1-520cbe6c315a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:00.014806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be6176-0dd1-4580-abc3-4b9bdcbd2777 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:00.091963 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 838/1680] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:13:59 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:00.099219 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be6176-0dd1-4580-abc3-4b9bdcbd2777 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:00.183772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eeaba10f-3aba-465b-a5c1-520cbe6c315a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2222eb5a023a406aa5767bd10edfdec9', 'request_id': 'req-eeaba10f-3aba-465b-a5c1-520cbe6c315a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:00.217658 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eeaba10f-3aba-465b-a5c1-520cbe6c315a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2222eb5a023a406aa5767bd10edfdec9', 'request_id': 'req-eeaba10f-3aba-465b-a5c1-520cbe6c315a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:00.228410 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:00.253677 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eeaba10f-3aba-465b-a5c1-520cbe6c315a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2222eb5a023a406aa5767bd10edfdec9', 'request_id': 'req-eeaba10f-3aba-465b-a5c1-520cbe6c315a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:00.283841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eeaba10f-3aba-465b-a5c1-520cbe6c315a admin admin] The token cache is being invalidate because project 2222eb5a023a406aa5767bd10edfdec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:00.284058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eeaba10f-3aba-465b-a5c1-520cbe6c315a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:00.285273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eeaba10f-3aba-465b-a5c1-520cbe6c315a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:00.292235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 843/1681] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:13:59 2022] DELETE /identity/v3/projects/2222eb5a023a406aa5767bd10edfdec9 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:00.298285 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fb380-bfa2-44c7-8fa3-c2c552877d59 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:00.299143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fb380-bfa2-44c7-8fa3-c2c552877d59 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:00.299758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fb380-bfa2-44c7-8fa3-c2c552877d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:00.365392 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be6176-0dd1-4580-abc3-4b9bdcbd2777 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:00.402949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-913fb380-bfa2-44c7-8fa3-c2c552877d59 None None] MFA Rules not processed for user `1a1bda7ed40242749e7caf03c882c501`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:00.404619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-913fb380-bfa2-44c7-8fa3-c2c552877d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:00.458886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:00.539165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33e320-998f-4695-ac5e-c241e748fb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:00.539782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33e320-998f-4695-ac5e-c241e748fb6d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:00.540051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33e320-998f-4695-ac5e-c241e748fb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:00.540417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33e320-998f-4695-ac5e-c241e748fb6d admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:00.541193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33e320-998f-4695-ac5e-c241e748fb6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:00.543766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33e320-998f-4695-ac5e-c241e748fb6d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:00.569821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 844/1682] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:00 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:00.569821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe5e65-2443-4511-af94-3aa9c6ce19d1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:00.569821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe5e65-2443-4511-af94-3aa9c6ce19d1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:00.569821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe5e65-2443-4511-af94-3aa9c6ce19d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:00.589047 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 839/1683] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:00 2022] POST /identity/v3/users => generated 291 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:00.589973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33e320-998f-4695-ac5e-c241e748fb6d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:00.603454 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8e33e320-998f-4695-ac5e-c241e748fb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:00.613192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4efe5e65-2443-4511-af94-3aa9c6ce19d1 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:00.614657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4efe5e65-2443-4511-af94-3aa9c6ce19d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:00.635435 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33e320-998f-4695-ac5e-c241e748fb6d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:00.640624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 845/1684] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:00.650160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe5e65-2443-4511-af94-3aa9c6ce19d1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:00.654106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4efe5e65-2443-4511-af94-3aa9c6ce19d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:00.665715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c3d35-a036-46bb-a778-4307c3a96b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:00.666643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c3d35-a036-46bb-a778-4307c3a96b99 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:00.667060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c3d35-a036-46bb-a778-4307c3a96b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:00.667437 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c3d35-a036-46bb-a778-4307c3a96b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:00.668259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c3d35-a036-46bb-a778-4307c3a96b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:00.670426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c3d35-a036-46bb-a778-4307c3a96b99 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:00.673186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe5e65-2443-4511-af94-3aa9c6ce19d1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:00.682929 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740709c-04a7-4273-8840-7fcc00b0ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:00.683862 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740709c-04a7-4273-8840-7fcc00b0ed1f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:00.684247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740709c-04a7-4273-8840-7fcc00b0ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:00.684527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740709c-04a7-4273-8840-7fcc00b0ed1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:00.685291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740709c-04a7-4273-8840-7fcc00b0ed1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:00.687617 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740709c-04a7-4273-8840-7fcc00b0ed1f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:00.708255 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 846/1685] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:00.708255 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd005c22-06dd-4280-9e60-e27c08e63d90 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:00.708255 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd005c22-06dd-4280-9e60-e27c08e63d90 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:00.708255 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd005c22-06dd-4280-9e60-e27c08e63d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:00.735935 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bd005c22-06dd-4280-9e60-e27c08e63d90 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:00.740870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bd005c22-06dd-4280-9e60-e27c08e63d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:00.755775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 840/1686] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:00 2022] POST /identity/v3/projects => generated 405 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:00.756846 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c3d35-a036-46bb-a778-4307c3a96b99 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:00.757431 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 847/1687] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:00.769777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd005c22-06dd-4280-9e60-e27c08e63d90 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:00.795326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd005c22-06dd-4280-9e60-e27c08e63d90 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:00.891916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c3d35-a036-46bb-a778-4307c3a96b99 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:00.907196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff587d01-403c-4b0c-9f74-175bcf7ce9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:00.908086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff587d01-403c-4b0c-9f74-175bcf7ce9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:00.908661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff587d01-403c-4b0c-9f74-175bcf7ce9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:00.908987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff587d01-403c-4b0c-9f74-175bcf7ce9c2 admin admin] PATH_INFO: `/v3/projects/ca0fa9eaf4aa4034b625e8e4c0e1a5b6/users/73fcc8135a8e40a7a6062b8d72843930/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:00.943482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff587d01-403c-4b0c-9f74-175bcf7ce9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0fa9eaf4aa4034b625e8e4c0e1a5b6, user_id=73fcc8135a8e40a7a6062b8d72843930, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:00.947026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff587d01-403c-4b0c-9f74-175bcf7ce9c2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:00.974128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 841/1688] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:00 2022] PUT /identity/v3/projects/ca0fa9eaf4aa4034b625e8e4c0e1a5b6/users/73fcc8135a8e40a7a6062b8d72843930/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:00.974284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff587d01-403c-4b0c-9f74-175bcf7ce9c2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:00.974874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b79032-3a5d-403b-80e7-7c8014a51046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:00.975547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b79032-3a5d-403b-80e7-7c8014a51046 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:00.975917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b79032-3a5d-403b-80e7-7c8014a51046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:00.976390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b79032-3a5d-403b-80e7-7c8014a51046 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:00.977288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b79032-3a5d-403b-80e7-7c8014a51046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:00.981605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b79032-3a5d-403b-80e7-7c8014a51046 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:01.040423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 848/1689] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:00 2022] POST /identity/v3/users => generated 309 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:01.041852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b79032-3a5d-403b-80e7-7c8014a51046 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:01.060009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b79032-3a5d-403b-80e7-7c8014a51046 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:01.177016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:01.212923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e0ad5-0a6d-467f-ab6d-2a2b317e4382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:01.212923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0ad5-0a6d-467f-ab6d-2a2b317e4382 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:01.212923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0ad5-0a6d-467f-ab6d-2a2b317e4382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:01.212923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e0ad5-0a6d-467f-ab6d-2a2b317e4382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:01.213387 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e0ad5-0a6d-467f-ab6d-2a2b317e4382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:01.213387 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e0ad5-0a6d-467f-ab6d-2a2b317e4382 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:01.228726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 849/1690] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:01.229748 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e0ad5-0a6d-467f-ab6d-2a2b317e4382 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:01.231591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff587d01-403c-4b0c-9f74-175bcf7ce9c2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:01.244811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6feca-033c-45f2-9b33-b960668cccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:01.245367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e0ad5-0a6d-467f-ab6d-2a2b317e4382 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:01.246084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6feca-033c-45f2-9b33-b960668cccdd admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:01.247089 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6feca-033c-45f2-9b33-b960668cccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:01.247518 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6feca-033c-45f2-9b33-b960668cccdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:01.250992 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6feca-033c-45f2-9b33-b960668cccdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:14:01.251901 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6feca-033c-45f2-9b33-b960668cccdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:01.252214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02c32f-386a-4153-aba1-41cde006fa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:01.253010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02c32f-386a-4153-aba1-41cde006fa0b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:01.253303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02c32f-386a-4153-aba1-41cde006fa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:01.253582 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02c32f-386a-4153-aba1-41cde006fa0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:01.254289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02c32f-386a-4153-aba1-41cde006fa0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:01.257480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6feca-033c-45f2-9b33-b960668cccdd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:01.257845 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02c32f-386a-4153-aba1-41cde006fa0b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:01.274594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 850/1691] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:01.279378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02c32f-386a-4153-aba1-41cde006fa0b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:01.294933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02c32f-386a-4153-aba1-41cde006fa0b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:01.301393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bf0d0-0b0a-4857-a690-297331ccc7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:01.303699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bf0d0-0b0a-4857-a690-297331ccc7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:01.303699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bf0d0-0b0a-4857-a690-297331ccc7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:01.303699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bf0d0-0b0a-4857-a690-297331ccc7c5 admin admin] PATH_INFO: `/v3/projects/ca0fa9eaf4aa4034b625e8e4c0e1a5b6/users/73fcc8135a8e40a7a6062b8d72843930/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:01.303989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 842/1692] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:14:01.303989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6feca-033c-45f2-9b33-b960668cccdd admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:01.309798 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bf0d0-0b0a-4857-a690-297331ccc7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0fa9eaf4aa4034b625e8e4c0e1a5b6, user_id=73fcc8135a8e40a7a6062b8d72843930, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:01.312869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bf0d0-0b0a-4857-a690-297331ccc7c5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:01.328360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 851/1693] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:01 2022] PUT /identity/v3/projects/ca0fa9eaf4aa4034b625e8e4c0e1a5b6/users/73fcc8135a8e40a7a6062b8d72843930/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:01.329495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bf0d0-0b0a-4857-a690-297331ccc7c5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:01.348467 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6feca-033c-45f2-9b33-b960668cccdd admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:01.392227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:01.426640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bf0d0-0b0a-4857-a690-297331ccc7c5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:01.438113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56a4a-84a9-4c10-af6e-cb5b55f4b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:01.439351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56a4a-84a9-4c10-af6e-cb5b55f4b8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:01.439661 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56a4a-84a9-4c10-af6e-cb5b55f4b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:01.439925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56a4a-84a9-4c10-af6e-cb5b55f4b8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:01.443545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec56a4a-84a9-4c10-af6e-cb5b55f4b8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:01.448777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec56a4a-84a9-4c10-af6e-cb5b55f4b8e1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:01.523461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 852/1694] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:01 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:01.527730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7941588-dc1a-40d5-b518-42620d5da3d6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:01.528022 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7941588-dc1a-40d5-b518-42620d5da3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:01.528300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7941588-dc1a-40d5-b518-42620d5da3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:01.533699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148944e-b7d0-4945-9c11-6f6f0eb8dbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:01.534960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148944e-b7d0-4945-9c11-6f6f0eb8dbb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:01.535259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148944e-b7d0-4945-9c11-6f6f0eb8dbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:01.535545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148944e-b7d0-4945-9c11-6f6f0eb8dbb8 admin admin] PATH_INFO: `/v3/projects/5613e3df6d9142fba104f64faec29d7a/users/79376a290eea4d69876be302495d54b4/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:01.575843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148944e-b7d0-4945-9c11-6f6f0eb8dbb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5613e3df6d9142fba104f64faec29d7a, user_id=79376a290eea4d69876be302495d54b4, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:01.578808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148944e-b7d0-4945-9c11-6f6f0eb8dbb8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:01.597690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b7941588-dc1a-40d5-b518-42620d5da3d6 None None] MFA Rules not processed for user `73fcc8135a8e40a7a6062b8d72843930`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:01.599167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b7941588-dc1a-40d5-b518-42620d5da3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:01.607039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 843/1695] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:01 2022] PUT /identity/v3/projects/5613e3df6d9142fba104f64faec29d7a/users/79376a290eea4d69876be302495d54b4/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:01.607632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148944e-b7d0-4945-9c11-6f6f0eb8dbb8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:01.750987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148944e-b7d0-4945-9c11-6f6f0eb8dbb8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:01.768350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab06cb-afd7-441a-b2fd-5cb9947bba74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:01.769028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab06cb-afd7-441a-b2fd-5cb9947bba74 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:01.769311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab06cb-afd7-441a-b2fd-5cb9947bba74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:01.769588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab06cb-afd7-441a-b2fd-5cb9947bba74 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:01.770279 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab06cb-afd7-441a-b2fd-5cb9947bba74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:01.772998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab06cb-afd7-441a-b2fd-5cb9947bba74 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:01.809247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 853/1696] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:01.810068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7941588-dc1a-40d5-b518-42620d5da3d6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:01.821290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 844/1697] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:01 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:01.825080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab06cb-afd7-441a-b2fd-5cb9947bba74 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:01.831639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7941588-dc1a-40d5-b518-42620d5da3d6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:01.840703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21e63b-3f95-4eff-a5f1-5dbfc73fe074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:01.841544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21e63b-3f95-4eff-a5f1-5dbfc73fe074 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:01.841925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21e63b-3f95-4eff-a5f1-5dbfc73fe074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:01.842364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21e63b-3f95-4eff-a5f1-5dbfc73fe074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:01.843193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21e63b-3f95-4eff-a5f1-5dbfc73fe074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:01.845245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21e63b-3f95-4eff-a5f1-5dbfc73fe074 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:01.845349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab06cb-afd7-441a-b2fd-5cb9947bba74 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:01.860657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a7209-7235-4fdb-908b-630aa6e62b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:01.861332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a7209-7235-4fdb-908b-630aa6e62b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:01.861618 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a7209-7235-4fdb-908b-630aa6e62b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:01.861889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a7209-7235-4fdb-908b-630aa6e62b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:01.862671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a7209-7235-4fdb-908b-630aa6e62b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:01.865856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a7209-7235-4fdb-908b-630aa6e62b19 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:01.869828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 854/1698] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:01.870709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21e63b-3f95-4eff-a5f1-5dbfc73fe074 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:01.876578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1a21e63b-3f95-4eff-a5f1-5dbfc73fe074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:01.893753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 845/1699] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:01.896980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a7209-7235-4fdb-908b-630aa6e62b19 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:01.919151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:01.921931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a7209-7235-4fdb-908b-630aa6e62b19 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:01.936285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0c1a-80d8-41d2-84d2-6bcb06ecfc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:01.937156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0c1a-80d8-41d2-84d2-6bcb06ecfc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:01.937447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0c1a-80d8-41d2-84d2-6bcb06ecfc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:01.937780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0c1a-80d8-41d2-84d2-6bcb06ecfc39 admin admin] PATH_INFO: `/v3/projects/5613e3df6d9142fba104f64faec29d7a/users/79376a290eea4d69876be302495d54b4/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:01.943362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d0c1a-80d8-41d2-84d2-6bcb06ecfc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5613e3df6d9142fba104f64faec29d7a, user_id=79376a290eea4d69876be302495d54b4, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:01.948342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d0c1a-80d8-41d2-84d2-6bcb06ecfc39 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:01.983681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 846/1700] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:01 2022] PUT /identity/v3/projects/5613e3df6d9142fba104f64faec29d7a/users/79376a290eea4d69876be302495d54b4/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:01.985504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0c1a-80d8-41d2-84d2-6bcb06ecfc39 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:02.013681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21e63b-3f95-4eff-a5f1-5dbfc73fe074 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:02.136333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0c1a-80d8-41d2-84d2-6bcb06ecfc39 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:02.137321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbca5f-124d-4846-a163-28bd955c7f7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:02.138097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbca5f-124d-4846-a163-28bd955c7f7e service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:02.140463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbca5f-124d-4846-a163-28bd955c7f7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:02.141821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbca5f-124d-4846-a163-28bd955c7f7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:02.151114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab863c-0fa9-4558-9445-aefddb6518d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:02.151804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab863c-0fa9-4558-9445-aefddb6518d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:02.154024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab863c-0fa9-4558-9445-aefddb6518d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:02.156740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab863c-0fa9-4558-9445-aefddb6518d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:02.156740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab863c-0fa9-4558-9445-aefddb6518d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:02.163189 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab863c-0fa9-4558-9445-aefddb6518d6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:02.188762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 847/1701] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:02.193216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab863c-0fa9-4558-9445-aefddb6518d6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:02.203369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:02.216988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab863c-0fa9-4558-9445-aefddb6518d6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:02.231959 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd94c5-ee28-4dde-a12d-ff9b976a9bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:02.234473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd94c5-ee28-4dde-a12d-ff9b976a9bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:02.234929 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd94c5-ee28-4dde-a12d-ff9b976a9bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:02.235301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd94c5-ee28-4dde-a12d-ff9b976a9bdf admin admin] PATH_INFO: `/v3/projects/abb6fcb5593349759974cb8573f30bd3/users/9ce3f66101b449c28908f865abf87798/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:02.277164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd94c5-ee28-4dde-a12d-ff9b976a9bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb6fcb5593349759974cb8573f30bd3, user_id=9ce3f66101b449c28908f865abf87798, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:02.286238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd94c5-ee28-4dde-a12d-ff9b976a9bdf admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:02.301734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbca5f-124d-4846-a163-28bd955c7f7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:02.303935 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbca5f-124d-4846-a163-28bd955c7f7e service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:02.316218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 848/1702] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:02 2022] PUT /identity/v3/projects/abb6fcb5593349759974cb8573f30bd3/users/9ce3f66101b449c28908f865abf87798/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:02.326886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec2489-b394-4299-abc4-733df7f2d040 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:02.327733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec2489-b394-4299-abc4-733df7f2d040 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:02.328282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec2489-b394-4299-abc4-733df7f2d040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:02.339104 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 855/1703] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:02.369703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-17ec2489-b394-4299-abc4-733df7f2d040 None None] MFA Rules not processed for user `9ce3f66101b449c28908f865abf87798`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:02.371338 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-17ec2489-b394-4299-abc4-733df7f2d040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:02.473943 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 849/1704] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:14:02.478538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbca5f-124d-4846-a163-28bd955c7f7e service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:02.493256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbca5f-124d-4846-a163-28bd955c7f7e service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:02.689806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0d3c-845b-4000-b935-2761cfe9dfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:02.690670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0d3c-845b-4000-b935-2761cfe9dfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:02.691056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0d3c-845b-4000-b935-2761cfe9dfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:02.691528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0d3c-845b-4000-b935-2761cfe9dfd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:02.692400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0d3c-845b-4000-b935-2761cfe9dfd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:02.697119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0d3c-845b-4000-b935-2761cfe9dfd6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:02.771129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 856/1705] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:02 2022] POST /identity/v3/projects => generated 381 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:02.774693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec2489-b394-4299-abc4-733df7f2d040 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:02.800398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec2489-b394-4299-abc4-733df7f2d040 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:02.952031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483b95e-0f5a-4821-94e7-bdcf0ec5a0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:02.956277 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b95e-0f5a-4821-94e7-bdcf0ec5a0af admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:02.956949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b95e-0f5a-4821-94e7-bdcf0ec5a0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:02.957417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b95e-0f5a-4821-94e7-bdcf0ec5a0af admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:02.959218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483b95e-0f5a-4821-94e7-bdcf0ec5a0af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:02.962051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483b95e-0f5a-4821-94e7-bdcf0ec5a0af admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:03.005391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0d3c-845b-4000-b935-2761cfe9dfd6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:03.007875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 850/1706] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:02 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:03.029084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0d3c-845b-4000-b935-2761cfe9dfd6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:03.054847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745df27f-522d-482a-8abd-2e193ab14c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:03.056059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745df27f-522d-482a-8abd-2e193ab14c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:03.056059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745df27f-522d-482a-8abd-2e193ab14c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:03.056319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745df27f-522d-482a-8abd-2e193ab14c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:03.057178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745df27f-522d-482a-8abd-2e193ab14c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:03.058949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745df27f-522d-482a-8abd-2e193ab14c63 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:03.061421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:03.090961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 857/1707] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:03.095160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483b95e-0f5a-4821-94e7-bdcf0ec5a0af admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:03.130032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483b95e-0f5a-4821-94e7-bdcf0ec5a0af admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:03.136570 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3331e-543c-439e-8de4-36dbb07fb66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:03.137483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3331e-543c-439e-8de4-36dbb07fb66e admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:03.137765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3331e-543c-439e-8de4-36dbb07fb66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:03.141052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3331e-543c-439e-8de4-36dbb07fb66e admin admin] PATH_INFO: `/v3/projects/e2cc8f65229c4234af8e7770ee4a3b4a/users/61fad3a3ff8945a48019538b4b9c075b/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:03.192439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3331e-543c-439e-8de4-36dbb07fb66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2cc8f65229c4234af8e7770ee4a3b4a, user_id=61fad3a3ff8945a48019538b4b9c075b, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:03.195557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3331e-543c-439e-8de4-36dbb07fb66e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:03.233084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 851/1708] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:03 2022] PUT /identity/v3/projects/e2cc8f65229c4234af8e7770ee4a3b4a/users/61fad3a3ff8945a48019538b4b9c075b/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:03.233854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745df27f-522d-482a-8abd-2e193ab14c63 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:03.245138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745df27f-522d-482a-8abd-2e193ab14c63 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:03.473351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2940-e871-42b0-bb4b-0a25fbf46c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:03.474794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2940-e871-42b0-bb4b-0a25fbf46c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:03.475225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2940-e871-42b0-bb4b-0a25fbf46c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:03.475842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2940-e871-42b0-bb4b-0a25fbf46c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:03.476754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a2940-e871-42b0-bb4b-0a25fbf46c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:03.478598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a2940-e871-42b0-bb4b-0a25fbf46c71 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:03.502280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 858/1709] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:14:03.513543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3331e-543c-439e-8de4-36dbb07fb66e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:03.544842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3331e-543c-439e-8de4-36dbb07fb66e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:03.558677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f7640-904c-462a-a458-49a3de14bfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:03.559392 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f7640-904c-462a-a458-49a3de14bfa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:03.559674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f7640-904c-462a-a458-49a3de14bfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:03.559953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f7640-904c-462a-a458-49a3de14bfa1 admin admin] PATH_INFO: `/v3/projects/e2cc8f65229c4234af8e7770ee4a3b4a/users/61fad3a3ff8945a48019538b4b9c075b/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:03.564650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f7640-904c-462a-a458-49a3de14bfa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2cc8f65229c4234af8e7770ee4a3b4a, user_id=61fad3a3ff8945a48019538b4b9c075b, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:03.574452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f7640-904c-462a-a458-49a3de14bfa1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:03.591985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 852/1710] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:03 2022] PUT /identity/v3/projects/e2cc8f65229c4234af8e7770ee4a3b4a/users/61fad3a3ff8945a48019538b4b9c075b/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:03.602628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a7e3c-6c88-451e-8484-2c58582b9c33 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:03.603358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a7e3c-6c88-451e-8484-2c58582b9c33 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:03.603923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a7e3c-6c88-451e-8484-2c58582b9c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:03.671444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2d4a7e3c-6c88-451e-8484-2c58582b9c33 None None] MFA Rules not processed for user `61fad3a3ff8945a48019538b4b9c075b`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:03.676450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2d4a7e3c-6c88-451e-8484-2c58582b9c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:03.943163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 859/1711] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:03.993939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f7640-904c-462a-a458-49a3de14bfa1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:03.996715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ff3f7640-904c-462a-a458-49a3de14bfa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:04.056802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:04.159512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f7640-904c-462a-a458-49a3de14bfa1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:04.169195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecf259-3907-4f49-aa9a-9c533bcdd75e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:04.169860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecf259-3907-4f49-aa9a-9c533bcdd75e service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:04.170144 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecf259-3907-4f49-aa9a-9c533bcdd75e service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:04.170548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecf259-3907-4f49-aa9a-9c533bcdd75e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:04.215756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecf259-3907-4f49-aa9a-9c533bcdd75e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:04.217648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cecf259-3907-4f49-aa9a-9c533bcdd75e service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:04.247156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 853/1712] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:04.572981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a7e3c-6c88-451e-8484-2c58582b9c33 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:04.592746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a7e3c-6c88-451e-8484-2c58582b9c33 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:04.603716 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb1a11-0c6c-4daf-bf0b-415795a0bf12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:04.607499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb1a11-0c6c-4daf-bf0b-415795a0bf12 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:04.608122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb1a11-0c6c-4daf-bf0b-415795a0bf12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:04.608603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb1a11-0c6c-4daf-bf0b-415795a0bf12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:04.778445 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb1a11-0c6c-4daf-bf0b-415795a0bf12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:04.785280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb1a11-0c6c-4daf-bf0b-415795a0bf12 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:04.811877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 860/1713] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:05.524334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64203c-4bfd-4571-a45e-7e3515b171ee None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:05.524970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64203c-4bfd-4571-a45e-7e3515b171ee None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:05.524970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64203c-4bfd-4571-a45e-7e3515b171ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:05.571545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-1f64203c-4bfd-4571-a45e-7e3515b171ee None None] MFA Rules not processed for user `096d0da1a0bc401c95bfbb8fc150a27b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:05.576053 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1f64203c-4bfd-4571-a45e-7e3515b171ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:05.798128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 854/1714] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:06.044150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb1a11-0c6c-4daf-bf0b-415795a0bf12 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:06.046408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2cfb1a11-0c6c-4daf-bf0b-415795a0bf12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:06.112245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb824f99-da0c-40dc-b2a5-a8f58bafba8b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:06.112735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb824f99-da0c-40dc-b2a5-a8f58bafba8b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:06.112918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb824f99-da0c-40dc-b2a5-a8f58bafba8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:06.118523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:06.226970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-cb824f99-da0c-40dc-b2a5-a8f58bafba8b None None] MFA Rules not processed for user `2ce8bf4f0ab64010b3855193f55971d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:06.228403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cb824f99-da0c-40dc-b2a5-a8f58bafba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:06.307005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb1a11-0c6c-4daf-bf0b-415795a0bf12 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:06.320680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece74678-971f-4d62-a637-16041a12175e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:06.322567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece74678-971f-4d62-a637-16041a12175e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:06.324035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece74678-971f-4d62-a637-16041a12175e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:06.324502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece74678-971f-4d62-a637-16041a12175e admin admin] PATH_INFO: `/v3/users/bc86aa22af8548cfb4147d85e71487d4` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:06.327876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece74678-971f-4d62-a637-16041a12175e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc86aa22af8548cfb4147d85e71487d4)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:06.334832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece74678-971f-4d62-a637-16041a12175e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:06.439944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 855/1715] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:06.451551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc8b8f-d28a-4e10-a13e-cd1a0988223d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:06.452066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc8b8f-d28a-4e10-a13e-cd1a0988223d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:06.452513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc8b8f-d28a-4e10-a13e-cd1a0988223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:06.477682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ece74678-971f-4d62-a637-16041a12175e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc86aa22af8548cfb4147d85e71487d4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:06.479160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ece74678-971f-4d62-a637-16041a12175e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc86aa22af8548cfb4147d85e71487d4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:06.487823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8ecc8b8f-d28a-4e10-a13e-cd1a0988223d None None] MFA Rules not processed for user `2ce8bf4f0ab64010b3855193f55971d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:06.489483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8ecc8b8f-d28a-4e10-a13e-cd1a0988223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:06.499949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ece74678-971f-4d62-a637-16041a12175e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc86aa22af8548cfb4147d85e71487d4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:06.500865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ece74678-971f-4d62-a637-16041a12175e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc86aa22af8548cfb4147d85e71487d4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:06.514372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 856/1716] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:14:06.525412 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc8b8f-d28a-4e10-a13e-cd1a0988223d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:06.528210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ece74678-971f-4d62-a637-16041a12175e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc86aa22af8548cfb4147d85e71487d4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:06.530637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8ecc8b8f-d28a-4e10-a13e-cd1a0988223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:06.570652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 861/1717] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:06 2022] DELETE /identity/v3/users/bc86aa22af8548cfb4147d85e71487d4 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:06.575860 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88956685-21e5-40c2-bae4-eac4a4978d27 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:06.576620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88956685-21e5-40c2-bae4-eac4a4978d27 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:06.577081 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88956685-21e5-40c2-bae4-eac4a4978d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:06.628212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-88956685-21e5-40c2-bae4-eac4a4978d27 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:06.633905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-88956685-21e5-40c2-bae4-eac4a4978d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:06.675604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:06.730455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc8b8f-d28a-4e10-a13e-cd1a0988223d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:06.757871 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 862/1718] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:06.759244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88956685-21e5-40c2-bae4-eac4a4978d27 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:06.763479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-88956685-21e5-40c2-bae4-eac4a4978d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:06.792232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88956685-21e5-40c2-bae4-eac4a4978d27 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:06.800847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ec345-88e4-4e56-87eb-33b2f049af87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:06.806350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ec345-88e4-4e56-87eb-33b2f049af87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:06.806718 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ec345-88e4-4e56-87eb-33b2f049af87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:06.807000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ec345-88e4-4e56-87eb-33b2f049af87 admin admin] PATH_INFO: `/v3/users/1b9238c6911c44d4a48ac7ad91d251dd` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:06.809748 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ec345-88e4-4e56-87eb-33b2f049af87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9238c6911c44d4a48ac7ad91d251dd)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:06.812936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ec345-88e4-4e56-87eb-33b2f049af87 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:06.916563 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:06.935700 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb94ba-06ab-411c-b8d7-66c377774ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:06.936512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb94ba-06ab-411c-b8d7-66c377774ce8 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:06.937079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb94ba-06ab-411c-b8d7-66c377774ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:06.937587 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb94ba-06ab-411c-b8d7-66c377774ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:06.940178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-61bb94ba-06ab-411c-b8d7-66c377774ce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:06.942528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-118ec345-88e4-4e56-87eb-33b2f049af87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9238c6911c44d4a48ac7ad91d251dd'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:06.943294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-118ec345-88e4-4e56-87eb-33b2f049af87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9238c6911c44d4a48ac7ad91d251dd'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:06.956958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-118ec345-88e4-4e56-87eb-33b2f049af87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9238c6911c44d4a48ac7ad91d251dd'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:06.958680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-118ec345-88e4-4e56-87eb-33b2f049af87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9238c6911c44d4a48ac7ad91d251dd'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:06.994864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-118ec345-88e4-4e56-87eb-33b2f049af87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9238c6911c44d4a48ac7ad91d251dd'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:07.034124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 863/1719] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:06 2022] DELETE /identity/v3/users/1b9238c6911c44d4a48ac7ad91d251dd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:07.038853 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843e28c-e323-4e02-ba7f-1f6d94a08822 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:07.039140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843e28c-e323-4e02-ba7f-1f6d94a08822 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:07.039414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843e28c-e323-4e02-ba7f-1f6d94a08822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:07.105091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5843e28c-e323-4e02-ba7f-1f6d94a08822 None None] MFA Rules not processed for user `79376a290eea4d69876be302495d54b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:07.107206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5843e28c-e323-4e02-ba7f-1f6d94a08822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:07.110094 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb94ba-06ab-411c-b8d7-66c377774ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:07.114332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb94ba-06ab-411c-b8d7-66c377774ce8 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:07.142667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 857/1720] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:07.146337 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb94ba-06ab-411c-b8d7-66c377774ce8 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:07.151088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-61bb94ba-06ab-411c-b8d7-66c377774ce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:07.214504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 864/1721] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:07 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:07.218356 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93735e5-707a-4853-bbe4-7918219d0b0b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:07.219534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93735e5-707a-4853-bbe4-7918219d0b0b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:07.221066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93735e5-707a-4853-bbe4-7918219d0b0b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:07.222790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 865/1722] 10.222.0.27 () {54 vars in 912 bytes} [Fri Aug 5 07:14:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:14:07.229267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbacef-6b49-4229-8873-b5bebeef78b7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:07.229356 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbacef-6b49-4229-8873-b5bebeef78b7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:07.229594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbacef-6b49-4229-8873-b5bebeef78b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:07.277092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a7cbacef-6b49-4229-8873-b5bebeef78b7 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:07.278364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a7cbacef-6b49-4229-8873-b5bebeef78b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:07.360620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb94ba-06ab-411c-b8d7-66c377774ce8 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:07.463127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:07.480589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b041140-2e29-497e-80c6-43bc3058a58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:07.481436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b041140-2e29-497e-80c6-43bc3058a58a service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:07.482091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b041140-2e29-497e-80c6-43bc3058a58a service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:07.482485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b041140-2e29-497e-80c6-43bc3058a58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:07.485232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6b041140-2e29-497e-80c6-43bc3058a58a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:07.500518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 866/1723] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:07.502207 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42db87a-980b-4b0e-a563-1b75b5df2380 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:07.502646 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42db87a-980b-4b0e-a563-1b75b5df2380 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:07.503063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42db87a-980b-4b0e-a563-1b75b5df2380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:07.595250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f42db87a-980b-4b0e-a563-1b75b5df2380 None None] MFA Rules not processed for user `9c4ce8a3f876467f93e7c9efd9e33390`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:07.601256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f42db87a-980b-4b0e-a563-1b75b5df2380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:07.621635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b041140-2e29-497e-80c6-43bc3058a58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:07.624532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b041140-2e29-497e-80c6-43bc3058a58a service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:07.658806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 858/1724] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:07.659832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b041140-2e29-497e-80c6-43bc3058a58a service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:07.661308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6b041140-2e29-497e-80c6-43bc3058a58a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:07.662722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 867/1725] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:14:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:07.674814 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b041140-2e29-497e-80c6-43bc3058a58a service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:07.679246 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7d70-587a-4032-aaa7-946af2a1b749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:07.679888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7d70-587a-4032-aaa7-946af2a1b749 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:07.680172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7d70-587a-4032-aaa7-946af2a1b749 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:07.680447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7d70-587a-4032-aaa7-946af2a1b749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:07.694445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7d70-587a-4032-aaa7-946af2a1b749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:07.696077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7d70-587a-4032-aaa7-946af2a1b749 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:07.711145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 859/1726] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:07.715632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42db87a-980b-4b0e-a563-1b75b5df2380 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:07.729128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42db87a-980b-4b0e-a563-1b75b5df2380 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:07.739027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5797c-4d5e-4ee5-b63b-5a7c8458b2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:07.739923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5797c-4d5e-4ee5-b63b-5a7c8458b2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:07.740311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5797c-4d5e-4ee5-b63b-5a7c8458b2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:07.740685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5797c-4d5e-4ee5-b63b-5a7c8458b2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:07.769702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5797c-4d5e-4ee5-b63b-5a7c8458b2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:07.772423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5797c-4d5e-4ee5-b63b-5a7c8458b2a1 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:07.789358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:07.802945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 868/1727] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:08.393725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7d70-587a-4032-aaa7-946af2a1b749 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:08.395294 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-44ff7d70-587a-4032-aaa7-946af2a1b749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:08.417409 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7d70-587a-4032-aaa7-946af2a1b749 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:08.434611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617efc1a-e712-424f-bc7d-2ff8a750f467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:08.435532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617efc1a-e712-424f-bc7d-2ff8a750f467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:08.435990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617efc1a-e712-424f-bc7d-2ff8a750f467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:08.436366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617efc1a-e712-424f-bc7d-2ff8a750f467 admin admin] PATH_INFO: `/v3/users/9ce3f66101b449c28908f865abf87798` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:08.441376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617efc1a-e712-424f-bc7d-2ff8a750f467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce3f66101b449c28908f865abf87798)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:08.446271 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617efc1a-e712-424f-bc7d-2ff8a750f467 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:08.519438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221fbbc-7bc8-49be-9f3d-c5e8fa5f9ca9 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:08.519996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221fbbc-7bc8-49be-9f3d-c5e8fa5f9ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:08.519996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221fbbc-7bc8-49be-9f3d-c5e8fa5f9ca9 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:08.521504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 869/1728] 10.222.0.27 () {54 vars in 912 bytes} [Fri Aug 5 07:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:14:08.538394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4456e8f-be55-486c-b212-55d2d4597de4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:08.539459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4456e8f-be55-486c-b212-55d2d4597de4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:08.539979 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4456e8f-be55-486c-b212-55d2d4597de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:08.589337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e4456e8f-be55-486c-b212-55d2d4597de4 None None] MFA Rules not processed for user `9c4ce8a3f876467f93e7c9efd9e33390`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:08.591638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e4456e8f-be55-486c-b212-55d2d4597de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:08.610626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-617efc1a-e712-424f-bc7d-2ff8a750f467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce3f66101b449c28908f865abf87798'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:08.614492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 870/1729] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:14:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:14:08.627164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-617efc1a-e712-424f-bc7d-2ff8a750f467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce3f66101b449c28908f865abf87798'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:08.646086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-617efc1a-e712-424f-bc7d-2ff8a750f467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce3f66101b449c28908f865abf87798'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:08.647026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-617efc1a-e712-424f-bc7d-2ff8a750f467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce3f66101b449c28908f865abf87798'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:08.671253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4456e8f-be55-486c-b212-55d2d4597de4 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:08.675463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e4456e8f-be55-486c-b212-55d2d4597de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:08.694300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4456e8f-be55-486c-b212-55d2d4597de4 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:08.705616 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-617efc1a-e712-424f-bc7d-2ff8a750f467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce3f66101b449c28908f865abf87798'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:08.713462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fada81-cd1b-4a54-8098-fefa46c7f81a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:08.714254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fada81-cd1b-4a54-8098-fefa46c7f81a service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:08.714541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fada81-cd1b-4a54-8098-fefa46c7f81a service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:08.714818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fada81-cd1b-4a54-8098-fefa46c7f81a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:08.729759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-06fada81-cd1b-4a54-8098-fefa46c7f81a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:08.731027 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 860/1730] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:08 2022] DELETE /identity/v3/users/9ce3f66101b449c28908f865abf87798 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:08.733610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e9462-3ca9-4474-8ea9-a048356b7437 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:08.733892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e9462-3ca9-4474-8ea9-a048356b7437 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:08.734169 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e9462-3ca9-4474-8ea9-a048356b7437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:08.750443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fada81-cd1b-4a54-8098-fefa46c7f81a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:08.751914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fada81-cd1b-4a54-8098-fefa46c7f81a service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:08.761563 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 871/1731] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:14:08.776112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2f1e9462-3ca9-4474-8ea9-a048356b7437 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:08.779439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2f1e9462-3ca9-4474-8ea9-a048356b7437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:08.889516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:08.923671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 861/1732] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:08.957646 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fada81-cd1b-4a54-8098-fefa46c7f81a service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:08.959275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-06fada81-cd1b-4a54-8098-fefa46c7f81a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:08.970780 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fada81-cd1b-4a54-8098-fefa46c7f81a service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:09.037433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50df9a3-d45d-4544-a18b-3e261486568c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:09.038138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50df9a3-d45d-4544-a18b-3e261486568c service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:09.038445 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50df9a3-d45d-4544-a18b-3e261486568c service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:09.038704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50df9a3-d45d-4544-a18b-3e261486568c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:09.051096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50df9a3-d45d-4544-a18b-3e261486568c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:09.052754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50df9a3-d45d-4544-a18b-3e261486568c service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:09.067960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 872/1733] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:09.089537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789b5e1-729d-4c13-8a52-88cde5433ca2 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:09.090517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789b5e1-729d-4c13-8a52-88cde5433ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:09.090972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789b5e1-729d-4c13-8a52-88cde5433ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:09.117414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c474c-3878-4732-b750-00217aa6d08f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:09.118237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c474c-3878-4732-b750-00217aa6d08f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:09.118574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c474c-3878-4732-b750-00217aa6d08f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:09.121230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 873/1734] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:14:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:14:09.149962 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f789b5e1-729d-4c13-8a52-88cde5433ca2 None None] MFA Rules not processed for user `02c685b300874351ab2dbd62bea1a669`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:09.151956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f789b5e1-729d-4c13-8a52-88cde5433ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:09.159931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310eb1d-47f2-43a8-9c1f-ef36194a8ae1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:09.159931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310eb1d-47f2-43a8-9c1f-ef36194a8ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:09.159931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310eb1d-47f2-43a8-9c1f-ef36194a8ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:09.196138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4310eb1d-47f2-43a8-9c1f-ef36194a8ae1 None None] MFA Rules not processed for user `9cedcecb65ea45aa8b37797907d69009`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:09.199408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4310eb1d-47f2-43a8-9c1f-ef36194a8ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:09.308383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 862/1735] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:09.312353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fb10e-2312-4aa9-be00-2c8d9b387351 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:09.312647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fb10e-2312-4aa9-be00-2c8d9b387351 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:09.312928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fb10e-2312-4aa9-be00-2c8d9b387351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:09.345257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 874/1736] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:09.357184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ee94e-e587-44d2-99b8-fdfdf86514a9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:09.357520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ee94e-e587-44d2-99b8-fdfdf86514a9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:09.357940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ee94e-e587-44d2-99b8-fdfdf86514a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:09.404638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-224ee94e-e587-44d2-99b8-fdfdf86514a9 None None] MFA Rules not processed for user `9cedcecb65ea45aa8b37797907d69009`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:09.405330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-fd8fb10e-2312-4aa9-be00-2c8d9b387351 None None] MFA Rules not processed for user `33213d31b1394cdfb5b447f4f4952b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:09.406085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-224ee94e-e587-44d2-99b8-fdfdf86514a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:09.409313 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fd8fb10e-2312-4aa9-be00-2c8d9b387351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:09.424428 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 875/1737] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:14:09.578788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ee94e-e587-44d2-99b8-fdfdf86514a9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:09.581407 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-224ee94e-e587-44d2-99b8-fdfdf86514a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:09.622454 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 863/1738] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:14:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:09.651925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74ce8e-2f53-41df-87db-c1966e44ebcf None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:09.652590 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74ce8e-2f53-41df-87db-c1966e44ebcf None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:09.652590 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74ce8e-2f53-41df-87db-c1966e44ebcf None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:09.654424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 864/1739] 10.222.0.27 () {54 vars in 961 bytes} [Fri Aug 5 07:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 07:14:09.664332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73275892-3dd2-44bf-9daa-888cda98c104 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:09.664641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73275892-3dd2-44bf-9daa-888cda98c104 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:09.664883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73275892-3dd2-44bf-9daa-888cda98c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:09.744106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-73275892-3dd2-44bf-9daa-888cda98c104 None None] MFA Rules not processed for user `33213d31b1394cdfb5b447f4f4952b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:09.745498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-73275892-3dd2-44bf-9daa-888cda98c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:09.800998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 865/1740] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Aug 5 07:14:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:09.802108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73275892-3dd2-44bf-9daa-888cda98c104 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:09.808078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-73275892-3dd2-44bf-9daa-888cda98c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:09.854167 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73275892-3dd2-44bf-9daa-888cda98c104 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:09.876593 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912230ce-67bf-4208-b3c7-a882ab5421a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:09.877296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912230ce-67bf-4208-b3c7-a882ab5421a6 service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:09.877578 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912230ce-67bf-4208-b3c7-a882ab5421a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:09.877856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912230ce-67bf-4208-b3c7-a882ab5421a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:09.882292 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-912230ce-67bf-4208-b3c7-a882ab5421a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:09.894580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:09.904748 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ee94e-e587-44d2-99b8-fdfdf86514a9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:09.920930 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537820c-e1bb-4c61-b742-5fa225d673fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:09.921694 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537820c-e1bb-4c61-b742-5fa225d673fb service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:09.921935 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537820c-e1bb-4c61-b742-5fa225d673fb service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:09.922213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537820c-e1bb-4c61-b742-5fa225d673fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:09.922397 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912230ce-67bf-4208-b3c7-a882ab5421a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:09.926336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912230ce-67bf-4208-b3c7-a882ab5421a6 service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:09.945552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537820c-e1bb-4c61-b742-5fa225d673fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:09.947220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537820c-e1bb-4c61-b742-5fa225d673fb service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:09.981953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 866/1741] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:09.992312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912230ce-67bf-4208-b3c7-a882ab5421a6 service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:09.992537 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 876/1742] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:09.993511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537820c-e1bb-4c61-b742-5fa225d673fb service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:10.003092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0537820c-e1bb-4c61-b742-5fa225d673fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:10.024654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912230ce-67bf-4208-b3c7-a882ab5421a6 service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:10.038205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537820c-e1bb-4c61-b742-5fa225d673fb service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:10.042327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83312f53-c2b2-4f52-b883-124ef37b15cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:10.048292 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83312f53-c2b2-4f52-b883-124ef37b15cc service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:10.048600 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83312f53-c2b2-4f52-b883-124ef37b15cc service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:10.048881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83312f53-c2b2-4f52-b883-124ef37b15cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:10.052615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:10.054083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:10.054083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:10.056224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] PATH_INFO: `/v3/projects/609be8cfbee24416a0cb50d1551bf9c5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:10.059159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609be8cfbee24416a0cb50d1551bf9c5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:10.061267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:10.069904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83312f53-c2b2-4f52-b883-124ef37b15cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:10.075717 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83312f53-c2b2-4f52-b883-124ef37b15cc service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:10.102861 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 867/1743] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:10.104306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83312f53-c2b2-4f52-b883-124ef37b15cc service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:10.106109 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-83312f53-c2b2-4f52-b883-124ef37b15cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:10.137486 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83312f53-c2b2-4f52-b883-124ef37b15cc service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:10.184228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ba59a-8628-4d8f-8b29-c7ff1214ff9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:10.184937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ba59a-8628-4d8f-8b29-c7ff1214ff9c service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:10.186247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ba59a-8628-4d8f-8b29-c7ff1214ff9c service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:10.186247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ba59a-8628-4d8f-8b29-c7ff1214ff9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:10.203235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609be8cfbee24416a0cb50d1551bf9c5', 'request_id': 'req-302c1bc3-7fc4-4711-9eab-67ff08d31f11'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.221212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609be8cfbee24416a0cb50d1551bf9c5', 'request_id': 'req-302c1bc3-7fc4-4711-9eab-67ff08d31f11'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.229521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609be8cfbee24416a0cb50d1551bf9c5', 'request_id': 'req-302c1bc3-7fc4-4711-9eab-67ff08d31f11'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.232418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ba59a-8628-4d8f-8b29-c7ff1214ff9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:10.242520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ba59a-8628-4d8f-8b29-c7ff1214ff9c service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:10.263307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] The token cache is being invalidate because project 609be8cfbee24416a0cb50d1551bf9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:10.263598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.268028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.273993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 868/1744] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:10.274359 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 877/1745] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:09 2022] DELETE /identity/v3/projects/609be8cfbee24416a0cb50d1551bf9c5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:10.278096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ba59a-8628-4d8f-8b29-c7ff1214ff9c service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:10.279966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:10.284200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:10.285976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-916ba59a-8628-4d8f-8b29-c7ff1214ff9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:10.337808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ba59a-8628-4d8f-8b29-c7ff1214ff9c service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:10.448335 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:10.562774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c1bc3-7fc4-4711-9eab-67ff08d31f11 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:10.569315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6963b0a-fbec-429d-bfb9-4180fa559b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:10.570258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6963b0a-fbec-429d-bfb9-4180fa559b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:10.570671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6963b0a-fbec-429d-bfb9-4180fa559b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:10.570954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6963b0a-fbec-429d-bfb9-4180fa559b3d admin admin] PATH_INFO: `/v3/users/7b2fa34e6a704803aac380e1ce74e8e5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:10.572467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6963b0a-fbec-429d-bfb9-4180fa559b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b2fa34e6a704803aac380e1ce74e8e5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:10.574597 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6963b0a-fbec-429d-bfb9-4180fa559b3d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:10.589166 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:10.589656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:10.592629 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:10.593047 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] PATH_INFO: `/v3/projects/d89e58634d36449a9869ddb6d5fdef16` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:10.598715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d89e58634d36449a9869ddb6d5fdef16)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:10.610349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:10.659746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6963b0a-fbec-429d-bfb9-4180fa559b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b2fa34e6a704803aac380e1ce74e8e5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.661351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6963b0a-fbec-429d-bfb9-4180fa559b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b2fa34e6a704803aac380e1ce74e8e5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.681458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6963b0a-fbec-429d-bfb9-4180fa559b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b2fa34e6a704803aac380e1ce74e8e5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.682489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6963b0a-fbec-429d-bfb9-4180fa559b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b2fa34e6a704803aac380e1ce74e8e5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.740465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6963b0a-fbec-429d-bfb9-4180fa559b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b2fa34e6a704803aac380e1ce74e8e5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.754436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:10.795425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 878/1746] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:10 2022] DELETE /identity/v3/users/7b2fa34e6a704803aac380e1ce74e8e5 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:10.797854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd89e58634d36449a9869ddb6d5fdef16', 'request_id': 'req-93fd4dae-58d5-4365-b9f1-9bac393fd223'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.799509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5b9b5-d590-456e-bd50-187e37bd811c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:10.799775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5b9b5-d590-456e-bd50-187e37bd811c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:10.801611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5b9b5-d590-456e-bd50-187e37bd811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:10.817446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd89e58634d36449a9869ddb6d5fdef16', 'request_id': 'req-93fd4dae-58d5-4365-b9f1-9bac393fd223'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.832544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd89e58634d36449a9869ddb6d5fdef16', 'request_id': 'req-93fd4dae-58d5-4365-b9f1-9bac393fd223'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.852516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c4c5b9b5-d590-456e-bd50-187e37bd811c None None] MFA Rules not processed for user `2ce8bf4f0ab64010b3855193f55971d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:10.855124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c4c5b9b5-d590-456e-bd50-187e37bd811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:10.869710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] The token cache is being invalidate because project d89e58634d36449a9869ddb6d5fdef16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:10.870232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.873653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:10.875695 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 869/1747] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:10 2022] DELETE /identity/v3/projects/d89e58634d36449a9869ddb6d5fdef16 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:10.883384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:10.891915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:11.071654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 879/1748] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:11.134009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd4dae-58d5-4365-b9f1-9bac393fd223 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:11.342499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:11.343560 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:11.344167 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:11.344819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] PATH_INFO: `/v3/users/73fcc8135a8e40a7a6062b8d72843930` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:11.352791 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73fcc8135a8e40a7a6062b8d72843930)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:11.359100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:11.417529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:11.510321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73fcc8135a8e40a7a6062b8d72843930'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:11.530590 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73fcc8135a8e40a7a6062b8d72843930'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:11.551703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73fcc8135a8e40a7a6062b8d72843930'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:11.552407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73fcc8135a8e40a7a6062b8d72843930'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:11.586183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73fcc8135a8e40a7a6062b8d72843930'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:11.603317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 870/1749] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:10 2022] DELETE /identity/v3/users/73fcc8135a8e40a7a6062b8d72843930 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:11.915360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5b9b5-d590-456e-bd50-187e37bd811c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:11.918454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c4c5b9b5-d590-456e-bd50-187e37bd811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:11.977196 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5b9b5-d590-456e-bd50-187e37bd811c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:12.012614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:12.017162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:12.165446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:12.169232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:12.169905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:12.170551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] PATH_INFO: `/v3/projects/abb6fcb5593349759974cb8573f30bd3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:12.182239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb6fcb5593349759974cb8573f30bd3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:12.188030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:12.188413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b9d63-d2e4-4bec-be8a-1384e7028757 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:12.208752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:12.212693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:12.213121 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:12.217953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] PATH_INFO: `/v3/users/1a1bda7ed40242749e7caf03c882c501` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:12.222634 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a1bda7ed40242749e7caf03c882c501)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:12.232346 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:12.319725 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb6fcb5593349759974cb8573f30bd3', 'request_id': 'req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.339926 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb6fcb5593349759974cb8573f30bd3', 'request_id': 'req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.353215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb6fcb5593349759974cb8573f30bd3', 'request_id': 'req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.370321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a1bda7ed40242749e7caf03c882c501'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.379061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] The token cache is being invalidate because project abb6fcb5593349759974cb8573f30bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:12.381191 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.382290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.391218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 880/1750] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:11 2022] DELETE /identity/v3/projects/abb6fcb5593349759974cb8573f30bd3 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:12.396166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:12.398122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:12.424297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a1bda7ed40242749e7caf03c882c501'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.442656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a1bda7ed40242749e7caf03c882c501'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.443577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a1bda7ed40242749e7caf03c882c501'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.478227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:12.521656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a1bda7ed40242749e7caf03c882c501'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.530196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 871/1751] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:12 2022] DELETE /identity/v3/users/1a1bda7ed40242749e7caf03c882c501 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:12.592776 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26feca-1cfd-4b46-8a10-be5cd2c226d2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:12.810898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:12.811535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:12.811820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:12.812100 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] PATH_INFO: `/v3/users/61fad3a3ff8945a48019538b4b9c075b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:12.820175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] RBAC: Authorizing `identity:delete_user(user_id=61fad3a3ff8945a48019538b4b9c075b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:12.822328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:12.936374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61fad3a3ff8945a48019538b4b9c075b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.941445 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61fad3a3ff8945a48019538b4b9c075b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.955909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61fad3a3ff8945a48019538b4b9c075b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.956659 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61fad3a3ff8945a48019538b4b9c075b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:12.984322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61fad3a3ff8945a48019538b4b9c075b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:13.039499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 881/1752] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:12 2022] DELETE /identity/v3/users/61fad3a3ff8945a48019538b4b9c075b => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:13.282185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:13.288361 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:13.347100 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:13.347100 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:13.383748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268068f7-bfb9-4467-bb8a-e23f500dc710 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:13.392813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:13.584799 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:13.602278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cf1d2-5856-4c53-a935-aec4cd48799d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:13.606491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:13.607704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:13.608224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:13.608707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] PATH_INFO: `/v3/projects/0b6dc0e56919427cb92fc5906b967ce9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:13.613957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6dc0e56919427cb92fc5906b967ce9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:13.617293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:13.628840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:13.629564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:13.629845 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:13.630120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075 admin admin] PATH_INFO: `/v3/projects/ca0fa9eaf4aa4034b625e8e4c0e1a5b6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:13.632216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0fa9eaf4aa4034b625e8e4c0e1a5b6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:13.636767 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:13.753220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6dc0e56919427cb92fc5906b967ce9', 'request_id': 'req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:13.783736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6dc0e56919427cb92fc5906b967ce9', 'request_id': 'req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:13.808015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6dc0e56919427cb92fc5906b967ce9', 'request_id': 'req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:13.810448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0fa9eaf4aa4034b625e8e4c0e1a5b6', 'request_id': 'req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:13.826974 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0fa9eaf4aa4034b625e8e4c0e1a5b6', 'request_id': 'req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:13.850912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0fa9eaf4aa4034b625e8e4c0e1a5b6', 'request_id': 'req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:13.857610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] The token cache is being invalidate because project 0b6dc0e56919427cb92fc5906b967ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:13.858251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:13.862885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:13.867088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 872/1753] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:13 2022] DELETE /identity/v3/projects/0b6dc0e56919427cb92fc5906b967ce9 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:13.868554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:13.874118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:13.893646 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075 admin admin] The token cache is being invalidate because project ca0fa9eaf4aa4034b625e8e4c0e1a5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:13.894020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:13.901437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5fd08a7c-d5f0-48e9-a331-4f8ec510b075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:13.913567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 882/1754] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:13 2022] DELETE /identity/v3/projects/ca0fa9eaf4aa4034b625e8e4c0e1a5b6 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:13.915111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0ef9e-0bad-4b90-b165-6ea3a1de4843 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:13.915408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0ef9e-0bad-4b90-b165-6ea3a1de4843 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:13.915688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0ef9e-0bad-4b90-b165-6ea3a1de4843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:13.998200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d8f0ef9e-0bad-4b90-b165-6ea3a1de4843 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:13.999516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d8f0ef9e-0bad-4b90-b165-6ea3a1de4843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:14.028838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432ee5e-2bf4-4ddf-ae2c-fb1500374d6d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:14.130096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:14.164378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 883/1755] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:14.167905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffd3f8-9fb8-41a9-8506-11e3dbaef3b4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:14.169393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffd3f8-9fb8-41a9-8506-11e3dbaef3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:14.169857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffd3f8-9fb8-41a9-8506-11e3dbaef3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:14.174808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:14.175810 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:14.176193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:14.176633 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37 admin admin] PATH_INFO: `/v3/projects/329af868e9fd4ebba224241aa9e576f0` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:14.179067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=329af868e9fd4ebba224241aa9e576f0)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:14.181398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:14.199382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-13ffd3f8-9fb8-41a9-8506-11e3dbaef3b4 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:14.202024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-13ffd3f8-9fb8-41a9-8506-11e3dbaef3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:14.217491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 884/1756] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:14.219433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafc5bb-a527-4000-b0bc-4eba7c1f710d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:14.219940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafc5bb-a527-4000-b0bc-4eba7c1f710d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:14.220370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafc5bb-a527-4000-b0bc-4eba7c1f710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:14.296267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9aafc5bb-a527-4000-b0bc-4eba7c1f710d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:14.317601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9aafc5bb-a527-4000-b0bc-4eba7c1f710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:14.370361 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329af868e9fd4ebba224241aa9e576f0', 'request_id': 'req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:14.391776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329af868e9fd4ebba224241aa9e576f0', 'request_id': 'req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:14.419670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329af868e9fd4ebba224241aa9e576f0', 'request_id': 'req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:14.462226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37 admin admin] The token cache is being invalidate because project 329af868e9fd4ebba224241aa9e576f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:14.462526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:14.465571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0ee336db-3f7e-4ea4-9a03-9106c94dfa37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:14.470635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 873/1757] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:13 2022] DELETE /identity/v3/projects/329af868e9fd4ebba224241aa9e576f0 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:14.472794 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd4218-1b51-4201-b706-425ec22d91f6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:14.473268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd4218-1b51-4201-b706-425ec22d91f6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:14.474208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd4218-1b51-4201-b706-425ec22d91f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:14.491823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 885/1758] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:14.493225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3bfa3-e730-46f6-8acd-1fa565691704 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:14.493702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3bfa3-e730-46f6-8acd-1fa565691704 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:14.494142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3bfa3-e730-46f6-8acd-1fa565691704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:14.503663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6bcd4218-1b51-4201-b706-425ec22d91f6 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:14.504928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6bcd4218-1b51-4201-b706-425ec22d91f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:14.520400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 874/1759] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:14.521621 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd4218-1b51-4201-b706-425ec22d91f6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:14.523610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6bcd4218-1b51-4201-b706-425ec22d91f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:14.539938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd4218-1b51-4201-b706-425ec22d91f6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:14.546850 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:14.548342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:14.548830 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:14.549271 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] PATH_INFO: `/v3/users/79376a290eea4d69876be302495d54b4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:14.551834 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79376a290eea4d69876be302495d54b4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:14.555102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:14.589943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:14.668433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79376a290eea4d69876be302495d54b4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:14.675475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1ad3bfa3-e730-46f6-8acd-1fa565691704 None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:14.677243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1ad3bfa3-e730-46f6-8acd-1fa565691704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:14.703052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79376a290eea4d69876be302495d54b4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:14.721834 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79376a290eea4d69876be302495d54b4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:14.722528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79376a290eea4d69876be302495d54b4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:14.779423 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79376a290eea4d69876be302495d54b4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:14.804713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 875/1760] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:14 2022] DELETE /identity/v3/users/79376a290eea4d69876be302495d54b4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:14.808102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:14.813505 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:14.876097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 886/1761] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:14:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:14.877062 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3bfa3-e730-46f6-8acd-1fa565691704 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:14.880075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1ad3bfa3-e730-46f6-8acd-1fa565691704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:14.914814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3bfa3-e730-46f6-8acd-1fa565691704 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:14.976980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:15.029973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737a914-93df-43c8-869c-1836aca1ad60 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:15.039407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7c2d8-e37c-4302-99bf-a1c999943429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:15.040651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7c2d8-e37c-4302-99bf-a1c999943429 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:15.041397 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7c2d8-e37c-4302-99bf-a1c999943429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:15.041904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7c2d8-e37c-4302-99bf-a1c999943429 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:15.045125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7c2d8-e37c-4302-99bf-a1c999943429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:14:15.045672 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7c2d8-e37c-4302-99bf-a1c999943429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:15.048327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7c2d8-e37c-4302-99bf-a1c999943429 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:15.084790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 876/1762] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:14:15.086009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7c2d8-e37c-4302-99bf-a1c999943429 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:15.106584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8bd7c2d8-e37c-4302-99bf-a1c999943429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:15.137769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb47ba1-2700-4b42-8056-b74850e01ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:15.138529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47ba1-2700-4b42-8056-b74850e01ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:15.138670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47ba1-2700-4b42-8056-b74850e01ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:15.140521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47ba1-2700-4b42-8056-b74850e01ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:15.142011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb47ba1-2700-4b42-8056-b74850e01ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:14:15.142599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb47ba1-2700-4b42-8056-b74850e01ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:15.144426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb47ba1-2700-4b42-8056-b74850e01ae1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:15.147937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7c2d8-e37c-4302-99bf-a1c999943429 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:15.163172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 887/1763] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:14:15.164527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb47ba1-2700-4b42-8056-b74850e01ae1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:15.171235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:15.171925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:15.172208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:15.172495 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] PATH_INFO: `/v3/projects/e2cc8f65229c4234af8e7770ee4a3b4a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:15.187725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2cc8f65229c4234af8e7770ee4a3b4a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:15.189762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:15.205378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb47ba1-2700-4b42-8056-b74850e01ae1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:15.219550 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff294c0b-63f7-4759-97b8-921aa0fddfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:15.223017 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff294c0b-63f7-4759-97b8-921aa0fddfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:15.223567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff294c0b-63f7-4759-97b8-921aa0fddfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:15.223990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff294c0b-63f7-4759-97b8-921aa0fddfd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:15.224854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff294c0b-63f7-4759-97b8-921aa0fddfd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:15.227942 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff294c0b-63f7-4759-97b8-921aa0fddfd7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:15.308930 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2cc8f65229c4234af8e7770ee4a3b4a', 'request_id': 'req-7c40f65c-f3e8-433f-88fc-59c39119df4d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:15.311850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 888/1764] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:15 2022] POST /identity/v3/projects => generated 357 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:15.314375 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff294c0b-63f7-4759-97b8-921aa0fddfd7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:15.337864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2cc8f65229c4234af8e7770ee4a3b4a', 'request_id': 'req-7c40f65c-f3e8-433f-88fc-59c39119df4d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:15.380370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2cc8f65229c4234af8e7770ee4a3b4a', 'request_id': 'req-7c40f65c-f3e8-433f-88fc-59c39119df4d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:15.495867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] The token cache is being invalidate because project e2cc8f65229c4234af8e7770ee4a3b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:15.501981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:15.514986 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:15.523191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 877/1765] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:15 2022] DELETE /identity/v3/projects/e2cc8f65229c4234af8e7770ee4a3b4a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:15.524611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:15.530035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:15.588044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff294c0b-63f7-4759-97b8-921aa0fddfd7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:15.612660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e036f7-1d71-4ad2-b2f6-af16052c8860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:15.614340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e036f7-1d71-4ad2-b2f6-af16052c8860 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:15.618505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e036f7-1d71-4ad2-b2f6-af16052c8860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:15.619087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e036f7-1d71-4ad2-b2f6-af16052c8860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:15.620340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e036f7-1d71-4ad2-b2f6-af16052c8860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:15.626959 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e036f7-1d71-4ad2-b2f6-af16052c8860 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:15.682922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:15.747321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 889/1766] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:15 2022] POST /identity/v3/projects => generated 375 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:15.748257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e036f7-1d71-4ad2-b2f6-af16052c8860 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:15.754173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b6e036f7-1d71-4ad2-b2f6-af16052c8860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:15.811298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40f65c-f3e8-433f-88fc-59c39119df4d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:15.915032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:15.918978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e036f7-1d71-4ad2-b2f6-af16052c8860 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:15.933941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834c9c7-877a-48fa-acb5-65c3d20f6264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:15.934932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834c9c7-877a-48fa-acb5-65c3d20f6264 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:15.935624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834c9c7-877a-48fa-acb5-65c3d20f6264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:15.936247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834c9c7-877a-48fa-acb5-65c3d20f6264 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:15.940217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834c9c7-877a-48fa-acb5-65c3d20f6264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:15.946722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834c9c7-877a-48fa-acb5-65c3d20f6264 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:15.953994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd100bba-ea06-4437-b2a4-25e2438bdce0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:15.955752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd100bba-ea06-4437-b2a4-25e2438bdce0 service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:15.956253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd100bba-ea06-4437-b2a4-25e2438bdce0 service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:15.956682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd100bba-ea06-4437-b2a4-25e2438bdce0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:15.962028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fd100bba-ea06-4437-b2a4-25e2438bdce0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:16.005899 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 890/1767] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:15 2022] POST /identity/v3/users => generated 279 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:16.008262 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554464e-2350-4db3-a7c6-c7c3eb23f712 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:16.010924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554464e-2350-4db3-a7c6-c7c3eb23f712 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:16.011576 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554464e-2350-4db3-a7c6-c7c3eb23f712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:16.084427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2554464e-2350-4db3-a7c6-c7c3eb23f712 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:16.086892 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2554464e-2350-4db3-a7c6-c7c3eb23f712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:16.120712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 891/1768] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:16.120712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554464e-2350-4db3-a7c6-c7c3eb23f712 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:16.125186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2554464e-2350-4db3-a7c6-c7c3eb23f712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:16.143417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd100bba-ea06-4437-b2a4-25e2438bdce0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:16.147193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554464e-2350-4db3-a7c6-c7c3eb23f712 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:16.148569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd100bba-ea06-4437-b2a4-25e2438bdce0 service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:16.162570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126cd06f-4cb2-4e2f-88ca-8af3163e9ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:16.166198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cd06f-4cb2-4e2f-88ca-8af3163e9ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:16.166710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cd06f-4cb2-4e2f-88ca-8af3163e9ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:16.167594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126cd06f-4cb2-4e2f-88ca-8af3163e9ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:16.168445 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cd06f-4cb2-4e2f-88ca-8af3163e9ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:16.175806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 878/1769] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:14:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:14:16.178008 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126cd06f-4cb2-4e2f-88ca-8af3163e9ce3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:16.178403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd100bba-ea06-4437-b2a4-25e2438bdce0 service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:16.205713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd100bba-ea06-4437-b2a4-25e2438bdce0 service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:16.223740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6245cce-3c75-4534-8fb4-0e9539044b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:16.226340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6245cce-3c75-4534-8fb4-0e9539044b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:16.227505 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6245cce-3c75-4534-8fb4-0e9539044b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:16.227798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6245cce-3c75-4534-8fb4-0e9539044b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:16.228583 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6245cce-3c75-4534-8fb4-0e9539044b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:16.238618 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6245cce-3c75-4534-8fb4-0e9539044b5a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:16.253901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 892/1770] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:16 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:16.262707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c79c8a-65e3-4385-8da6-5e1abe3554f2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:16.264228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c79c8a-65e3-4385-8da6-5e1abe3554f2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:16.264693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c79c8a-65e3-4385-8da6-5e1abe3554f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:16.319998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 879/1771] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:16.323733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6245cce-3c75-4534-8fb4-0e9539044b5a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:16.369870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6245cce-3c75-4534-8fb4-0e9539044b5a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:16.372710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-76c79c8a-65e3-4385-8da6-5e1abe3554f2 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:16.383374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-76c79c8a-65e3-4385-8da6-5e1abe3554f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:16.393241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34047bd-3d63-4d00-b72e-7a6c480a2338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:16.397022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34047bd-3d63-4d00-b72e-7a6c480a2338 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:16.399941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34047bd-3d63-4d00-b72e-7a6c480a2338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:16.400843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34047bd-3d63-4d00-b72e-7a6c480a2338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:16.403101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34047bd-3d63-4d00-b72e-7a6c480a2338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:16.411912 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34047bd-3d63-4d00-b72e-7a6c480a2338 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:16.417900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 893/1772] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:16.422143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c79c8a-65e3-4385-8da6-5e1abe3554f2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:16.455243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c79c8a-65e3-4385-8da6-5e1abe3554f2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:16.472511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 880/1773] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:16.472511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34047bd-3d63-4d00-b72e-7a6c480a2338 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:16.482479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298d897-1b83-4de7-90d5-7c3bca243046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:16.486448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298d897-1b83-4de7-90d5-7c3bca243046 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:16.490177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298d897-1b83-4de7-90d5-7c3bca243046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:16.490628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298d897-1b83-4de7-90d5-7c3bca243046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:16.491500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298d897-1b83-4de7-90d5-7c3bca243046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:16.493305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298d897-1b83-4de7-90d5-7c3bca243046 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:16.516078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34047bd-3d63-4d00-b72e-7a6c480a2338 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:16.532616 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238710b-4df0-4b10-be46-a5d37b2fa1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:16.533315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238710b-4df0-4b10-be46-a5d37b2fa1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:16.533605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238710b-4df0-4b10-be46-a5d37b2fa1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:16.533886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238710b-4df0-4b10-be46-a5d37b2fa1bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:16.534606 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238710b-4df0-4b10-be46-a5d37b2fa1bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:14:16.535017 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238710b-4df0-4b10-be46-a5d37b2fa1bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:16.537013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238710b-4df0-4b10-be46-a5d37b2fa1bb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:16.537483 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 894/1774] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:16.539457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298d897-1b83-4de7-90d5-7c3bca243046 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:16.570703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298d897-1b83-4de7-90d5-7c3bca243046 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:16.585799 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e277c82-796d-4a58-b5c8-15c2f058affc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:16.586790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e277c82-796d-4a58-b5c8-15c2f058affc admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:16.587173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e277c82-796d-4a58-b5c8-15c2f058affc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:16.587724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e277c82-796d-4a58-b5c8-15c2f058affc admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:16.588759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e277c82-796d-4a58-b5c8-15c2f058affc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:16.590708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e277c82-796d-4a58-b5c8-15c2f058affc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:16.596691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 881/1775] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:14:16.597788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238710b-4df0-4b10-be46-a5d37b2fa1bb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:16.628483 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 895/1776] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:16.630817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e277c82-796d-4a58-b5c8-15c2f058affc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:16.646885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238710b-4df0-4b10-be46-a5d37b2fa1bb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:16.663512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e277c82-796d-4a58-b5c8-15c2f058affc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:16.670737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74c61f-e859-4d41-a5ca-17e34c724fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:16.671316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74c61f-e859-4d41-a5ca-17e34c724fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:16.671607 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74c61f-e859-4d41-a5ca-17e34c724fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:16.672271 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74c61f-e859-4d41-a5ca-17e34c724fcb admin admin] PATH_INFO: `/v3/projects/311b44854c864702bfba21fcbacb0997/users/d126585de5dd46738d706f9140da615c/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:16.681594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284d220-4cb3-4cce-bc4a-75d8a8dcaba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:16.682401 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d220-4cb3-4cce-bc4a-75d8a8dcaba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:16.682786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d220-4cb3-4cce-bc4a-75d8a8dcaba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:16.683874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d220-4cb3-4cce-bc4a-75d8a8dcaba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:16.684684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284d220-4cb3-4cce-bc4a-75d8a8dcaba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:16.707835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284d220-4cb3-4cce-bc4a-75d8a8dcaba0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:16.719604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74c61f-e859-4d41-a5ca-17e34c724fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=311b44854c864702bfba21fcbacb0997, user_id=d126585de5dd46738d706f9140da615c, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:16.722617 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74c61f-e859-4d41-a5ca-17e34c724fcb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:16.774869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 882/1777] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:16 2022] PUT /identity/v3/projects/311b44854c864702bfba21fcbacb0997/users/d126585de5dd46738d706f9140da615c/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:16.777057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74c61f-e859-4d41-a5ca-17e34c724fcb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:16.817145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 896/1778] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:16 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:16.819048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dba03-fdef-41e6-8072-023b5842072d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:16.827934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dba03-fdef-41e6-8072-023b5842072d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:16.829099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dba03-fdef-41e6-8072-023b5842072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:16.945006 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-705dba03-fdef-41e6-8072-023b5842072d None None] MFA Rules not processed for user `d126585de5dd46738d706f9140da615c`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:16.947125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-705dba03-fdef-41e6-8072-023b5842072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:17.007686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74c61f-e859-4d41-a5ca-17e34c724fcb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:17.110969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:17.187845 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:17.232824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2795819-fde5-455c-806e-d5491e7fa8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:17.232824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2795819-fde5-455c-806e-d5491e7fa8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:17.233168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 897/1779] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:17.233256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2795819-fde5-455c-806e-d5491e7fa8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:17.236451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2795819-fde5-455c-806e-d5491e7fa8a0 admin admin] PATH_INFO: `/v3/projects/86f0d0247ff14d77b7a19f9e4395e823/users/9de318c1c96440e490bf1dd2d97caedf/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:17.236616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dba03-fdef-41e6-8072-023b5842072d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:17.280568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dba03-fdef-41e6-8072-023b5842072d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:17.304080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344a5a8-417b-4cb8-b869-b9cbee8414f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:17.307063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a5a8-417b-4cb8-b869-b9cbee8414f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:17.308735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a5a8-417b-4cb8-b869-b9cbee8414f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:17.309889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a5a8-417b-4cb8-b869-b9cbee8414f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:17.311053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344a5a8-417b-4cb8-b869-b9cbee8414f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:17.325580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344a5a8-417b-4cb8-b869-b9cbee8414f8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:17.326709 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2795819-fde5-455c-806e-d5491e7fa8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f0d0247ff14d77b7a19f9e4395e823, user_id=9de318c1c96440e490bf1dd2d97caedf, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:17.329684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2795819-fde5-455c-806e-d5491e7fa8a0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:17.366797 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 883/1780] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:16 2022] PUT /identity/v3/projects/86f0d0247ff14d77b7a19f9e4395e823/users/9de318c1c96440e490bf1dd2d97caedf/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:17.367676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2795819-fde5-455c-806e-d5491e7fa8a0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:17.382484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 898/1781] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:17 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:17.384503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bb574-4ae9-453f-ab2e-bc06c61f456e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:17.387434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bb574-4ae9-453f-ab2e-bc06c61f456e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:17.387938 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bb574-4ae9-453f-ab2e-bc06c61f456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:17.467955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ff1bb574-4ae9-453f-ab2e-bc06c61f456e None None] MFA Rules not processed for user `9de318c1c96440e490bf1dd2d97caedf`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:17.472558 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ff1bb574-4ae9-453f-ab2e-bc06c61f456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:17.552255 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2795819-fde5-455c-806e-d5491e7fa8a0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:17.565126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657318e9-3370-493a-b722-5d95c2982224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:17.565838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657318e9-3370-493a-b722-5d95c2982224 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:17.566201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657318e9-3370-493a-b722-5d95c2982224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:17.569172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657318e9-3370-493a-b722-5d95c2982224 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:17.569965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657318e9-3370-493a-b722-5d95c2982224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:17.571995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657318e9-3370-493a-b722-5d95c2982224 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:17.664238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 884/1782] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:17 2022] POST /identity/v3/projects => generated 357 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:17.665465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657318e9-3370-493a-b722-5d95c2982224 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:17.676880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 899/1783] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:17.681457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bb574-4ae9-453f-ab2e-bc06c61f456e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:17.685459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ff1bb574-4ae9-453f-ab2e-bc06c61f456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:17.743579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bb574-4ae9-453f-ab2e-bc06c61f456e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:17.916273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657318e9-3370-493a-b722-5d95c2982224 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:17.927652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b328ada-5e1a-4285-84f1-ac6d62b21e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:17.928426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b328ada-5e1a-4285-84f1-ac6d62b21e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:17.928712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b328ada-5e1a-4285-84f1-ac6d62b21e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:17.930189 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b328ada-5e1a-4285-84f1-ac6d62b21e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:17.930950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b328ada-5e1a-4285-84f1-ac6d62b21e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:17.935134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b328ada-5e1a-4285-84f1-ac6d62b21e01 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:17.964540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 885/1784] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:17.964540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b328ada-5e1a-4285-84f1-ac6d62b21e01 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:17.994186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:17.995129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:17.995519 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:17.995939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] PATH_INFO: `/v3/projects/5613e3df6d9142fba104f64faec29d7a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:17.997900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5613e3df6d9142fba104f64faec29d7a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:17.999978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:18.007481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b328ada-5e1a-4285-84f1-ac6d62b21e01 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:18.018062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a264a17-d8ff-4190-9115-be199d23079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:18.021316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a264a17-d8ff-4190-9115-be199d23079f admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:18.021729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a264a17-d8ff-4190-9115-be199d23079f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:18.022011 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a264a17-d8ff-4190-9115-be199d23079f admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:18.022875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a264a17-d8ff-4190-9115-be199d23079f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:18.030350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a264a17-d8ff-4190-9115-be199d23079f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:18.117908 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 886/1785] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:17 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:18.123611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a264a17-d8ff-4190-9115-be199d23079f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:18.135261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5613e3df6d9142fba104f64faec29d7a', 'request_id': 'req-17741289-7b0f-4465-a55b-60659b89fad7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:18.151050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a264a17-d8ff-4190-9115-be199d23079f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:18.165404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5613e3df6d9142fba104f64faec29d7a', 'request_id': 'req-17741289-7b0f-4465-a55b-60659b89fad7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:18.188263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:18.210904 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5613e3df6d9142fba104f64faec29d7a', 'request_id': 'req-17741289-7b0f-4465-a55b-60659b89fad7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:18.218070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:18.253183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] The token cache is being invalidate because project 5613e3df6d9142fba104f64faec29d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:18.254068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:18.255738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:18.264866 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 900/1786] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:17 2022] DELETE /identity/v3/projects/5613e3df6d9142fba104f64faec29d7a => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:18.264866 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:18.284444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:18.321760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc04257-6bb4-4ed8-b248-ca3783134e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:18.322624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc04257-6bb4-4ed8-b248-ca3783134e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:18.323057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc04257-6bb4-4ed8-b248-ca3783134e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:18.323486 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc04257-6bb4-4ed8-b248-ca3783134e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:18.324318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc04257-6bb4-4ed8-b248-ca3783134e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:18.326616 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc04257-6bb4-4ed8-b248-ca3783134e53 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:18.418548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 887/1787] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:18 2022] POST /identity/v3/projects => generated 377 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:18.419516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc04257-6bb4-4ed8-b248-ca3783134e53 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:18.423302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4fc04257-6bb4-4ed8-b248-ca3783134e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:18.457599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17741289-7b0f-4465-a55b-60659b89fad7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:18.650762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c71860-8a01-442e-b234-5d669ce897e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:18.651589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c71860-8a01-442e-b234-5d669ce897e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:18.652207 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c71860-8a01-442e-b234-5d669ce897e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:18.652207 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c71860-8a01-442e-b234-5d669ce897e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:18.658189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c71860-8a01-442e-b234-5d669ce897e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:18.660242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c71860-8a01-442e-b234-5d669ce897e6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:18.695687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 901/1788] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:18.699028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067e2b7-ae07-49da-961d-161720897e87 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:18.700261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067e2b7-ae07-49da-961d-161720897e87 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:18.700707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067e2b7-ae07-49da-961d-161720897e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:18.715553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc04257-6bb4-4ed8-b248-ca3783134e53 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:18.739837 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d336d-1d85-4e21-910d-2e1f6d6538e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:18.745580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d336d-1d85-4e21-910d-2e1f6d6538e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:18.747917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d336d-1d85-4e21-910d-2e1f6d6538e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:18.748423 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d336d-1d85-4e21-910d-2e1f6d6538e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:18.749393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d336d-1d85-4e21-910d-2e1f6d6538e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:18.751261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d336d-1d85-4e21-910d-2e1f6d6538e9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:18.762385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6067e2b7-ae07-49da-961d-161720897e87 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:18.765430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6067e2b7-ae07-49da-961d-161720897e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:18.786879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 902/1789] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:18.787830 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067e2b7-ae07-49da-961d-161720897e87 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:18.792021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6067e2b7-ae07-49da-961d-161720897e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:18.814332 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067e2b7-ae07-49da-961d-161720897e87 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:18.817703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 888/1790] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:18.819258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d336d-1d85-4e21-910d-2e1f6d6538e9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:18.835532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037d0d0-a64b-4cad-8b95-13c17d9010fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:18.836336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037d0d0-a64b-4cad-8b95-13c17d9010fd admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:18.836745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037d0d0-a64b-4cad-8b95-13c17d9010fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:18.837153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037d0d0-a64b-4cad-8b95-13c17d9010fd admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:18.837916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037d0d0-a64b-4cad-8b95-13c17d9010fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:18.840344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037d0d0-a64b-4cad-8b95-13c17d9010fd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:18.875576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d336d-1d85-4e21-910d-2e1f6d6538e9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:18.891060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca62fe4-a51d-4336-a777-10bb31403ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:18.901978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 903/1791] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:18 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:18.902823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca62fe4-a51d-4336-a777-10bb31403ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:18.903267 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca62fe4-a51d-4336-a777-10bb31403ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:18.904777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce00ba-c15f-4abc-8c81-b822d51c1219 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:18.905351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca62fe4-a51d-4336-a777-10bb31403ad0 admin admin] PATH_INFO: `/v3/projects/e9a751dd41f84dacb12654755d0342cd/users/406bb9a0c7344a12b2c4adaed2ad06be/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:18.906588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce00ba-c15f-4abc-8c81-b822d51c1219 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:18.907001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce00ba-c15f-4abc-8c81-b822d51c1219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:18.966086 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5dce00ba-c15f-4abc-8c81-b822d51c1219 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:18.967954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5dce00ba-c15f-4abc-8c81-b822d51c1219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:18.976075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca62fe4-a51d-4336-a777-10bb31403ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a751dd41f84dacb12654755d0342cd, user_id=406bb9a0c7344a12b2c4adaed2ad06be, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:18.981321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca62fe4-a51d-4336-a777-10bb31403ad0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:18.984817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 904/1792] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:18.986115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce00ba-c15f-4abc-8c81-b822d51c1219 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:19.004681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce00ba-c15f-4abc-8c81-b822d51c1219 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:19.019113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5f5ad-50f9-4c11-bc68-0f13ff779653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:19.019998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5f5ad-50f9-4c11-bc68-0f13ff779653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:19.020716 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5f5ad-50f9-4c11-bc68-0f13ff779653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:19.020716 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5f5ad-50f9-4c11-bc68-0f13ff779653 admin admin] PATH_INFO: `/v3/projects/b6ecc6ec46de4e3484121380a90802e7/users/41b02fb146de40ccbf23fede9be11ca3/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:19.042546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 889/1793] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:18 2022] PUT /identity/v3/projects/e9a751dd41f84dacb12654755d0342cd/users/406bb9a0c7344a12b2c4adaed2ad06be/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:19.044593 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2428fc-fe5e-4333-a893-86f25640b1c3 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:19.044941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2428fc-fe5e-4333-a893-86f25640b1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:19.051763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2428fc-fe5e-4333-a893-86f25640b1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:19.072349 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5f5ad-50f9-4c11-bc68-0f13ff779653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ecc6ec46de4e3484121380a90802e7, user_id=41b02fb146de40ccbf23fede9be11ca3, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:19.080827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5f5ad-50f9-4c11-bc68-0f13ff779653 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:19.117903 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 905/1794] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:18 2022] PUT /identity/v3/projects/b6ecc6ec46de4e3484121380a90802e7/users/41b02fb146de40ccbf23fede9be11ca3/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:19.117903 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5f5ad-50f9-4c11-bc68-0f13ff779653 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:19.152394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5f2428fc-fe5e-4333-a893-86f25640b1c3 None None] MFA Rules not processed for user `9c4ce8a3f876467f93e7c9efd9e33390`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:19.156963 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5f2428fc-fe5e-4333-a893-86f25640b1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:19.236492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:19.262667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5f5ad-50f9-4c11-bc68-0f13ff779653 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:19.275451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853caff-a969-49ee-bfae-787b56a9ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:19.279740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853caff-a969-49ee-bfae-787b56a9ed00 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:19.281564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853caff-a969-49ee-bfae-787b56a9ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:19.281564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853caff-a969-49ee-bfae-787b56a9ed00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:19.283741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853caff-a969-49ee-bfae-787b56a9ed00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:19.292281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853caff-a969-49ee-bfae-787b56a9ed00 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:19.340418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 906/1795] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:19.342467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853caff-a969-49ee-bfae-787b56a9ed00 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:19.357028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853caff-a969-49ee-bfae-787b56a9ed00 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:19.385364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1290da-de39-40bd-86a8-249180706ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:19.386026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1290da-de39-40bd-86a8-249180706ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:19.386367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1290da-de39-40bd-86a8-249180706ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:19.386692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1290da-de39-40bd-86a8-249180706ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:19.387581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1290da-de39-40bd-86a8-249180706ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:14:19.387921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1290da-de39-40bd-86a8-249180706ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:19.389955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1290da-de39-40bd-86a8-249180706ebf admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:19.414302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 907/1796] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:14:19.414302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cb12d-c415-47a6-94de-ff77d38c28c0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:19.414302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cb12d-c415-47a6-94de-ff77d38c28c0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:19.414302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cb12d-c415-47a6-94de-ff77d38c28c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:19.424023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 890/1797] 10.222.0.44 () {58 vars in 1015 bytes} [Fri Aug 5 07:14:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:19.425166 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2428fc-fe5e-4333-a893-86f25640b1c3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:19.457163 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2428fc-fe5e-4333-a893-86f25640b1c3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:19.483464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dd0ec-12de-4fe7-80ae-9a9c9d330f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:19.484404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dd0ec-12de-4fe7-80ae-9a9c9d330f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:19.484832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dd0ec-12de-4fe7-80ae-9a9c9d330f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:19.485528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dd0ec-12de-4fe7-80ae-9a9c9d330f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:19.486411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410dd0ec-12de-4fe7-80ae-9a9c9d330f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:19.488224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410dd0ec-12de-4fe7-80ae-9a9c9d330f1f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:19.525817 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 891/1798] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:19.530074 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ac3d9-1d8c-47b1-90d6-f7b44e8f1781 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:19.530409 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ac3d9-1d8c-47b1-90d6-f7b44e8f1781 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:19.530686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ac3d9-1d8c-47b1-90d6-f7b44e8f1781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:19.545376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-310cb12d-c415-47a6-94de-ff77d38c28c0 None None] MFA Rules not processed for user `406bb9a0c7344a12b2c4adaed2ad06be`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:19.547007 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-310cb12d-c415-47a6-94de-ff77d38c28c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:19.575949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-bd9ac3d9-1d8c-47b1-90d6-f7b44e8f1781 None None] MFA Rules not processed for user `02c685b300874351ab2dbd62bea1a669`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:19.578485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bd9ac3d9-1d8c-47b1-90d6-f7b44e8f1781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:19.591487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:19.718686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 892/1799] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:19.719685 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ac3d9-1d8c-47b1-90d6-f7b44e8f1781 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:19.736586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ac3d9-1d8c-47b1-90d6-f7b44e8f1781 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:19.744553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540cc21-bcdb-4d9d-a280-fcb297c79d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:19.745931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540cc21-bcdb-4d9d-a280-fcb297c79d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:19.746531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540cc21-bcdb-4d9d-a280-fcb297c79d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:19.747088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540cc21-bcdb-4d9d-a280-fcb297c79d48 admin admin] PATH_INFO: `/v3/projects/41b30043ff8e43dc8e9def65f05c00ce/users/567d0a707c90416e927c511fad5cf2f4/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:19.749740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 908/1800] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:19.752817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cb12d-c415-47a6-94de-ff77d38c28c0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:19.771393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540cc21-bcdb-4d9d-a280-fcb297c79d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b30043ff8e43dc8e9def65f05c00ce, user_id=567d0a707c90416e927c511fad5cf2f4, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:19.775078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540cc21-bcdb-4d9d-a280-fcb297c79d48 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:19.798240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cb12d-c415-47a6-94de-ff77d38c28c0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:19.806371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 893/1801] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:19 2022] PUT /identity/v3/projects/41b30043ff8e43dc8e9def65f05c00ce/users/567d0a707c90416e927c511fad5cf2f4/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:19.807677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540cc21-bcdb-4d9d-a280-fcb297c79d48 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:19.809955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e540cc21-bcdb-4d9d-a280-fcb297c79d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:19.965804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50583a34-4f68-47ff-a57d-57d1e653dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:19.969547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50583a34-4f68-47ff-a57d-57d1e653dd3f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:19.969849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50583a34-4f68-47ff-a57d-57d1e653dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:19.970130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50583a34-4f68-47ff-a57d-57d1e653dd3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:19.970850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50583a34-4f68-47ff-a57d-57d1e653dd3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:19.981051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50583a34-4f68-47ff-a57d-57d1e653dd3f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:20.032611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540cc21-bcdb-4d9d-a280-fcb297c79d48 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:20.039704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 909/1802] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:19 2022] POST /identity/v3/projects => generated 371 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:20.040836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50583a34-4f68-47ff-a57d-57d1e653dd3f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:20.181174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:20.214512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8730533-479a-49c8-af43-941b40639091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:20.215181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8730533-479a-49c8-af43-941b40639091 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:20.216315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8730533-479a-49c8-af43-941b40639091 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:20.217299 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8730533-479a-49c8-af43-941b40639091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:20.227998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50583a34-4f68-47ff-a57d-57d1e653dd3f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:20.253793 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91774a-1caa-4d3b-a465-bc19760d9a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:20.254850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91774a-1caa-4d3b-a465-bc19760d9a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:20.256072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91774a-1caa-4d3b-a465-bc19760d9a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:20.256072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91774a-1caa-4d3b-a465-bc19760d9a86 admin admin] PATH_INFO: `/v3/projects/b6ecc6ec46de4e3484121380a90802e7/users/41b02fb146de40ccbf23fede9be11ca3/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:20.256800 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8730533-479a-49c8-af43-941b40639091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:20.261175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8730533-479a-49c8-af43-941b40639091 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:20.282775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 894/1803] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:20.282775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8730533-479a-49c8-af43-941b40639091 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:20.290233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91774a-1caa-4d3b-a465-bc19760d9a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ecc6ec46de4e3484121380a90802e7, user_id=41b02fb146de40ccbf23fede9be11ca3, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:20.299832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91774a-1caa-4d3b-a465-bc19760d9a86 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:20.358424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8730533-479a-49c8-af43-941b40639091 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:20.364509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 910/1804] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:20 2022] PUT /identity/v3/projects/b6ecc6ec46de4e3484121380a90802e7/users/41b02fb146de40ccbf23fede9be11ca3/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:20.366840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91774a-1caa-4d3b-a465-bc19760d9a86 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:20.561353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:20.589233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51079f48-6dec-4868-91f8-207df3d9b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:20.591245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51079f48-6dec-4868-91f8-207df3d9b540 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:20.593013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51079f48-6dec-4868-91f8-207df3d9b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:20.612278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51079f48-6dec-4868-91f8-207df3d9b540 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:20.613217 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51079f48-6dec-4868-91f8-207df3d9b540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:20.615467 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51079f48-6dec-4868-91f8-207df3d9b540 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:20.674509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91774a-1caa-4d3b-a465-bc19760d9a86 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:20.692123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b40575-33df-45e1-807c-5c25b03b3e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:20.705159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b40575-33df-45e1-807c-5c25b03b3e67 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:20.705159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b40575-33df-45e1-807c-5c25b03b3e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:20.705159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b40575-33df-45e1-807c-5c25b03b3e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:20.705159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b40575-33df-45e1-807c-5c25b03b3e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:20.705159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b40575-33df-45e1-807c-5c25b03b3e67 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:20.734930 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 895/1805] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:20 2022] POST /identity/v3/projects => generated 381 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:20.744090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51079f48-6dec-4868-91f8-207df3d9b540 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:20.752411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 911/1806] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:20.761048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850695c-6020-4b3d-be58-92296d90e8c8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:20.761792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850695c-6020-4b3d-be58-92296d90e8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:20.762936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850695c-6020-4b3d-be58-92296d90e8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:20.901980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f850695c-6020-4b3d-be58-92296d90e8c8 None None] MFA Rules not processed for user `41b02fb146de40ccbf23fede9be11ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:20.903601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f850695c-6020-4b3d-be58-92296d90e8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:21.047649 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51079f48-6dec-4868-91f8-207df3d9b540 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:21.059239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3daea0-32c1-4397-b7b0-279e6eff7e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:21.059797 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3daea0-32c1-4397-b7b0-279e6eff7e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:21.060079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3daea0-32c1-4397-b7b0-279e6eff7e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:21.060351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3daea0-32c1-4397-b7b0-279e6eff7e72 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:21.062678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3daea0-32c1-4397-b7b0-279e6eff7e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:21.070403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3daea0-32c1-4397-b7b0-279e6eff7e72 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:21.121004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 896/1807] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:20 2022] POST /identity/v3/users => generated 286 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:21.122237 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3daea0-32c1-4397-b7b0-279e6eff7e72 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:21.152512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3daea0-32c1-4397-b7b0-279e6eff7e72 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:21.163770 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab68e03-a3a2-40a6-9192-a5fb09155c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:21.165535 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab68e03-a3a2-40a6-9192-a5fb09155c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:21.165821 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab68e03-a3a2-40a6-9192-a5fb09155c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:21.167023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab68e03-a3a2-40a6-9192-a5fb09155c7c admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:21.168594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab68e03-a3a2-40a6-9192-a5fb09155c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:21.173918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab68e03-a3a2-40a6-9192-a5fb09155c7c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:21.230294 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 897/1808] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:21 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:21.231479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab68e03-a3a2-40a6-9192-a5fb09155c7c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:21.236667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 912/1809] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:21.238389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850695c-6020-4b3d-be58-92296d90e8c8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:21.258098 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850695c-6020-4b3d-be58-92296d90e8c8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:21.258985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab68e03-a3a2-40a6-9192-a5fb09155c7c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:21.268763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469d74e-dc39-42ef-b805-fb5cadb03184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:21.271554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca9800-54b9-4e11-800c-066b4dca845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:21.271703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469d74e-dc39-42ef-b805-fb5cadb03184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:21.271981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469d74e-dc39-42ef-b805-fb5cadb03184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:21.273193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469d74e-dc39-42ef-b805-fb5cadb03184 admin admin] PATH_INFO: `/v3/projects/41b30043ff8e43dc8e9def65f05c00ce/users/567d0a707c90416e927c511fad5cf2f4/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:21.277889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469d74e-dc39-42ef-b805-fb5cadb03184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b30043ff8e43dc8e9def65f05c00ce, user_id=567d0a707c90416e927c511fad5cf2f4, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:21.279491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca9800-54b9-4e11-800c-066b4dca845c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:21.280358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca9800-54b9-4e11-800c-066b4dca845c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:21.280855 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca9800-54b9-4e11-800c-066b4dca845c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:21.281873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca9800-54b9-4e11-800c-066b4dca845c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:21.283321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469d74e-dc39-42ef-b805-fb5cadb03184 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:21.287595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca9800-54b9-4e11-800c-066b4dca845c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:21.312322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 913/1810] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:21.313659 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca9800-54b9-4e11-800c-066b4dca845c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:21.319172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 898/1811] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:21 2022] PUT /identity/v3/projects/41b30043ff8e43dc8e9def65f05c00ce/users/567d0a707c90416e927c511fad5cf2f4/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:21.331483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469d74e-dc39-42ef-b805-fb5cadb03184 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:21.332199 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca9800-54b9-4e11-800c-066b4dca845c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:21.339324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0469d74e-dc39-42ef-b805-fb5cadb03184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:21.478436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:21.500571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469d74e-dc39-42ef-b805-fb5cadb03184 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:21.515107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a025b2-4d7d-43a7-9fb7-38810ea8d3f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:21.516924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a025b2-4d7d-43a7-9fb7-38810ea8d3f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:21.517240 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a025b2-4d7d-43a7-9fb7-38810ea8d3f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:21.517512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a025b2-4d7d-43a7-9fb7-38810ea8d3f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:21.520573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40352bf0-53c6-4d8b-a057-0c73b082c7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:21.524702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40352bf0-53c6-4d8b-a057-0c73b082c7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:21.525345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40352bf0-53c6-4d8b-a057-0c73b082c7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:21.526772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40352bf0-53c6-4d8b-a057-0c73b082c7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:21.532602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40352bf0-53c6-4d8b-a057-0c73b082c7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:21.535435 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40352bf0-53c6-4d8b-a057-0c73b082c7c5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:21.579101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 914/1812] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:21.580344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40352bf0-53c6-4d8b-a057-0c73b082c7c5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:21.637062 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40352bf0-53c6-4d8b-a057-0c73b082c7c5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:21.678533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:21.680078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4a6de-c369-4bdc-89ba-8a109bf7ae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:21.681162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4a6de-c369-4bdc-89ba-8a109bf7ae16 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:21.687684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4a6de-c369-4bdc-89ba-8a109bf7ae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:21.689469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4a6de-c369-4bdc-89ba-8a109bf7ae16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:21.696636 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4a6de-c369-4bdc-89ba-8a109bf7ae16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:21.716579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4a6de-c369-4bdc-89ba-8a109bf7ae16 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:21.718620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a025b2-4d7d-43a7-9fb7-38810ea8d3f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:21.721631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a025b2-4d7d-43a7-9fb7-38810ea8d3f5 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:21.754921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 915/1813] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:21.756822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff3d93-5611-46f9-98a7-6c9e5515ab29 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:21.757262 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff3d93-5611-46f9-98a7-6c9e5515ab29 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:21.757785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff3d93-5611-46f9-98a7-6c9e5515ab29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:21.782035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 899/1814] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:21.782663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a025b2-4d7d-43a7-9fb7-38810ea8d3f5 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:21.818098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a025b2-4d7d-43a7-9fb7-38810ea8d3f5 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:21.837021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9475ac-9a93-4aa4-abe8-634468cf3a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:21.838016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9475ac-9a93-4aa4-abe8-634468cf3a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:21.838450 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9475ac-9a93-4aa4-abe8-634468cf3a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:21.839640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9475ac-9a93-4aa4-abe8-634468cf3a78 admin admin] PATH_INFO: `/v3/projects/c09f7c6431f942e6adeb588cee9ada3a/users/573f556944ff4bc2a712097e8d3c2eef/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:21.850519 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ccff3d93-5611-46f9-98a7-6c9e5515ab29 None None] MFA Rules not processed for user `567d0a707c90416e927c511fad5cf2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:21.857140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ccff3d93-5611-46f9-98a7-6c9e5515ab29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:21.875190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9475ac-9a93-4aa4-abe8-634468cf3a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09f7c6431f942e6adeb588cee9ada3a, user_id=573f556944ff4bc2a712097e8d3c2eef, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:21.880866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9475ac-9a93-4aa4-abe8-634468cf3a78 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:21.912414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 900/1815] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:21 2022] PUT /identity/v3/projects/c09f7c6431f942e6adeb588cee9ada3a/users/573f556944ff4bc2a712097e8d3c2eef/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:21.915885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9475ac-9a93-4aa4-abe8-634468cf3a78 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:22.057657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9475ac-9a93-4aa4-abe8-634468cf3a78 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:22.064769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 916/1816] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:22.069107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff3d93-5611-46f9-98a7-6c9e5515ab29 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:22.075498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabf6a1-6756-4daf-87a1-99e72eb8507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:22.076312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabf6a1-6756-4daf-87a1-99e72eb8507d admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:22.076577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabf6a1-6756-4daf-87a1-99e72eb8507d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:22.076879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabf6a1-6756-4daf-87a1-99e72eb8507d admin admin] PATH_INFO: `/v3/projects/57d6e5be44f24cbb91906eab9d7e3d24/users/26cd7da4e1e342ca802a1f9afad2b8c5/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:22.095980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff3d93-5611-46f9-98a7-6c9e5515ab29 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:22.101530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63df4e9-628e-41d3-a3c8-b64d9f334491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:22.102414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63df4e9-628e-41d3-a3c8-b64d9f334491 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:22.102880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63df4e9-628e-41d3-a3c8-b64d9f334491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:22.103308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63df4e9-628e-41d3-a3c8-b64d9f334491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:22.104246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63df4e9-628e-41d3-a3c8-b64d9f334491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:22.106406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63df4e9-628e-41d3-a3c8-b64d9f334491 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:22.112264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabf6a1-6756-4daf-87a1-99e72eb8507d admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d6e5be44f24cbb91906eab9d7e3d24, user_id=26cd7da4e1e342ca802a1f9afad2b8c5, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:22.115360 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabf6a1-6756-4daf-87a1-99e72eb8507d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:22.119029 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 917/1817] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:22.120511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63df4e9-628e-41d3-a3c8-b64d9f334491 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:22.148907 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 901/1818] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:21 2022] PUT /identity/v3/projects/57d6e5be44f24cbb91906eab9d7e3d24/users/26cd7da4e1e342ca802a1f9afad2b8c5/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:22.149964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabf6a1-6756-4daf-87a1-99e72eb8507d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:22.159939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ccabf6a1-6756-4daf-87a1-99e72eb8507d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:22.283651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63df4e9-628e-41d3-a3c8-b64d9f334491 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:22.292327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabf6a1-6756-4daf-87a1-99e72eb8507d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:22.293355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee29b47-5aac-4e16-85fc-aeedb8490d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:22.294016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee29b47-5aac-4e16-85fc-aeedb8490d60 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:22.294290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee29b47-5aac-4e16-85fc-aeedb8490d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:22.294565 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee29b47-5aac-4e16-85fc-aeedb8490d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:22.297152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47174ad-00d4-41e4-9a41-7cf8710e5909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:22.298480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47174ad-00d4-41e4-9a41-7cf8710e5909 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:22.298883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47174ad-00d4-41e4-9a41-7cf8710e5909 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:22.299273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47174ad-00d4-41e4-9a41-7cf8710e5909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:22.301535 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e47174ad-00d4-41e4-9a41-7cf8710e5909 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:22.306112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2ee29b47-5aac-4e16-85fc-aeedb8490d60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:22.400460 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47174ad-00d4-41e4-9a41-7cf8710e5909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:22.402549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47174ad-00d4-41e4-9a41-7cf8710e5909 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:22.413058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:22.440648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 902/1819] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:22.441769 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47174ad-00d4-41e4-9a41-7cf8710e5909 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:22.444870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee29b47-5aac-4e16-85fc-aeedb8490d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:22.446615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee29b47-5aac-4e16-85fc-aeedb8490d60 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:22.453236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:22.469383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 918/1820] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:22.484343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b2cce-9d2c-4c93-b2bc-d69288b7afb6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:22.485637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b2cce-9d2c-4c93-b2bc-d69288b7afb6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:22.486752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b2cce-9d2c-4c93-b2bc-d69288b7afb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:22.569037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-927b2cce-9d2c-4c93-b2bc-d69288b7afb6 None None] MFA Rules not processed for user `26cd7da4e1e342ca802a1f9afad2b8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:22.573680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-927b2cce-9d2c-4c93-b2bc-d69288b7afb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:22.669186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47174ad-00d4-41e4-9a41-7cf8710e5909 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:22.679775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98348fa0-6662-4a08-9705-525f101f98d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:22.681312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98348fa0-6662-4a08-9705-525f101f98d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:22.681940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98348fa0-6662-4a08-9705-525f101f98d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:22.682439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98348fa0-6662-4a08-9705-525f101f98d4 admin admin] PATH_INFO: `/v3/projects/c09f7c6431f942e6adeb588cee9ada3a/users/573f556944ff4bc2a712097e8d3c2eef/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:22.686576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98348fa0-6662-4a08-9705-525f101f98d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09f7c6431f942e6adeb588cee9ada3a, user_id=573f556944ff4bc2a712097e8d3c2eef, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:22.696137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98348fa0-6662-4a08-9705-525f101f98d4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:22.724118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 903/1821] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:22 2022] PUT /identity/v3/projects/c09f7c6431f942e6adeb588cee9ada3a/users/573f556944ff4bc2a712097e8d3c2eef/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:22.739157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1389d90-414d-4d6d-8ad7-241fe3fc7a1f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:22.739907 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1389d90-414d-4d6d-8ad7-241fe3fc7a1f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:22.740469 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1389d90-414d-4d6d-8ad7-241fe3fc7a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:22.837745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b1389d90-414d-4d6d-8ad7-241fe3fc7a1f None None] MFA Rules not processed for user `573f556944ff4bc2a712097e8d3c2eef`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:22.843960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b1389d90-414d-4d6d-8ad7-241fe3fc7a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:22.865325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 919/1822] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:22.869754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b2cce-9d2c-4c93-b2bc-d69288b7afb6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:22.897476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b2cce-9d2c-4c93-b2bc-d69288b7afb6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:23.156239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 904/1823] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:23.172252 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1389d90-414d-4d6d-8ad7-241fe3fc7a1f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:23.188766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73ddda-288e-4b91-b2fe-24d75022642b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:23.189922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73ddda-288e-4b91-b2fe-24d75022642b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:23.190530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73ddda-288e-4b91-b2fe-24d75022642b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:23.191147 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73ddda-288e-4b91-b2fe-24d75022642b admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:23.192219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73ddda-288e-4b91-b2fe-24d75022642b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:23.201442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73ddda-288e-4b91-b2fe-24d75022642b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:23.317145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 920/1824] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:22 2022] POST /identity/v3/projects => generated 371 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:23.318675 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73ddda-288e-4b91-b2fe-24d75022642b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:23.379419 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1389d90-414d-4d6d-8ad7-241fe3fc7a1f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:23.483846 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:23.535348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73ddda-288e-4b91-b2fe-24d75022642b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:23.543918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36744969-6097-4c19-87eb-f8720f46bd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:23.544666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36744969-6097-4c19-87eb-f8720f46bd48 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:23.545032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36744969-6097-4c19-87eb-f8720f46bd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:23.545291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36744969-6097-4c19-87eb-f8720f46bd48 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:23.546151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36744969-6097-4c19-87eb-f8720f46bd48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:23.550090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36744969-6097-4c19-87eb-f8720f46bd48 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:23.574370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dfe7d-8d69-4ae5-9916-0a871e0867ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:23.575802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dfe7d-8d69-4ae5-9916-0a871e0867ce service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:23.576393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dfe7d-8d69-4ae5-9916-0a871e0867ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:23.576879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dfe7d-8d69-4ae5-9916-0a871e0867ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:23.618261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 921/1825] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:23 2022] POST /identity/v3/users => generated 292 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:23.619173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36744969-6097-4c19-87eb-f8720f46bd48 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:23.643047 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:23.657271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36744969-6097-4c19-87eb-f8720f46bd48 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:23.677696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348a00e-009c-4c85-8450-7d49874bceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:23.679038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348a00e-009c-4c85-8450-7d49874bceca admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:23.679818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348a00e-009c-4c85-8450-7d49874bceca admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:23.681995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348a00e-009c-4c85-8450-7d49874bceca admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:23.683139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348a00e-009c-4c85-8450-7d49874bceca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:23.689785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348a00e-009c-4c85-8450-7d49874bceca admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:23.736845 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 922/1826] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:23.738530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348a00e-009c-4c85-8450-7d49874bceca admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:23.767137 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348a00e-009c-4c85-8450-7d49874bceca admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:23.790616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adad2a-7643-4ce1-b664-8d28b21b9935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:23.791329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adad2a-7643-4ce1-b664-8d28b21b9935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:23.791607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adad2a-7643-4ce1-b664-8d28b21b9935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:23.791878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adad2a-7643-4ce1-b664-8d28b21b9935 admin admin] PATH_INFO: `/v3/projects/dda33ba38acc4e439b353af5ac89bf42/users/9c1ba110a1884c478f013d0aec101b55/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:23.804884 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dfe7d-8d69-4ae5-9916-0a871e0867ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:23.806684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dfe7d-8d69-4ae5-9916-0a871e0867ce service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:23.830273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 905/1827] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:23.886442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adad2a-7643-4ce1-b664-8d28b21b9935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda33ba38acc4e439b353af5ac89bf42, user_id=9c1ba110a1884c478f013d0aec101b55, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:23.898958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adad2a-7643-4ce1-b664-8d28b21b9935 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:23.973742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 923/1828] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:23 2022] PUT /identity/v3/projects/dda33ba38acc4e439b353af5ac89bf42/users/9c1ba110a1884c478f013d0aec101b55/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:23.978276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dfe7d-8d69-4ae5-9916-0a871e0867ce service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:23.994869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dfe7d-8d69-4ae5-9916-0a871e0867ce service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:24.155178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f23ef-011a-499c-b070-121e8e380450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:24.155844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f23ef-011a-499c-b070-121e8e380450 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:24.156164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f23ef-011a-499c-b070-121e8e380450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:24.156451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f23ef-011a-499c-b070-121e8e380450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:24.165559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f23ef-011a-499c-b070-121e8e380450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:24.165559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f23ef-011a-499c-b070-121e8e380450 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:24.195330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 906/1829] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:24.200574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adad2a-7643-4ce1-b664-8d28b21b9935 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:24.222555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adad2a-7643-4ce1-b664-8d28b21b9935 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:24.233691 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cd879-6f31-404f-aff2-042dcc58374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:24.236026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cd879-6f31-404f-aff2-042dcc58374c admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:24.236708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cd879-6f31-404f-aff2-042dcc58374c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:24.236854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cd879-6f31-404f-aff2-042dcc58374c admin admin] PATH_INFO: `/v3/projects/dda33ba38acc4e439b353af5ac89bf42/users/9c1ba110a1884c478f013d0aec101b55/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:24.242677 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cd879-6f31-404f-aff2-042dcc58374c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda33ba38acc4e439b353af5ac89bf42, user_id=9c1ba110a1884c478f013d0aec101b55, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:24.254210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cd879-6f31-404f-aff2-042dcc58374c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:24.292701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 924/1830] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:24 2022] PUT /identity/v3/projects/dda33ba38acc4e439b353af5ac89bf42/users/9c1ba110a1884c478f013d0aec101b55/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:24.297992 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e600d2b-41c5-43d9-8ccc-6671909f593f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:24.298823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e600d2b-41c5-43d9-8ccc-6671909f593f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:24.299279 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e600d2b-41c5-43d9-8ccc-6671909f593f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:24.375137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7e600d2b-41c5-43d9-8ccc-6671909f593f None None] MFA Rules not processed for user `9c1ba110a1884c478f013d0aec101b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:24.376881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7e600d2b-41c5-43d9-8ccc-6671909f593f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:24.612971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 907/1831] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:24.640590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccab8-0b3a-4758-81a2-fbf6262d3def None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:24.641108 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccab8-0b3a-4758-81a2-fbf6262d3def None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:24.641203 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccab8-0b3a-4758-81a2-fbf6262d3def None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:24.643159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 925/1832] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:14:24.753116 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04cc5c-7f6a-4266-ba9f-5027ea658c41 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:24.754028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04cc5c-7f6a-4266-ba9f-5027ea658c41 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:24.754028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04cc5c-7f6a-4266-ba9f-5027ea658c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:24.790241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:24.815629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ccab8-0b3a-4758-81a2-fbf6262d3def None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:24.832411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ab04cc5c-7f6a-4266-ba9f-5027ea658c41 None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:24.839724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ab04cc5c-7f6a-4266-ba9f-5027ea658c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:24.960925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ccab8-0b3a-4758-81a2-fbf6262d3def None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:24.968656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c47f7-32e8-4577-aac2-abf96d769ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:24.970154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c47f7-32e8-4577-aac2-abf96d769ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:24.971014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c47f7-32e8-4577-aac2-abf96d769ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:24.971403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c47f7-32e8-4577-aac2-abf96d769ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:25.000747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c47f7-32e8-4577-aac2-abf96d769ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:25.011191 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c47f7-32e8-4577-aac2-abf96d769ef9 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:25.051166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 926/1833] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:14:25.175484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 908/1834] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:14:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:26.016311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c47f7-32e8-4577-aac2-abf96d769ef9 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:26.038936 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04cc5c-7f6a-4266-ba9f-5027ea658c41 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:26.040946 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ab04cc5c-7f6a-4266-ba9f-5027ea658c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:26.077868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04cc5c-7f6a-4266-ba9f-5027ea658c41 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:26.090089 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25a70d-5aae-4cc3-8586-619b94e282e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:26.091060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25a70d-5aae-4cc3-8586-619b94e282e4 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:26.091491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25a70d-5aae-4cc3-8586-619b94e282e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:26.095988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25a70d-5aae-4cc3-8586-619b94e282e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:26.116149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25a70d-5aae-4cc3-8586-619b94e282e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:26.119464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25a70d-5aae-4cc3-8586-619b94e282e4 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:26.150078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 909/1835] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:26.300238 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c47f7-32e8-4577-aac2-abf96d769ef9 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:26.310035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:26.310035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:26.310498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:26.310591 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] PATH_INFO: `/v3/users/406bb9a0c7344a12b2c4adaed2ad06be` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:26.312805 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=406bb9a0c7344a12b2c4adaed2ad06be)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:26.315058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:26.415373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406bb9a0c7344a12b2c4adaed2ad06be'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:26.416174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406bb9a0c7344a12b2c4adaed2ad06be'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:26.427777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406bb9a0c7344a12b2c4adaed2ad06be'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:26.428616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406bb9a0c7344a12b2c4adaed2ad06be'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:26.435939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:26.448326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406bb9a0c7344a12b2c4adaed2ad06be'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:26.471078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 927/1836] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:26 2022] DELETE /identity/v3/users/406bb9a0c7344a12b2c4adaed2ad06be => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:26.475517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99ba0-32eb-4206-a123-70a13861f79d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:26.476004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99ba0-32eb-4206-a123-70a13861f79d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:26.476232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99ba0-32eb-4206-a123-70a13861f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:26.498755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-78d99ba0-32eb-4206-a123-70a13861f79d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:26.499780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-78d99ba0-32eb-4206-a123-70a13861f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:26.525690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:26.527249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:26.587343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 910/1837] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:26.598394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99ba0-32eb-4206-a123-70a13861f79d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:26.600300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-78d99ba0-32eb-4206-a123-70a13861f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:26.618961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0d69f-9725-442b-9a83-9c451e77a6b4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:26.624978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325237a-00c2-415b-83c5-2a6aa312035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:26.625650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325237a-00c2-415b-83c5-2a6aa312035c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:26.625974 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325237a-00c2-415b-83c5-2a6aa312035c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:26.626262 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325237a-00c2-415b-83c5-2a6aa312035c admin admin] PATH_INFO: `/v3/users/26cd7da4e1e342ca802a1f9afad2b8c5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:26.627953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325237a-00c2-415b-83c5-2a6aa312035c admin admin] RBAC: Authorizing `identity:delete_user(user_id=26cd7da4e1e342ca802a1f9afad2b8c5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:26.630197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325237a-00c2-415b-83c5-2a6aa312035c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:26.682104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99ba0-32eb-4206-a123-70a13861f79d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:26.690013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974c1a-3b17-4762-bd0f-523399fbffeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:26.690666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974c1a-3b17-4762-bd0f-523399fbffeb service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:26.690954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974c1a-3b17-4762-bd0f-523399fbffeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:26.691328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974c1a-3b17-4762-bd0f-523399fbffeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:26.721497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e974c1a-3b17-4762-bd0f-523399fbffeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:26.723121 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e974c1a-3b17-4762-bd0f-523399fbffeb service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:26.731895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6325237a-00c2-415b-83c5-2a6aa312035c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26cd7da4e1e342ca802a1f9afad2b8c5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:26.735774 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 911/1838] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:26.736715 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6325237a-00c2-415b-83c5-2a6aa312035c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26cd7da4e1e342ca802a1f9afad2b8c5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:26.747532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6325237a-00c2-415b-83c5-2a6aa312035c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26cd7da4e1e342ca802a1f9afad2b8c5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:26.748381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6325237a-00c2-415b-83c5-2a6aa312035c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26cd7da4e1e342ca802a1f9afad2b8c5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:26.752394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74b145-96d5-44df-a222-46dbaaf96af5 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:26.752647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74b145-96d5-44df-a222-46dbaaf96af5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:26.752883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74b145-96d5-44df-a222-46dbaaf96af5 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:26.754459 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 912/1839] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:14:26.767693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6325237a-00c2-415b-83c5-2a6aa312035c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26cd7da4e1e342ca802a1f9afad2b8c5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:26.784738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b7881-27cd-4b7a-aa1a-eca12a3348b3 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:26.785147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b7881-27cd-4b7a-aa1a-eca12a3348b3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:26.785330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b7881-27cd-4b7a-aa1a-eca12a3348b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:26.794870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 928/1840] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:26 2022] DELETE /identity/v3/users/26cd7da4e1e342ca802a1f9afad2b8c5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:14:26.798044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca9784-2a35-4320-8882-2b3af37d29ec None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:26.799368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca9784-2a35-4320-8882-2b3af37d29ec None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:26.799653 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca9784-2a35-4320-8882-2b3af37d29ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:26.818325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-fc9b7881-27cd-4b7a-aa1a-eca12a3348b3 None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:26.820787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fc9b7881-27cd-4b7a-aa1a-eca12a3348b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:26.839191 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a9ca9784-2a35-4320-8882-2b3af37d29ec None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:26.841179 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a9ca9784-2a35-4320-8882-2b3af37d29ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:26.867159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:26.955385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:26.956052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 913/1841] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:14:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:26.981256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b7881-27cd-4b7a-aa1a-eca12a3348b3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:26.985508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fc9b7881-27cd-4b7a-aa1a-eca12a3348b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:26.990420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 929/1842] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:27.009898 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b7881-27cd-4b7a-aa1a-eca12a3348b3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:27.017814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca9784-2a35-4320-8882-2b3af37d29ec None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:27.019363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a9ca9784-2a35-4320-8882-2b3af37d29ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:27.033728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40346c1-ee57-4f8b-99b7-bd6221d61c9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:27.034261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40346c1-ee57-4f8b-99b7-bd6221d61c9e service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:27.034541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40346c1-ee57-4f8b-99b7-bd6221d61c9e service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:27.034896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40346c1-ee57-4f8b-99b7-bd6221d61c9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:27.045967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40346c1-ee57-4f8b-99b7-bd6221d61c9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:27.047916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40346c1-ee57-4f8b-99b7-bd6221d61c9e service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:27.074514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 914/1843] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:27.146396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca9784-2a35-4320-8882-2b3af37d29ec None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:27.151832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041c27c-5899-42ff-af8d-239e27e42b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:27.151832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041c27c-5899-42ff-af8d-239e27e42b7f service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:27.152011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041c27c-5899-42ff-af8d-239e27e42b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:27.152334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041c27c-5899-42ff-af8d-239e27e42b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:27.163020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041c27c-5899-42ff-af8d-239e27e42b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:27.164487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041c27c-5899-42ff-af8d-239e27e42b7f service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:27.175555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 930/1844] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:27.611957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40346c1-ee57-4f8b-99b7-bd6221d61c9e service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:27.613748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e40346c1-ee57-4f8b-99b7-bd6221d61c9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:27.630239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40346c1-ee57-4f8b-99b7-bd6221d61c9e service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:27.636368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:27.638292 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:27.639845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:27.639969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] PATH_INFO: `/v3/projects/e9a751dd41f84dacb12654755d0342cd` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:27.641521 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a751dd41f84dacb12654755d0342cd)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:27.644884 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:27.706207 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a751dd41f84dacb12654755d0342cd', 'request_id': 'req-6a006db8-16a4-44d0-9e44-4cf64929c5cf'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:27.719428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a751dd41f84dacb12654755d0342cd', 'request_id': 'req-6a006db8-16a4-44d0-9e44-4cf64929c5cf'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:27.729550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a751dd41f84dacb12654755d0342cd', 'request_id': 'req-6a006db8-16a4-44d0-9e44-4cf64929c5cf'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:27.748050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] The token cache is being invalidate because project e9a751dd41f84dacb12654755d0342cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:27.748391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:27.749272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:27.754159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 915/1845] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:27 2022] DELETE /identity/v3/projects/e9a751dd41f84dacb12654755d0342cd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:27.755790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041c27c-5899-42ff-af8d-239e27e42b7f service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:27.768360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041c27c-5899-42ff-af8d-239e27e42b7f service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:27.797744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:27.800212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:27.852798 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:27.853579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:27.853804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:27.854087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] PATH_INFO: `/v3/users/573f556944ff4bc2a712097e8d3c2eef` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:27.855362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] RBAC: Authorizing `identity:delete_user(user_id=573f556944ff4bc2a712097e8d3c2eef)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:27.857858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:27.916611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a006db8-16a4-44d0-9e44-4cf64929c5cf admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:27.922722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:27.923476 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:27.923744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:27.924160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] PATH_INFO: `/v3/projects/57d6e5be44f24cbb91906eab9d7e3d24` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:27.925391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d6e5be44f24cbb91906eab9d7e3d24)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:27.927490 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:27.927757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573f556944ff4bc2a712097e8d3c2eef'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:27.928547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573f556944ff4bc2a712097e8d3c2eef'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:27.939325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573f556944ff4bc2a712097e8d3c2eef'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:27.940221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573f556944ff4bc2a712097e8d3c2eef'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:27.957602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573f556944ff4bc2a712097e8d3c2eef'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:27.971059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:27.988944 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 931/1846] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:27 2022] DELETE /identity/v3/users/573f556944ff4bc2a712097e8d3c2eef => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:27.990980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d6e5be44f24cbb91906eab9d7e3d24', 'request_id': 'req-af441db3-e456-4f37-b10e-3578a43cd816'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.005040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d6e5be44f24cbb91906eab9d7e3d24', 'request_id': 'req-af441db3-e456-4f37-b10e-3578a43cd816'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.012961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d6e5be44f24cbb91906eab9d7e3d24', 'request_id': 'req-af441db3-e456-4f37-b10e-3578a43cd816'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.024679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] The token cache is being invalidate because project 57d6e5be44f24cbb91906eab9d7e3d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:28.025001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.025691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.027268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 916/1847] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:27 2022] DELETE /identity/v3/projects/57d6e5be44f24cbb91906eab9d7e3d24 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:14:28.032257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:28.033796 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:28.056065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:28.105959 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23da34-2eb9-48cf-be56-6daf6e1b95df admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:28.111666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:28.112457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:28.112968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:28.113318 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] PATH_INFO: `/v3/users/9c1ba110a1884c478f013d0aec101b55` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:28.114607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1ba110a1884c478f013d0aec101b55)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:28.116761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:28.187752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1ba110a1884c478f013d0aec101b55'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.188424 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1ba110a1884c478f013d0aec101b55'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.199561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1ba110a1884c478f013d0aec101b55'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.200531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1ba110a1884c478f013d0aec101b55'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.216803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1ba110a1884c478f013d0aec101b55'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.241286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 932/1848] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:28 2022] DELETE /identity/v3/users/9c1ba110a1884c478f013d0aec101b55 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:28.575710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:28.577481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:28.654735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:28.656779 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:28.680601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af441db3-e456-4f37-b10e-3578a43cd816 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:28.733329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4b0e7-7d98-4286-b78e-d8d868cdf5ef admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:28.738866 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:28.739546 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:28.739826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:28.740102 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3 admin admin] PATH_INFO: `/v3/projects/c09f7c6431f942e6adeb588cee9ada3a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:28.741362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09f7c6431f942e6adeb588cee9ada3a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:28.741483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec383f40-c409-4a94-a953-57fbb752fb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:28.742077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec383f40-c409-4a94-a953-57fbb752fb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:28.742358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec383f40-c409-4a94-a953-57fbb752fb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:28.742637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec383f40-c409-4a94-a953-57fbb752fb49 admin admin] PATH_INFO: `/v3/projects/dda33ba38acc4e439b353af5ac89bf42` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:28.743328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:28.744145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec383f40-c409-4a94-a953-57fbb752fb49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda33ba38acc4e439b353af5ac89bf42)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:28.746239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec383f40-c409-4a94-a953-57fbb752fb49 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:28.790389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:28.799116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09f7c6431f942e6adeb588cee9ada3a', 'request_id': 'req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.804978 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ec383f40-c409-4a94-a953-57fbb752fb49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda33ba38acc4e439b353af5ac89bf42', 'request_id': 'req-ec383f40-c409-4a94-a953-57fbb752fb49'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.808374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09f7c6431f942e6adeb588cee9ada3a', 'request_id': 'req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.813388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ec383f40-c409-4a94-a953-57fbb752fb49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda33ba38acc4e439b353af5ac89bf42', 'request_id': 'req-ec383f40-c409-4a94-a953-57fbb752fb49'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.815582 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09f7c6431f942e6adeb588cee9ada3a', 'request_id': 'req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.819632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ec383f40-c409-4a94-a953-57fbb752fb49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda33ba38acc4e439b353af5ac89bf42', 'request_id': 'req-ec383f40-c409-4a94-a953-57fbb752fb49'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.821490 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:28.827438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3 admin admin] The token cache is being invalidate because project c09f7c6431f942e6adeb588cee9ada3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:28.827637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.828334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-27dbfebb-7945-4f65-91f9-14c6f51aa2d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.829908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 933/1849] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:28 2022] DELETE /identity/v3/projects/c09f7c6431f942e6adeb588cee9ada3a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:28.833395 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ec383f40-c409-4a94-a953-57fbb752fb49 admin admin] The token cache is being invalidate because project dda33ba38acc4e439b353af5ac89bf42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:28.833837 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ec383f40-c409-4a94-a953-57fbb752fb49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.834347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ec383f40-c409-4a94-a953-57fbb752fb49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:28.835245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f747e45-4485-47a2-9d4e-dbcb96012c40 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:28.835533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f747e45-4485-47a2-9d4e-dbcb96012c40 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:28.835814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f747e45-4485-47a2-9d4e-dbcb96012c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:28.839391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 917/1850] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:28 2022] DELETE /identity/v3/projects/dda33ba38acc4e439b353af5ac89bf42 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:28.841020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343707c-22c1-4670-a87c-1b903e5aab54 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:28.841306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343707c-22c1-4670-a87c-1b903e5aab54 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:28.841698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343707c-22c1-4670-a87c-1b903e5aab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:28.865988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f343707c-22c1-4670-a87c-1b903e5aab54 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:28.867193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f343707c-22c1-4670-a87c-1b903e5aab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:28.867499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8f747e45-4485-47a2-9d4e-dbcb96012c40 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:28.868930 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8f747e45-4485-47a2-9d4e-dbcb96012c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:28.930220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 918/1851] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:14:28.935070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 934/1852] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:14:28.938124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ebe23-1525-4c13-8d48-26706081291b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:28.938412 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ebe23-1525-4c13-8d48-26706081291b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:28.938712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ebe23-1525-4c13-8d48-26706081291b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:28.942940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731bb0a-398c-4d99-947f-672d086e2e9a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:28.943232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731bb0a-398c-4d99-947f-672d086e2e9a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:28.943510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731bb0a-398c-4d99-947f-672d086e2e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:28.961174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-682ebe23-1525-4c13-8d48-26706081291b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:28.962633 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-682ebe23-1525-4c13-8d48-26706081291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:28.966809 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e731bb0a-398c-4d99-947f-672d086e2e9a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:28.967996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e731bb0a-398c-4d99-947f-672d086e2e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:28.971558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 919/1853] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:28.977469 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ebe23-1525-4c13-8d48-26706081291b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:28.979858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 935/1854] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:28.984161 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731bb0a-398c-4d99-947f-672d086e2e9a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:28.987716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ebe23-1525-4c13-8d48-26706081291b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:28.993635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731bb0a-398c-4d99-947f-672d086e2e9a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:28.993769 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786446d-3f0d-4285-ba5c-4cdb31de94c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:28.994371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786446d-3f0d-4285-ba5c-4cdb31de94c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:28.994649 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786446d-3f0d-4285-ba5c-4cdb31de94c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:28.994926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786446d-3f0d-4285-ba5c-4cdb31de94c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:28.995661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786446d-3f0d-4285-ba5c-4cdb31de94c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:14:28.995966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786446d-3f0d-4285-ba5c-4cdb31de94c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:28.997613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786446d-3f0d-4285-ba5c-4cdb31de94c3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:28.998749 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904964d-e567-47d9-83c4-962f1552bb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:28.999377 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904964d-e567-47d9-83c4-962f1552bb2f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:28.999671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904964d-e567-47d9-83c4-962f1552bb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:28.999933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904964d-e567-47d9-83c4-962f1552bb2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.001023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904964d-e567-47d9-83c4-962f1552bb2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:14:29.001023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904964d-e567-47d9-83c4-962f1552bb2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.002546 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904964d-e567-47d9-83c4-962f1552bb2f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.012132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 920/1855] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:14:29.016596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786446d-3f0d-4285-ba5c-4cdb31de94c3 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.018954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 936/1856] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:14:29.023391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904964d-e567-47d9-83c4-962f1552bb2f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.027695 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786446d-3f0d-4285-ba5c-4cdb31de94c3 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.032871 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c440b-2b6b-4ebc-9608-ce2e50d0b94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.033532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c440b-2b6b-4ebc-9608-ce2e50d0b94d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.033812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c440b-2b6b-4ebc-9608-ce2e50d0b94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.034098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c440b-2b6b-4ebc-9608-ce2e50d0b94d admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.034753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c440b-2b6b-4ebc-9608-ce2e50d0b94d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.035296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904964d-e567-47d9-83c4-962f1552bb2f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.036679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c440b-2b6b-4ebc-9608-ce2e50d0b94d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.041311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1ae99-9663-4f58-9d85-3e5f50921bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.041967 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ae99-9663-4f58-9d85-3e5f50921bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.042256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ae99-9663-4f58-9d85-3e5f50921bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.042532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1ae99-9663-4f58-9d85-3e5f50921bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.043278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1ae99-9663-4f58-9d85-3e5f50921bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.045471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1ae99-9663-4f58-9d85-3e5f50921bbb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.078166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 937/1857] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:29 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:14:29.081136 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 921/1858] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:29 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:29.085969 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1ae99-9663-4f58-9d85-3e5f50921bbb admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.086250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c440b-2b6b-4ebc-9608-ce2e50d0b94d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.160214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1ae99-9663-4f58-9d85-3e5f50921bbb admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.165389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeadf2-2634-4f52-aad3-81e759bc1d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.166034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeadf2-2634-4f52-aad3-81e759bc1d43 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.166313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeadf2-2634-4f52-aad3-81e759bc1d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.166589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeadf2-2634-4f52-aad3-81e759bc1d43 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.167265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeadf2-2634-4f52-aad3-81e759bc1d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.167460 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c440b-2b6b-4ebc-9608-ce2e50d0b94d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.169284 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeadf2-2634-4f52-aad3-81e759bc1d43 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.172146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d4b70-1f87-4edc-8deb-5bf97d8a15ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.172816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d4b70-1f87-4edc-8deb-5bf97d8a15ee admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.173124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d4b70-1f87-4edc-8deb-5bf97d8a15ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.173395 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d4b70-1f87-4edc-8deb-5bf97d8a15ee admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.174086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d4b70-1f87-4edc-8deb-5bf97d8a15ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.176149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d4b70-1f87-4edc-8deb-5bf97d8a15ee admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.197053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 938/1859] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:29 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:29.198841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeadf2-2634-4f52-aad3-81e759bc1d43 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.202032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 922/1860] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:29 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:29.206018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d4b70-1f87-4edc-8deb-5bf97d8a15ee admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.209743 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeadf2-2634-4f52-aad3-81e759bc1d43 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.216987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb53a83-7f91-4bf6-877e-71662ee1198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.217627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb53a83-7f91-4bf6-877e-71662ee1198d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.217903 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb53a83-7f91-4bf6-877e-71662ee1198d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.218166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb53a83-7f91-4bf6-877e-71662ee1198d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.218568 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d4b70-1f87-4edc-8deb-5bf97d8a15ee admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.218871 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb53a83-7f91-4bf6-877e-71662ee1198d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.220552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb53a83-7f91-4bf6-877e-71662ee1198d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.223987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b758f-84d6-4d0d-94e0-b0b456a5ca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.224734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b758f-84d6-4d0d-94e0-b0b456a5ca4e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.225156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b758f-84d6-4d0d-94e0-b0b456a5ca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.225501 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b758f-84d6-4d0d-94e0-b0b456a5ca4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.226282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b758f-84d6-4d0d-94e0-b0b456a5ca4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.228058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b758f-84d6-4d0d-94e0-b0b456a5ca4e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.233717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 939/1861] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:14:29.237607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb53a83-7f91-4bf6-877e-71662ee1198d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.241906 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 923/1862] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:14:29.250015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b758f-84d6-4d0d-94e0-b0b456a5ca4e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.255091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb53a83-7f91-4bf6-877e-71662ee1198d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.261653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b758f-84d6-4d0d-94e0-b0b456a5ca4e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.267570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea8bdc-bf03-4550-b3e7-dd2327cec308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.268350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea8bdc-bf03-4550-b3e7-dd2327cec308 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.268720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea8bdc-bf03-4550-b3e7-dd2327cec308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.269283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea8bdc-bf03-4550-b3e7-dd2327cec308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.269988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea8bdc-bf03-4550-b3e7-dd2327cec308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.270186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05b4d4-7aef-49c9-9504-5c5a79cbe89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.270956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05b4d4-7aef-49c9-9504-5c5a79cbe89c admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.271407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05b4d4-7aef-49c9-9504-5c5a79cbe89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.271755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05b4d4-7aef-49c9-9504-5c5a79cbe89c admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.272392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea8bdc-bf03-4550-b3e7-dd2327cec308 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.272579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05b4d4-7aef-49c9-9504-5c5a79cbe89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.274343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:29.275041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05b4d4-7aef-49c9-9504-5c5a79cbe89c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.297803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 924/1863] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:29.300139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 940/1864] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:14:29.300954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05b4d4-7aef-49c9-9504-5c5a79cbe89c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.301445 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea8bdc-bf03-4550-b3e7-dd2327cec308 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.315770 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05b4d4-7aef-49c9-9504-5c5a79cbe89c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.319824 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea8bdc-bf03-4550-b3e7-dd2327cec308 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.322260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047c142-b847-44f5-95b5-b7b6b4529aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.323355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047c142-b847-44f5-95b5-b7b6b4529aab admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.323649 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047c142-b847-44f5-95b5-b7b6b4529aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.323928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047c142-b847-44f5-95b5-b7b6b4529aab admin admin] PATH_INFO: `/v3/projects/b016214ad494450b8cf2c4673bac987d/users/15bcd9f971634cebae306dcb7fdf7517/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.327712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe11b63-a700-4dc3-a318-4c1f48edfd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.329544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe11b63-a700-4dc3-a318-4c1f48edfd12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.330034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe11b63-a700-4dc3-a318-4c1f48edfd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.330479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe11b63-a700-4dc3-a318-4c1f48edfd12 admin admin] PATH_INFO: `/v3/projects/1078fd65113e4294ba830d465e8ea824/users/e94014fd00dc45adb0f43b30e5511f99/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.349312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047c142-b847-44f5-95b5-b7b6b4529aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b016214ad494450b8cf2c4673bac987d, user_id=15bcd9f971634cebae306dcb7fdf7517, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.353219 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047c142-b847-44f5-95b5-b7b6b4529aab admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.356204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe11b63-a700-4dc3-a318-4c1f48edfd12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1078fd65113e4294ba830d465e8ea824, user_id=e94014fd00dc45adb0f43b30e5511f99, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.360844 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe11b63-a700-4dc3-a318-4c1f48edfd12 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.365445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:29.374150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 925/1865] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:29 2022] PUT /identity/v3/projects/b016214ad494450b8cf2c4673bac987d/users/15bcd9f971634cebae306dcb7fdf7517/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:29.379363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf723-7f12-48ee-89f2-4aad9a3e9a39 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.379844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf723-7f12-48ee-89f2-4aad9a3e9a39 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.380658 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf723-7f12-48ee-89f2-4aad9a3e9a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.400920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 941/1866] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:29 2022] PUT /identity/v3/projects/1078fd65113e4294ba830d465e8ea824/users/e94014fd00dc45adb0f43b30e5511f99/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:29.400920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cc19-4b4d-4e76-8417-88cacdea55b0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.400920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cc19-4b4d-4e76-8417-88cacdea55b0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.400920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cc19-4b4d-4e76-8417-88cacdea55b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.412529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-caccf723-7f12-48ee-89f2-4aad9a3e9a39 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:29.413894 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-caccf723-7f12-48ee-89f2-4aad9a3e9a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:29.426338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-00a9cc19-4b4d-4e76-8417-88cacdea55b0 None None] MFA Rules not processed for user `e94014fd00dc45adb0f43b30e5511f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:29.428024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-00a9cc19-4b4d-4e76-8417-88cacdea55b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:29.482654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 926/1867] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:29.493044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccf723-7f12-48ee-89f2-4aad9a3e9a39 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.494585 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-caccf723-7f12-48ee-89f2-4aad9a3e9a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:29.513484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 942/1868] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:29.518174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9cc19-4b4d-4e76-8417-88cacdea55b0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.530566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9cc19-4b4d-4e76-8417-88cacdea55b0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.540415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ec6a8-4a79-41f6-8544-2b633f33bd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.541235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ec6a8-4a79-41f6-8544-2b633f33bd44 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.542484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ec6a8-4a79-41f6-8544-2b633f33bd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.542900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ec6a8-4a79-41f6-8544-2b633f33bd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.543719 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ec6a8-4a79-41f6-8544-2b633f33bd44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.546339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ec6a8-4a79-41f6-8544-2b633f33bd44 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.578949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccf723-7f12-48ee-89f2-4aad9a3e9a39 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.581878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 943/1869] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:29 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:14:29.587627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ec6a8-4a79-41f6-8544-2b633f33bd44 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.635960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e3cb6-402b-4a2c-b550-096746d4f5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.636713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e3cb6-402b-4a2c-b550-096746d4f5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.637098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e3cb6-402b-4a2c-b550-096746d4f5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.637382 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e3cb6-402b-4a2c-b550-096746d4f5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.656342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ec6a8-4a79-41f6-8544-2b633f33bd44 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.661169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306fb8e-63a1-47c7-ae88-db1308662237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.661805 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306fb8e-63a1-47c7-ae88-db1308662237 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.662198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306fb8e-63a1-47c7-ae88-db1308662237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.662484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306fb8e-63a1-47c7-ae88-db1308662237 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.663160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306fb8e-63a1-47c7-ae88-db1308662237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.665131 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306fb8e-63a1-47c7-ae88-db1308662237 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.693585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 944/1870] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:29 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:14:29.697588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306fb8e-63a1-47c7-ae88-db1308662237 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.708543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306fb8e-63a1-47c7-ae88-db1308662237 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.711380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e3cb6-402b-4a2c-b550-096746d4f5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.713054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e3cb6-402b-4a2c-b550-096746d4f5b5 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.715084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bfc17-5ceb-444c-8a3a-4643893a443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.715802 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bfc17-5ceb-444c-8a3a-4643893a443c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.716130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bfc17-5ceb-444c-8a3a-4643893a443c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.716609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bfc17-5ceb-444c-8a3a-4643893a443c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.717513 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bfc17-5ceb-444c-8a3a-4643893a443c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.719341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bfc17-5ceb-444c-8a3a-4643893a443c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.724988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 927/1871] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:14:29.733886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 945/1872] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:29.735050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e3cb6-402b-4a2c-b550-096746d4f5b5 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.741392 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:29.745855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e3cb6-402b-4a2c-b550-096746d4f5b5 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.752626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca313e-c820-4511-925a-cf9ed2143895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.753400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca313e-c820-4511-925a-cf9ed2143895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.753689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca313e-c820-4511-925a-cf9ed2143895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.753984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca313e-c820-4511-925a-cf9ed2143895 admin admin] PATH_INFO: `/v3/projects/568b6a4a01a54b33bf4d695f4325bea7/users/ffad0421e9e644e68da5b301814dc1f4/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.771126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca313e-c820-4511-925a-cf9ed2143895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=568b6a4a01a54b33bf4d695f4325bea7, user_id=ffad0421e9e644e68da5b301814dc1f4, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.773861 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca313e-c820-4511-925a-cf9ed2143895 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.790546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 928/1873] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:29 2022] PUT /identity/v3/projects/568b6a4a01a54b33bf4d695f4325bea7/users/ffad0421e9e644e68da5b301814dc1f4/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:14:29.794530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bfc17-5ceb-444c-8a3a-4643893a443c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.805125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bfc17-5ceb-444c-8a3a-4643893a443c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.820049 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:29.872871 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969d679-6da0-4b78-b1a6-8c6fa753663e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.873577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969d679-6da0-4b78-b1a6-8c6fa753663e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.873856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969d679-6da0-4b78-b1a6-8c6fa753663e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.874128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969d679-6da0-4b78-b1a6-8c6fa753663e admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.875201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969d679-6da0-4b78-b1a6-8c6fa753663e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.876943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969d679-6da0-4b78-b1a6-8c6fa753663e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.895729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca313e-c820-4511-925a-cf9ed2143895 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:29.897180 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 946/1874] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:29.909534 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca313e-c820-4511-925a-cf9ed2143895 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:29.915007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d624d2-b0ed-4d30-ad0a-aa4adaba2ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:29.915977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d624d2-b0ed-4d30-ad0a-aa4adaba2ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.916264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d624d2-b0ed-4d30-ad0a-aa4adaba2ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.916542 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d624d2-b0ed-4d30-ad0a-aa4adaba2ad7 admin admin] PATH_INFO: `/v3/projects/568b6a4a01a54b33bf4d695f4325bea7/users/ffad0421e9e644e68da5b301814dc1f4/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.918996 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d624d2-b0ed-4d30-ad0a-aa4adaba2ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=568b6a4a01a54b33bf4d695f4325bea7, user_id=ffad0421e9e644e68da5b301814dc1f4, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:29.922082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d624d2-b0ed-4d30-ad0a-aa4adaba2ad7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:29.934346 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 929/1875] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:29 2022] PUT /identity/v3/projects/568b6a4a01a54b33bf4d695f4325bea7/users/ffad0421e9e644e68da5b301814dc1f4/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:29.945019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c876e-f74f-412c-998b-9e31e9494d2a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:29.945341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c876e-f74f-412c-998b-9e31e9494d2a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:29.945620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c876e-f74f-412c-998b-9e31e9494d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:29.979349 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e12c876e-f74f-412c-998b-9e31e9494d2a None None] MFA Rules not processed for user `ffad0421e9e644e68da5b301814dc1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:29.980725 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e12c876e-f74f-412c-998b-9e31e9494d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:30.058725 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 947/1876] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:30.078717 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d624d2-b0ed-4d30-ad0a-aa4adaba2ad7 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:30.080630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c5d624d2-b0ed-4d30-ad0a-aa4adaba2ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:30.158980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d624d2-b0ed-4d30-ad0a-aa4adaba2ad7 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:30.162833 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d607-4d08-48a7-83b1-7a348fc77512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:30.165198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d607-4d08-48a7-83b1-7a348fc77512 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:30.165198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d607-4d08-48a7-83b1-7a348fc77512 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:30.165198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d607-4d08-48a7-83b1-7a348fc77512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:30.179233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110d607-4d08-48a7-83b1-7a348fc77512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:30.181085 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110d607-4d08-48a7-83b1-7a348fc77512 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:30.200806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 930/1877] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:30.366123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c876e-f74f-412c-998b-9e31e9494d2a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:30.542204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d607-4d08-48a7-83b1-7a348fc77512 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:30.544340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9110d607-4d08-48a7-83b1-7a348fc77512 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:30.565510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c876e-f74f-412c-998b-9e31e9494d2a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:30.568147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d607-4d08-48a7-83b1-7a348fc77512 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:30.575836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990b6d8-e494-449f-b9a0-dca93106ffa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:30.576561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990b6d8-e494-449f-b9a0-dca93106ffa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:30.576787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b89258-3bc8-4091-9bca-a8314cae38f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:30.576939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990b6d8-e494-449f-b9a0-dca93106ffa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:30.577751 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b89258-3bc8-4091-9bca-a8314cae38f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:30.579000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b89258-3bc8-4091-9bca-a8314cae38f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:30.579360 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990b6d8-e494-449f-b9a0-dca93106ffa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:30.580756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b89258-3bc8-4091-9bca-a8314cae38f7 admin admin] PATH_INFO: `/v3/users/e94014fd00dc45adb0f43b30e5511f99` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:30.585189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b89258-3bc8-4091-9bca-a8314cae38f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94014fd00dc45adb0f43b30e5511f99)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:30.594686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8990b6d8-e494-449f-b9a0-dca93106ffa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:30.594900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b89258-3bc8-4091-9bca-a8314cae38f7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:30.743402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:30.763963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-42b89258-3bc8-4091-9bca-a8314cae38f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94014fd00dc45adb0f43b30e5511f99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:30.766272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-42b89258-3bc8-4091-9bca-a8314cae38f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94014fd00dc45adb0f43b30e5511f99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:30.798724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-42b89258-3bc8-4091-9bca-a8314cae38f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94014fd00dc45adb0f43b30e5511f99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:30.799437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-42b89258-3bc8-4091-9bca-a8314cae38f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94014fd00dc45adb0f43b30e5511f99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:30.827223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-42b89258-3bc8-4091-9bca-a8314cae38f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94014fd00dc45adb0f43b30e5511f99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:30.837418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990b6d8-e494-449f-b9a0-dca93106ffa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:30.839350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990b6d8-e494-449f-b9a0-dca93106ffa7 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:30.841258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 948/1878] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:30 2022] DELETE /identity/v3/users/e94014fd00dc45adb0f43b30e5511f99 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:30.845857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071427f3-9816-4543-a2d2-be8152bec3c1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:30.846502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071427f3-9816-4543-a2d2-be8152bec3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:30.847131 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071427f3-9816-4543-a2d2-be8152bec3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:30.852084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 931/1879] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:14:30.905722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-071427f3-9816-4543-a2d2-be8152bec3c1 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:30.907234 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-071427f3-9816-4543-a2d2-be8152bec3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:30.976730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d12d4-73b3-4cb7-8edd-d95fde0221d0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:30.977951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d12d4-73b3-4cb7-8edd-d95fde0221d0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:30.978379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d12d4-73b3-4cb7-8edd-d95fde0221d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:31.091865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 949/1880] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:14:31.100609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071427f3-9816-4543-a2d2-be8152bec3c1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:31.103169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-071427f3-9816-4543-a2d2-be8152bec3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:31.112767 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c65d12d4-73b3-4cb7-8edd-d95fde0221d0 None None] MFA Rules not processed for user `15bcd9f971634cebae306dcb7fdf7517`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:31.121468 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c65d12d4-73b3-4cb7-8edd-d95fde0221d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:31.269796 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071427f3-9816-4543-a2d2-be8152bec3c1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:31.273861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca421646-a190-4343-856c-32ce68f9f157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:31.274520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421646-a190-4343-856c-32ce68f9f157 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:31.274802 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421646-a190-4343-856c-32ce68f9f157 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:31.275089 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca421646-a190-4343-856c-32ce68f9f157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:31.292704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca421646-a190-4343-856c-32ce68f9f157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:31.294781 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca421646-a190-4343-856c-32ce68f9f157 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:31.316506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:31.317502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 950/1881] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:14:31.336943 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 932/1882] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:31.341210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca421646-a190-4343-856c-32ce68f9f157 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:31.344118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ca421646-a190-4343-856c-32ce68f9f157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:31.362652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca421646-a190-4343-856c-32ce68f9f157 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:31.368744 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577baf72-c49f-46dc-bed4-af09587691ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:31.369978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577baf72-c49f-46dc-bed4-af09587691ec admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:31.370258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577baf72-c49f-46dc-bed4-af09587691ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:31.370529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577baf72-c49f-46dc-bed4-af09587691ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:31.371250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577baf72-c49f-46dc-bed4-af09587691ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:31.373523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577baf72-c49f-46dc-bed4-af09587691ec admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:31.421436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 951/1883] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:31 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:31.421700 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d12d4-73b3-4cb7-8edd-d95fde0221d0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:31.445312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d12d4-73b3-4cb7-8edd-d95fde0221d0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:31.547330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37589d-6d82-40b8-8348-2ee1220bf27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:31.548461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37589d-6d82-40b8-8348-2ee1220bf27b admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:31.548682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37589d-6d82-40b8-8348-2ee1220bf27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:31.549282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37589d-6d82-40b8-8348-2ee1220bf27b admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:31.550479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37589d-6d82-40b8-8348-2ee1220bf27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:31.554677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37589d-6d82-40b8-8348-2ee1220bf27b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:31.598934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 933/1884] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:31 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:31.602867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577baf72-c49f-46dc-bed4-af09587691ec admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:31.622526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577baf72-c49f-46dc-bed4-af09587691ec admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:31.635934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b8fd6-42b7-478e-89a7-1ec9f2a5a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:31.636754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b8fd6-42b7-478e-89a7-1ec9f2a5a8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:31.637078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b8fd6-42b7-478e-89a7-1ec9f2a5a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:31.637354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b8fd6-42b7-478e-89a7-1ec9f2a5a8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:31.638073 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b8fd6-42b7-478e-89a7-1ec9f2a5a8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:31.640033 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b8fd6-42b7-478e-89a7-1ec9f2a5a8a5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:31.667306 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 952/1885] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:31.671660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37589d-6d82-40b8-8348-2ee1220bf27b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:31.691512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37589d-6d82-40b8-8348-2ee1220bf27b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:31.702054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326b6e-0fe5-4f38-95ca-268316c9ac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:31.703256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326b6e-0fe5-4f38-95ca-268316c9ac50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:31.703256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326b6e-0fe5-4f38-95ca-268316c9ac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:31.703984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326b6e-0fe5-4f38-95ca-268316c9ac50 admin admin] PATH_INFO: `/v3/projects/01d5fdd9054a44b28957ba69c41a9839/users/7be8308727f9430b88576ecf4d4fe4ad/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:31.725752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8326b6e-0fe5-4f38-95ca-268316c9ac50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d5fdd9054a44b28957ba69c41a9839, user_id=7be8308727f9430b88576ecf4d4fe4ad, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:31.730571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8326b6e-0fe5-4f38-95ca-268316c9ac50 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:31.780360 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 934/1886] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:31 2022] PUT /identity/v3/projects/01d5fdd9054a44b28957ba69c41a9839/users/7be8308727f9430b88576ecf4d4fe4ad/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:31.784423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b8fd6-42b7-478e-89a7-1ec9f2a5a8a5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:31.801945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b8fd6-42b7-478e-89a7-1ec9f2a5a8a5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:31.861951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:31.956951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8509b-4a9f-4794-a1e1-fe4d3d2f60cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:31.961087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8509b-4a9f-4794-a1e1-fe4d3d2f60cb admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:31.961087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8509b-4a9f-4794-a1e1-fe4d3d2f60cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:31.961087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8509b-4a9f-4794-a1e1-fe4d3d2f60cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:31.961087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8509b-4a9f-4794-a1e1-fe4d3d2f60cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:31.961087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8509b-4a9f-4794-a1e1-fe4d3d2f60cb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:31.978940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 953/1887] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:31.982231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326b6e-0fe5-4f38-95ca-268316c9ac50 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:32.005524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326b6e-0fe5-4f38-95ca-268316c9ac50 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:32.020627 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc6b50-2f41-4a2e-8809-dfaa41c60894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:32.021458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc6b50-2f41-4a2e-8809-dfaa41c60894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:32.022551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc6b50-2f41-4a2e-8809-dfaa41c60894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:32.022955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc6b50-2f41-4a2e-8809-dfaa41c60894 admin admin] PATH_INFO: `/v3/projects/01d5fdd9054a44b28957ba69c41a9839/users/7be8308727f9430b88576ecf4d4fe4ad/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:32.025368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc6b50-2f41-4a2e-8809-dfaa41c60894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d5fdd9054a44b28957ba69c41a9839, user_id=7be8308727f9430b88576ecf4d4fe4ad, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:32.029368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc6b50-2f41-4a2e-8809-dfaa41c60894 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:32.045000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 935/1888] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:31 2022] PUT /identity/v3/projects/01d5fdd9054a44b28957ba69c41a9839/users/7be8308727f9430b88576ecf4d4fe4ad/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:32.067232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8509b-4a9f-4794-a1e1-fe4d3d2f60cb admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:32.069058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-40d8509b-4a9f-4794-a1e1-fe4d3d2f60cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:32.092215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8509b-4a9f-4794-a1e1-fe4d3d2f60cb admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:32.214042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad9f9b-7197-4030-b43b-fabef27e0ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:32.214844 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad9f9b-7197-4030-b43b-fabef27e0ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:32.215183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad9f9b-7197-4030-b43b-fabef27e0ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:32.215599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad9f9b-7197-4030-b43b-fabef27e0ab5 admin admin] PATH_INFO: `/v3/projects/1078fd65113e4294ba830d465e8ea824` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:32.217537 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad9f9b-7197-4030-b43b-fabef27e0ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1078fd65113e4294ba830d465e8ea824)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:32.219718 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad9f9b-7197-4030-b43b-fabef27e0ab5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:32.369618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-18ad9f9b-7197-4030-b43b-fabef27e0ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1078fd65113e4294ba830d465e8ea824', 'request_id': 'req-18ad9f9b-7197-4030-b43b-fabef27e0ab5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:32.384041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-18ad9f9b-7197-4030-b43b-fabef27e0ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1078fd65113e4294ba830d465e8ea824', 'request_id': 'req-18ad9f9b-7197-4030-b43b-fabef27e0ab5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:32.396534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-18ad9f9b-7197-4030-b43b-fabef27e0ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1078fd65113e4294ba830d465e8ea824', 'request_id': 'req-18ad9f9b-7197-4030-b43b-fabef27e0ab5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:32.420914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-18ad9f9b-7197-4030-b43b-fabef27e0ab5 admin admin] The token cache is being invalidate because project 1078fd65113e4294ba830d465e8ea824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:32.420914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-18ad9f9b-7197-4030-b43b-fabef27e0ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:32.422044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-18ad9f9b-7197-4030-b43b-fabef27e0ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:32.426436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 954/1889] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:32 2022] DELETE /identity/v3/projects/1078fd65113e4294ba830d465e8ea824 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:32.434214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc6b50-2f41-4a2e-8809-dfaa41c60894 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:32.449337 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f7fc6b50-2f41-4a2e-8809-dfaa41c60894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:32.508577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc6b50-2f41-4a2e-8809-dfaa41c60894 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:32.722636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:32.723675 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:32.726481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:32.727431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] PATH_INFO: `/v3/users/ffad0421e9e644e68da5b301814dc1f4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:32.730020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffad0421e9e644e68da5b301814dc1f4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:32.735209 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:32.825515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffad0421e9e644e68da5b301814dc1f4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:32.826958 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:32.834349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffad0421e9e644e68da5b301814dc1f4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:32.844137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffad0421e9e644e68da5b301814dc1f4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:32.844789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffad0421e9e644e68da5b301814dc1f4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:32.861792 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffad0421e9e644e68da5b301814dc1f4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:32.880048 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 936/1890] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:32 2022] DELETE /identity/v3/users/ffad0421e9e644e68da5b301814dc1f4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:14:33.158489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b93a0d-d5ae-4107-99db-73f5c3e0a3ad None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:33.159005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b93a0d-d5ae-4107-99db-73f5c3e0a3ad None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:33.159100 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b93a0d-d5ae-4107-99db-73f5c3e0a3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:33.202804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-18b93a0d-d5ae-4107-99db-73f5c3e0a3ad None None] MFA Rules not processed for user `7be8308727f9430b88576ecf4d4fe4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:33.205201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-18b93a0d-d5ae-4107-99db-73f5c3e0a3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:33.285882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:33.324429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 955/1891] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:33.338350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:33.340314 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:33.358409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b93a0d-d5ae-4107-99db-73f5c3e0a3ad None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:33.360394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-18b93a0d-d5ae-4107-99db-73f5c3e0a3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:33.432339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b3b33-b7a0-44d0-bc91-397b65354fde admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:33.437240 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011b620-7647-4d7d-97ea-fef1c99c2fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:33.437909 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011b620-7647-4d7d-97ea-fef1c99c2fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:33.438192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011b620-7647-4d7d-97ea-fef1c99c2fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:33.438468 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011b620-7647-4d7d-97ea-fef1c99c2fa6 admin admin] PATH_INFO: `/v3/projects/568b6a4a01a54b33bf4d695f4325bea7` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:33.439852 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011b620-7647-4d7d-97ea-fef1c99c2fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=568b6a4a01a54b33bf4d695f4325bea7)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:33.441817 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011b620-7647-4d7d-97ea-fef1c99c2fa6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:33.444097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b93a0d-d5ae-4107-99db-73f5c3e0a3ad None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:33.448525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448aff75-3e22-4b6b-9fc7-21afd7f2db52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:33.449193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aff75-3e22-4b6b-9fc7-21afd7f2db52 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:33.449469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aff75-3e22-4b6b-9fc7-21afd7f2db52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:33.449738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aff75-3e22-4b6b-9fc7-21afd7f2db52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:33.453385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-448aff75-3e22-4b6b-9fc7-21afd7f2db52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:33.499751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c011b620-7647-4d7d-97ea-fef1c99c2fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568b6a4a01a54b33bf4d695f4325bea7', 'request_id': 'req-c011b620-7647-4d7d-97ea-fef1c99c2fa6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:33.509912 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c011b620-7647-4d7d-97ea-fef1c99c2fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568b6a4a01a54b33bf4d695f4325bea7', 'request_id': 'req-c011b620-7647-4d7d-97ea-fef1c99c2fa6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:33.528372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448aff75-3e22-4b6b-9fc7-21afd7f2db52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:33.531003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c011b620-7647-4d7d-97ea-fef1c99c2fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568b6a4a01a54b33bf4d695f4325bea7', 'request_id': 'req-c011b620-7647-4d7d-97ea-fef1c99c2fa6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:33.532314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448aff75-3e22-4b6b-9fc7-21afd7f2db52 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:33.543562 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c011b620-7647-4d7d-97ea-fef1c99c2fa6 admin admin] The token cache is being invalidate because project 568b6a4a01a54b33bf4d695f4325bea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:33.543880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c011b620-7647-4d7d-97ea-fef1c99c2fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:33.544495 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c011b620-7647-4d7d-97ea-fef1c99c2fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:33.546090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 956/1892] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:33.546498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 937/1893] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:33 2022] DELETE /identity/v3/projects/568b6a4a01a54b33bf4d695f4325bea7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:33.551609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a30336-4c27-4b95-96a8-73f7a82e7560 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:33.551897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a30336-4c27-4b95-96a8-73f7a82e7560 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:33.552173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a30336-4c27-4b95-96a8-73f7a82e7560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:33.583865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-31a30336-4c27-4b95-96a8-73f7a82e7560 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:33.585134 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-31a30336-4c27-4b95-96a8-73f7a82e7560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:33.672275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 957/1894] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:14:33.680764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f99ad-6555-4666-9ab8-430bda8ffcef None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:33.681483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f99ad-6555-4666-9ab8-430bda8ffcef None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:33.681971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f99ad-6555-4666-9ab8-430bda8ffcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:33.736406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9d1f99ad-6555-4666-9ab8-430bda8ffcef None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:33.739749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9d1f99ad-6555-4666-9ab8-430bda8ffcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:33.750150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 938/1895] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:33.754894 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a30336-4c27-4b95-96a8-73f7a82e7560 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:33.774321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a30336-4c27-4b95-96a8-73f7a82e7560 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:33.784951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cae96-ba1a-4299-a75c-e50f6f32f691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:33.786564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cae96-ba1a-4299-a75c-e50f6f32f691 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:33.786876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cae96-ba1a-4299-a75c-e50f6f32f691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:33.787138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cae96-ba1a-4299-a75c-e50f6f32f691 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:33.790076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cae96-ba1a-4299-a75c-e50f6f32f691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:14:33.790440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cae96-ba1a-4299-a75c-e50f6f32f691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:33.793391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cae96-ba1a-4299-a75c-e50f6f32f691 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:33.823187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 958/1896] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:14:33.827652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f99ad-6555-4666-9ab8-430bda8ffcef None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:33.847441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f99ad-6555-4666-9ab8-430bda8ffcef None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:33.860458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29079b-7dcb-446c-859e-b0eb46dce5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:33.862094 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29079b-7dcb-446c-859e-b0eb46dce5ae admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:33.862654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29079b-7dcb-446c-859e-b0eb46dce5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:33.862940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29079b-7dcb-446c-859e-b0eb46dce5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:33.863962 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29079b-7dcb-446c-859e-b0eb46dce5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:33.867708 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29079b-7dcb-446c-859e-b0eb46dce5ae admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:33.915765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 939/1897] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:33 2022] POST /identity/v3/projects => generated 407 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:33.928968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cae96-ba1a-4299-a75c-e50f6f32f691 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:33.941273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cae96-ba1a-4299-a75c-e50f6f32f691 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:34.020705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:34.095193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334f69d-7263-47ae-8e20-a2827b37c169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:34.096225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334f69d-7263-47ae-8e20-a2827b37c169 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:34.096570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334f69d-7263-47ae-8e20-a2827b37c169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:34.096922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334f69d-7263-47ae-8e20-a2827b37c169 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:34.097665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334f69d-7263-47ae-8e20-a2827b37c169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:34.100677 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334f69d-7263-47ae-8e20-a2827b37c169 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:34.132488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 959/1898] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:33 2022] POST /identity/v3/users => generated 304 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:34.137880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29079b-7dcb-446c-859e-b0eb46dce5ae admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:34.156227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29079b-7dcb-446c-859e-b0eb46dce5ae admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:34.169826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0fdf5-0302-41c6-aec9-491b8f8f4e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:34.170608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0fdf5-0302-41c6-aec9-491b8f8f4e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:34.170788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0fdf5-0302-41c6-aec9-491b8f8f4e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:34.171035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0fdf5-0302-41c6-aec9-491b8f8f4e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:34.171782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0fdf5-0302-41c6-aec9-491b8f8f4e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:34.173417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0fdf5-0302-41c6-aec9-491b8f8f4e05 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:34.190829 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 940/1899] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:34.194862 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334f69d-7263-47ae-8e20-a2827b37c169 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:34.207674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334f69d-7263-47ae-8e20-a2827b37c169 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:34.213897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bab70-12c3-45e5-b7b0-8656b8f4736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:34.214796 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bab70-12c3-45e5-b7b0-8656b8f4736d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:34.215072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bab70-12c3-45e5-b7b0-8656b8f4736d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:34.215341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bab70-12c3-45e5-b7b0-8656b8f4736d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:34.216059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bab70-12c3-45e5-b7b0-8656b8f4736d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:34.217805 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bab70-12c3-45e5-b7b0-8656b8f4736d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:34.253139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 960/1900] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:34.257584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0fdf5-0302-41c6-aec9-491b8f8f4e05 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:34.268300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0fdf5-0302-41c6-aec9-491b8f8f4e05 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:34.289690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76663135-8f82-4f14-af6b-8b5ad3f4abeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:34.290823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76663135-8f82-4f14-af6b-8b5ad3f4abeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:34.291509 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76663135-8f82-4f14-af6b-8b5ad3f4abeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:34.291997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76663135-8f82-4f14-af6b-8b5ad3f4abeb admin admin] PATH_INFO: `/v3/projects/1d1236df4c1c40269bb13fc321e1c08f/users/9c469a940aae4cf78e0aedd7f719d61b/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:34.310805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:34.322771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76663135-8f82-4f14-af6b-8b5ad3f4abeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1236df4c1c40269bb13fc321e1c08f, user_id=9c469a940aae4cf78e0aedd7f719d61b, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:34.325931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76663135-8f82-4f14-af6b-8b5ad3f4abeb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:34.347964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 941/1901] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:34 2022] PUT /identity/v3/projects/1d1236df4c1c40269bb13fc321e1c08f/users/9c469a940aae4cf78e0aedd7f719d61b/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:14:34.362660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc86fa-adab-4a65-9f86-bd70521a4a10 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:34.363016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc86fa-adab-4a65-9f86-bd70521a4a10 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:34.363286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc86fa-adab-4a65-9f86-bd70521a4a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:34.404330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-09dc86fa-adab-4a65-9f86-bd70521a4a10 None None] MFA Rules not processed for user `9c469a940aae4cf78e0aedd7f719d61b`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:34.405769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-09dc86fa-adab-4a65-9f86-bd70521a4a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:34.474304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 961/1902] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:34 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:34.481789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76663135-8f82-4f14-af6b-8b5ad3f4abeb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:34.546450 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76663135-8f82-4f14-af6b-8b5ad3f4abeb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:34.551615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de3a7b-2027-479a-9eda-d505c5909c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:34.552251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de3a7b-2027-479a-9eda-d505c5909c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:34.552536 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de3a7b-2027-479a-9eda-d505c5909c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:34.552818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de3a7b-2027-479a-9eda-d505c5909c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:34.553603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de3a7b-2027-479a-9eda-d505c5909c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:34.555531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de3a7b-2027-479a-9eda-d505c5909c09 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:34.587380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 942/1903] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:34 2022] POST /identity/v3/projects => generated 409 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:34.592957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc86fa-adab-4a65-9f86-bd70521a4a10 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:34.607449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc86fa-adab-4a65-9f86-bd70521a4a10 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:34.668726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7364f-e603-470a-a340-e33b8f237597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:34.669400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7364f-e603-470a-a340-e33b8f237597 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:34.669843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7364f-e603-470a-a340-e33b8f237597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:34.670133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7364f-e603-470a-a340-e33b8f237597 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:34.670908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7364f-e603-470a-a340-e33b8f237597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:34.673648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7364f-e603-470a-a340-e33b8f237597 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:34.706019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 962/1904] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:34 2022] POST /identity/v3/users => generated 311 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:14:34.710665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de3a7b-2027-479a-9eda-d505c5909c09 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:34.731092 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de3a7b-2027-479a-9eda-d505c5909c09 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:34.738866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9225f-01c1-4df2-8ff4-68931f95980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:34.739522 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9225f-01c1-4df2-8ff4-68931f95980e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:34.739868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9225f-01c1-4df2-8ff4-68931f95980e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:34.740145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9225f-01c1-4df2-8ff4-68931f95980e admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:34.741570 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9225f-01c1-4df2-8ff4-68931f95980e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:34.743558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9225f-01c1-4df2-8ff4-68931f95980e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:34.756332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 943/1905] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:34.760732 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7364f-e603-470a-a340-e33b8f237597 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:34.771196 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7364f-e603-470a-a340-e33b8f237597 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:34.775891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ed23-f0cf-4f82-9d0c-716fb9fd048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:34.776604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ed23-f0cf-4f82-9d0c-716fb9fd048b admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:34.776854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ed23-f0cf-4f82-9d0c-716fb9fd048b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:34.777155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4ed23-f0cf-4f82-9d0c-716fb9fd048b admin admin] PATH_INFO: `/v3/projects/f58b815f1e7f4ad99af2a7e0952414d4/users/4714d80b7ce34e998f6380fe0698ad57/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:34.793121 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4ed23-f0cf-4f82-9d0c-716fb9fd048b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58b815f1e7f4ad99af2a7e0952414d4, user_id=4714d80b7ce34e998f6380fe0698ad57, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:34.795899 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4ed23-f0cf-4f82-9d0c-716fb9fd048b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:34.799243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:34.813187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 963/1906] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:34 2022] PUT /identity/v3/projects/f58b815f1e7f4ad99af2a7e0952414d4/users/4714d80b7ce34e998f6380fe0698ad57/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:34.817561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9225f-01c1-4df2-8ff4-68931f95980e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:34.829353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9225f-01c1-4df2-8ff4-68931f95980e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:34.897687 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5acd9-41da-46ec-b5c4-56157b952868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:34.898383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5acd9-41da-46ec-b5c4-56157b952868 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:34.898610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5acd9-41da-46ec-b5c4-56157b952868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:34.898888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5acd9-41da-46ec-b5c4-56157b952868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:34.899657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5acd9-41da-46ec-b5c4-56157b952868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:34.901345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5acd9-41da-46ec-b5c4-56157b952868 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:34.912963 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 944/1907] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:34.917632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ed23-f0cf-4f82-9d0c-716fb9fd048b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:34.928032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4ed23-f0cf-4f82-9d0c-716fb9fd048b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:34.932816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0293d-4489-4c56-9b20-04a5a17cbca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:34.933523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0293d-4489-4c56-9b20-04a5a17cbca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:34.933811 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0293d-4489-4c56-9b20-04a5a17cbca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:34.934072 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0293d-4489-4c56-9b20-04a5a17cbca1 admin admin] PATH_INFO: `/v3/projects/f58b815f1e7f4ad99af2a7e0952414d4/users/4714d80b7ce34e998f6380fe0698ad57/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:34.941248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0293d-4489-4c56-9b20-04a5a17cbca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58b815f1e7f4ad99af2a7e0952414d4, user_id=4714d80b7ce34e998f6380fe0698ad57, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:34.941248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0293d-4489-4c56-9b20-04a5a17cbca1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:34.950683 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 964/1908] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:34 2022] PUT /identity/v3/projects/f58b815f1e7f4ad99af2a7e0952414d4/users/4714d80b7ce34e998f6380fe0698ad57/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:34.961453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933da91e-11c5-4268-b53c-5b08fd57c12b None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:34.961787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933da91e-11c5-4268-b53c-5b08fd57c12b None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:34.962146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933da91e-11c5-4268-b53c-5b08fd57c12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:34.997032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-933da91e-11c5-4268-b53c-5b08fd57c12b None None] MFA Rules not processed for user `4714d80b7ce34e998f6380fe0698ad57`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:34.998321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-933da91e-11c5-4268-b53c-5b08fd57c12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:35.055478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:35.082991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 945/1909] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:34 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:35.094449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0293d-4489-4c56-9b20-04a5a17cbca1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:35.096368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-11e0293d-4489-4c56-9b20-04a5a17cbca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:35.162103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0293d-4489-4c56-9b20-04a5a17cbca1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:35.165835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46e4fd-34ce-416e-9b0f-aacd679dd198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:35.166489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46e4fd-34ce-416e-9b0f-aacd679dd198 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:35.166762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46e4fd-34ce-416e-9b0f-aacd679dd198 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:35.167040 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46e4fd-34ce-416e-9b0f-aacd679dd198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:35.176998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46e4fd-34ce-416e-9b0f-aacd679dd198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:35.178495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46e4fd-34ce-416e-9b0f-aacd679dd198 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:35.189479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 965/1910] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:35 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:35.387042 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933da91e-11c5-4268-b53c-5b08fd57c12b None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:35.397557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933da91e-11c5-4268-b53c-5b08fd57c12b None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:35.401390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f3c95-be66-4ddc-b5a3-8ff85b744869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:35.402019 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f3c95-be66-4ddc-b5a3-8ff85b744869 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:35.402298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f3c95-be66-4ddc-b5a3-8ff85b744869 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:35.402571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f3c95-be66-4ddc-b5a3-8ff85b744869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:35.463593 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f3c95-be66-4ddc-b5a3-8ff85b744869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:35.465127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f3c95-be66-4ddc-b5a3-8ff85b744869 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:35.474816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 946/1911] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:35 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:38.271899 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46e4fd-34ce-416e-9b0f-aacd679dd198 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:38.273457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9d46e4fd-34ce-416e-9b0f-aacd679dd198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:38.289912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46e4fd-34ce-416e-9b0f-aacd679dd198 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:38.294027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47892ebc-6acd-4c08-94b0-c5b564959354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:38.295113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47892ebc-6acd-4c08-94b0-c5b564959354 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:38.295786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47892ebc-6acd-4c08-94b0-c5b564959354 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:38.295786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47892ebc-6acd-4c08-94b0-c5b564959354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:38.301214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-47892ebc-6acd-4c08-94b0-c5b564959354 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:38.405117 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47892ebc-6acd-4c08-94b0-c5b564959354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:38.406568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47892ebc-6acd-4c08-94b0-c5b564959354 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:38.416307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 966/1912] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:45.470334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=34 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:48.411905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=63,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:53.383578 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b43f6-494a-47a9-846a-e881b19dff81 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:53.384635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b43f6-494a-47a9-846a-e881b19dff81 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:53.385353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b43f6-494a-47a9-846a-e881b19dff81 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:53.388119 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 947/1913] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:14:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:14:53.404063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab225fd-2aa1-4793-95b6-cc8e672a7061 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:53.404524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab225fd-2aa1-4793-95b6-cc8e672a7061 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:53.404812 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab225fd-2aa1-4793-95b6-cc8e672a7061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:53.444402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-aab225fd-2aa1-4793-95b6-cc8e672a7061 None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:53.445880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-aab225fd-2aa1-4793-95b6-cc8e672a7061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:53.551495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 967/1914] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:14:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:53.574314 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b43f6-494a-47a9-846a-e881b19dff81 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:53.578137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-831b43f6-494a-47a9-846a-e881b19dff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:53.615382 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b43f6-494a-47a9-846a-e881b19dff81 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:53.623663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684ecd9-0736-4672-b0e0-ec17df0cedb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:53.624648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684ecd9-0736-4672-b0e0-ec17df0cedb9 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:53.625099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684ecd9-0736-4672-b0e0-ec17df0cedb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:53.625514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684ecd9-0736-4672-b0e0-ec17df0cedb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:53.640325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684ecd9-0736-4672-b0e0-ec17df0cedb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:53.642694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684ecd9-0736-4672-b0e0-ec17df0cedb9 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:53.659651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 948/1915] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:53.802971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab225fd-2aa1-4793-95b6-cc8e672a7061 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:53.890827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab225fd-2aa1-4793-95b6-cc8e672a7061 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:53.896175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:53.896851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:53.897160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:53.897443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] PATH_INFO: `/v3/users/9c469a940aae4cf78e0aedd7f719d61b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:53.899138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c469a940aae4cf78e0aedd7f719d61b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:53.901118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:53.982611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c469a940aae4cf78e0aedd7f719d61b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:53.983374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c469a940aae4cf78e0aedd7f719d61b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:53.993325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c469a940aae4cf78e0aedd7f719d61b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:53.994162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c469a940aae4cf78e0aedd7f719d61b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:54.011556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c469a940aae4cf78e0aedd7f719d61b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:54.029023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 968/1916] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:53 2022] DELETE /identity/v3/users/9c469a940aae4cf78e0aedd7f719d61b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:54.033064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53621bc-9dd9-464c-8acf-90ae8de215d6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:54.033653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53621bc-9dd9-464c-8acf-90ae8de215d6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:54.033769 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53621bc-9dd9-464c-8acf-90ae8de215d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:54.054626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d53621bc-9dd9-464c-8acf-90ae8de215d6 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:54.055830 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d53621bc-9dd9-464c-8acf-90ae8de215d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:54.124155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 949/1917] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:14:54.134528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:54.136864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:54.152273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:54.204687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05100f3-2ff3-4acf-92f2-375c5f7016e8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:54.208757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376e717-d52e-4130-90d1-4439834f0da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:54.209411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376e717-d52e-4130-90d1-4439834f0da1 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:54.209685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376e717-d52e-4130-90d1-4439834f0da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:54.209959 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376e717-d52e-4130-90d1-4439834f0da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:54.224635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376e717-d52e-4130-90d1-4439834f0da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:54.226587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376e717-d52e-4130-90d1-4439834f0da1 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:54.237336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 969/1918] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:54.756449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53621bc-9dd9-464c-8acf-90ae8de215d6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:54.758253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d53621bc-9dd9-464c-8acf-90ae8de215d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:54.771591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53621bc-9dd9-464c-8acf-90ae8de215d6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:54.777917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:54.778619 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:54.779162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:54.779443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] PATH_INFO: `/v3/projects/1d1236df4c1c40269bb13fc321e1c08f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:54.780804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1236df4c1c40269bb13fc321e1c08f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:54.782915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:54.851638 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1236df4c1c40269bb13fc321e1c08f', 'request_id': 'req-0fb77048-d9a0-4882-9eb4-3105187644d8'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:54.861133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1236df4c1c40269bb13fc321e1c08f', 'request_id': 'req-0fb77048-d9a0-4882-9eb4-3105187644d8'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:54.868785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1236df4c1c40269bb13fc321e1c08f', 'request_id': 'req-0fb77048-d9a0-4882-9eb4-3105187644d8'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:54.887575 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] The token cache is being invalidate because project 1d1236df4c1c40269bb13fc321e1c08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:54.888010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:54.888809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:54.890812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 950/1919] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:54 2022] DELETE /identity/v3/projects/1d1236df4c1c40269bb13fc321e1c08f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:54.894660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376e717-d52e-4130-90d1-4439834f0da1 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:54.906884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376e717-d52e-4130-90d1-4439834f0da1 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:54.973230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7d167-fc22-4796-a185-41eec0dc7082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:54.973883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7d167-fc22-4796-a185-41eec0dc7082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:54.974183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7d167-fc22-4796-a185-41eec0dc7082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:54.974465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7d167-fc22-4796-a185-41eec0dc7082 admin admin] PATH_INFO: `/v3/users/4714d80b7ce34e998f6380fe0698ad57` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:54.976290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7d167-fc22-4796-a185-41eec0dc7082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4714d80b7ce34e998f6380fe0698ad57)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:54.977619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7d167-fc22-4796-a185-41eec0dc7082 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:55.033928 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1db7d167-fc22-4796-a185-41eec0dc7082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4714d80b7ce34e998f6380fe0698ad57'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:55.034632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1db7d167-fc22-4796-a185-41eec0dc7082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4714d80b7ce34e998f6380fe0698ad57'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:55.044551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1db7d167-fc22-4796-a185-41eec0dc7082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4714d80b7ce34e998f6380fe0698ad57'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:55.045398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1db7d167-fc22-4796-a185-41eec0dc7082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4714d80b7ce34e998f6380fe0698ad57'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:55.061648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1db7d167-fc22-4796-a185-41eec0dc7082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4714d80b7ce34e998f6380fe0698ad57'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:55.075512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 970/1920] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:54 2022] DELETE /identity/v3/users/4714d80b7ce34e998f6380fe0698ad57 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:14:55.389054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:55.390524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:55.408540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb77048-d9a0-4882-9eb4-3105187644d8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:55.470659 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:55.471216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:55.471497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:55.471776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd admin admin] PATH_INFO: `/v3/projects/f58b815f1e7f4ad99af2a7e0952414d4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:55.472994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58b815f1e7f4ad99af2a7e0952414d4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:55.474935 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:55.487783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:55.530243 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58b815f1e7f4ad99af2a7e0952414d4', 'request_id': 'req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:55.538182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58b815f1e7f4ad99af2a7e0952414d4', 'request_id': 'req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:55.543906 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58b815f1e7f4ad99af2a7e0952414d4', 'request_id': 'req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:55.555780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd admin admin] The token cache is being invalidate because project f58b815f1e7f4ad99af2a7e0952414d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:55.556009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:55.556771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4facb4ba-bf9e-4ae6-b7cc-b936b8cdc6cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:55.558584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 951/1921] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:55 2022] DELETE /identity/v3/projects/f58b815f1e7f4ad99af2a7e0952414d4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:55.563940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2360d9c-f9c8-4721-b760-0f3b25952ae2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:55.564213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2360d9c-f9c8-4721-b760-0f3b25952ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:55.564490 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2360d9c-f9c8-4721-b760-0f3b25952ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:55.586332 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c2360d9c-f9c8-4721-b760-0f3b25952ae2 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:55.587576 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c2360d9c-f9c8-4721-b760-0f3b25952ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:55.620280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:55.661982 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 971/1922] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:55.670692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f1435-a205-43b7-a2ba-7836c10a3947 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:55.670972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f1435-a205-43b7-a2ba-7836c10a3947 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:55.671247 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f1435-a205-43b7-a2ba-7836c10a3947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:55.694016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-377f1435-a205-43b7-a2ba-7836c10a3947 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:55.694631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-377f1435-a205-43b7-a2ba-7836c10a3947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:55.702935 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 952/1923] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:55.707353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2360d9c-f9c8-4721-b760-0f3b25952ae2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:55.718266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2360d9c-f9c8-4721-b760-0f3b25952ae2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:55.724292 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b14128-16a5-4fad-a730-3f33f15bd4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:55.724959 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b14128-16a5-4fad-a730-3f33f15bd4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:55.725243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b14128-16a5-4fad-a730-3f33f15bd4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:55.725518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b14128-16a5-4fad-a730-3f33f15bd4b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:55.726308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b14128-16a5-4fad-a730-3f33f15bd4b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:14:55.726618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b14128-16a5-4fad-a730-3f33f15bd4b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:55.728394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b14128-16a5-4fad-a730-3f33f15bd4b5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:55.742142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 972/1924] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:14:55.746714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f1435-a205-43b7-a2ba-7836c10a3947 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:55.757139 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f1435-a205-43b7-a2ba-7836c10a3947 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:55.762393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693af425-5f96-4694-b9f5-f50cafb432d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:55.763147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693af425-5f96-4694-b9f5-f50cafb432d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:55.763432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693af425-5f96-4694-b9f5-f50cafb432d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:55.763708 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693af425-5f96-4694-b9f5-f50cafb432d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:55.764396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693af425-5f96-4694-b9f5-f50cafb432d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:55.766463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693af425-5f96-4694-b9f5-f50cafb432d6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:55.800402 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 953/1925] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:55 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:55.805545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b14128-16a5-4fad-a730-3f33f15bd4b5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:55.817058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b14128-16a5-4fad-a730-3f33f15bd4b5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:55.878299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a6cf2-0a36-406f-813b-2ad95c01e3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:55.878934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6cf2-0a36-406f-813b-2ad95c01e3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:55.879224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6cf2-0a36-406f-813b-2ad95c01e3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:55.879525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6cf2-0a36-406f-813b-2ad95c01e3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:55.880185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a6cf2-0a36-406f-813b-2ad95c01e3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:55.882158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a6cf2-0a36-406f-813b-2ad95c01e3d3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:55.909648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 973/1926] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:55 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:55.910995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693af425-5f96-4694-b9f5-f50cafb432d6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:55.923400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693af425-5f96-4694-b9f5-f50cafb432d6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:55.929049 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80886267-2bbc-4199-aeab-e74327852a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:55.929786 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80886267-2bbc-4199-aeab-e74327852a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:55.930134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80886267-2bbc-4199-aeab-e74327852a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:55.930479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80886267-2bbc-4199-aeab-e74327852a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:55.931188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80886267-2bbc-4199-aeab-e74327852a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:55.932808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80886267-2bbc-4199-aeab-e74327852a79 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:55.943508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 954/1927] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:55.947659 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a6cf2-0a36-406f-813b-2ad95c01e3d3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:55.958048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a6cf2-0a36-406f-813b-2ad95c01e3d3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:55.963518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecfb12-6850-462c-8f11-294bd5eabb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:55.964203 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecfb12-6850-462c-8f11-294bd5eabb60 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:55.964453 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecfb12-6850-462c-8f11-294bd5eabb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:55.964740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecfb12-6850-462c-8f11-294bd5eabb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:55.965478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecfb12-6850-462c-8f11-294bd5eabb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:55.967268 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecfb12-6850-462c-8f11-294bd5eabb60 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:55.979928 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 974/1928] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:55.984603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80886267-2bbc-4199-aeab-e74327852a79 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:55.995297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80886267-2bbc-4199-aeab-e74327852a79 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:56.001042 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d2e5d-388d-4e81-b7fa-85a9d8911072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:56.001742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d2e5d-388d-4e81-b7fa-85a9d8911072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:56.002052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d2e5d-388d-4e81-b7fa-85a9d8911072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:56.002324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d2e5d-388d-4e81-b7fa-85a9d8911072 admin admin] PATH_INFO: `/v3/projects/ba9b804bd6a149e0b686738dc2b61bda/users/94c6a59645bf49088e163bd22227fe2f/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:56.020947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d2e5d-388d-4e81-b7fa-85a9d8911072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9b804bd6a149e0b686738dc2b61bda, user_id=94c6a59645bf49088e163bd22227fe2f, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:56.023706 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d2e5d-388d-4e81-b7fa-85a9d8911072 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:56.041496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 955/1929] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:55 2022] PUT /identity/v3/projects/ba9b804bd6a149e0b686738dc2b61bda/users/94c6a59645bf49088e163bd22227fe2f/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:56.053213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef988680-a91d-4860-9177-7a04dfe31a71 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:56.053548 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef988680-a91d-4860-9177-7a04dfe31a71 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:56.053867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef988680-a91d-4860-9177-7a04dfe31a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:56.085234 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ef988680-a91d-4860-9177-7a04dfe31a71 None None] MFA Rules not processed for user `94c6a59645bf49088e163bd22227fe2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:56.086530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ef988680-a91d-4860-9177-7a04dfe31a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:56.158300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 975/1930] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:56.163232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d2e5d-388d-4e81-b7fa-85a9d8911072 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:56.230613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d2e5d-388d-4e81-b7fa-85a9d8911072 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:56.236752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28e240-8645-4a49-8038-38da18f06dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:56.237435 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28e240-8645-4a49-8038-38da18f06dce admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:56.237716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28e240-8645-4a49-8038-38da18f06dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:56.237991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28e240-8645-4a49-8038-38da18f06dce admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:56.238680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28e240-8645-4a49-8038-38da18f06dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:56.241891 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28e240-8645-4a49-8038-38da18f06dce admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:56.275278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 956/1931] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:56 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:56.280093 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef988680-a91d-4860-9177-7a04dfe31a71 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:56.294098 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef988680-a91d-4860-9177-7a04dfe31a71 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:56.331246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:56.364144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be974a47-4a64-48f5-81e3-35b05c593304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:56.364791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be974a47-4a64-48f5-81e3-35b05c593304 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:56.365218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be974a47-4a64-48f5-81e3-35b05c593304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:56.365500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be974a47-4a64-48f5-81e3-35b05c593304 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:56.366182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be974a47-4a64-48f5-81e3-35b05c593304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:56.368127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be974a47-4a64-48f5-81e3-35b05c593304 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:56.393791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 976/1932] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:56 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:56.395276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28e240-8645-4a49-8038-38da18f06dce admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:56.409940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28e240-8645-4a49-8038-38da18f06dce admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:56.414745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd1746-0b7e-4e44-9185-60edb00156dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:56.415356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd1746-0b7e-4e44-9185-60edb00156dd admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:56.415634 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd1746-0b7e-4e44-9185-60edb00156dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:56.415931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd1746-0b7e-4e44-9185-60edb00156dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:56.416624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd1746-0b7e-4e44-9185-60edb00156dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:56.418267 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd1746-0b7e-4e44-9185-60edb00156dd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:56.429907 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 957/1933] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:56.434365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be974a47-4a64-48f5-81e3-35b05c593304 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:56.444926 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be974a47-4a64-48f5-81e3-35b05c593304 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:56.449958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b8b28-222b-4067-bc19-a0305f100e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:56.450693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b8b28-222b-4067-bc19-a0305f100e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:56.450981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b8b28-222b-4067-bc19-a0305f100e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:56.451279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b8b28-222b-4067-bc19-a0305f100e91 admin admin] PATH_INFO: `/v3/projects/d90bd347c20148478cadf1f3a95cb57d/users/d2956af0285a4365b8a145c947fb300b/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:56.467274 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b8b28-222b-4067-bc19-a0305f100e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90bd347c20148478cadf1f3a95cb57d, user_id=d2956af0285a4365b8a145c947fb300b, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:56.470024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b8b28-222b-4067-bc19-a0305f100e91 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:56.485457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 977/1934] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:56 2022] PUT /identity/v3/projects/d90bd347c20148478cadf1f3a95cb57d/users/d2956af0285a4365b8a145c947fb300b/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:56.489330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd1746-0b7e-4e44-9185-60edb00156dd admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:56.500448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd1746-0b7e-4e44-9185-60edb00156dd admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:56.509712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:56.564572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5479-2065-4b80-90d1-575af8a6c8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:56.565257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5479-2065-4b80-90d1-575af8a6c8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:56.565636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5479-2065-4b80-90d1-575af8a6c8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:56.565764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5479-2065-4b80-90d1-575af8a6c8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:56.566478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c5479-2065-4b80-90d1-575af8a6c8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:56.568089 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c5479-2065-4b80-90d1-575af8a6c8f7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:56.579190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 958/1935] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:56.583735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b8b28-222b-4067-bc19-a0305f100e91 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:56.594812 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b8b28-222b-4067-bc19-a0305f100e91 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:56.599856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beaba0b-1fb1-4654-bfb3-ae20851b79b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:56.600532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaba0b-1fb1-4654-bfb3-ae20851b79b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:56.600812 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaba0b-1fb1-4654-bfb3-ae20851b79b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:56.601198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beaba0b-1fb1-4654-bfb3-ae20851b79b6 admin admin] PATH_INFO: `/v3/projects/d90bd347c20148478cadf1f3a95cb57d/users/d2956af0285a4365b8a145c947fb300b/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:56.603212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beaba0b-1fb1-4654-bfb3-ae20851b79b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90bd347c20148478cadf1f3a95cb57d, user_id=d2956af0285a4365b8a145c947fb300b, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:56.605890 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beaba0b-1fb1-4654-bfb3-ae20851b79b6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:56.617178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 978/1936] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:56 2022] PUT /identity/v3/projects/d90bd347c20148478cadf1f3a95cb57d/users/d2956af0285a4365b8a145c947fb300b/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:14:56.628023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44b3f2-82de-4250-82c5-15872ca8f9f8 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:56.628270 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44b3f2-82de-4250-82c5-15872ca8f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:56.628581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44b3f2-82de-4250-82c5-15872ca8f9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:56.659964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7f44b3f2-82de-4250-82c5-15872ca8f9f8 None None] MFA Rules not processed for user `d2956af0285a4365b8a145c947fb300b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:56.661253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7f44b3f2-82de-4250-82c5-15872ca8f9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:56.734448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 959/1937] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:56.746825 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beaba0b-1fb1-4654-bfb3-ae20851b79b6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:56.749365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2beaba0b-1fb1-4654-bfb3-ae20851b79b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:56.821119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beaba0b-1fb1-4654-bfb3-ae20851b79b6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:56.825205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4698a-5bcf-4ce6-97ea-92d3c203c114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:56.825936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4698a-5bcf-4ce6-97ea-92d3c203c114 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:56.826221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4698a-5bcf-4ce6-97ea-92d3c203c114 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:56.826515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4698a-5bcf-4ce6-97ea-92d3c203c114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:56.836499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4698a-5bcf-4ce6-97ea-92d3c203c114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:56.837981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4698a-5bcf-4ce6-97ea-92d3c203c114 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:56.848226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 979/1938] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:56.940174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44b3f2-82de-4250-82c5-15872ca8f9f8 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:56.950389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44b3f2-82de-4250-82c5-15872ca8f9f8 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:56.955398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513ebf0-826d-46d0-b914-c0fd3428e8fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:56.956063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513ebf0-826d-46d0-b914-c0fd3428e8fa service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:56.956339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513ebf0-826d-46d0-b914-c0fd3428e8fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:56.956612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513ebf0-826d-46d0-b914-c0fd3428e8fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:57.021969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513ebf0-826d-46d0-b914-c0fd3428e8fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:57.023457 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513ebf0-826d-46d0-b914-c0fd3428e8fa service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:57.034707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 960/1939] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:57.316563 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4698a-5bcf-4ce6-97ea-92d3c203c114 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:57.404775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4698a-5bcf-4ce6-97ea-92d3c203c114 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:57.411924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:57.412587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:57.412868 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:57.413166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] PATH_INFO: `/v3/users/94c6a59645bf49088e163bd22227fe2f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:57.414413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c6a59645bf49088e163bd22227fe2f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:57.416419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:57.453698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:57.483394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c6a59645bf49088e163bd22227fe2f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:57.484246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c6a59645bf49088e163bd22227fe2f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:57.497385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c6a59645bf49088e163bd22227fe2f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:57.498695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c6a59645bf49088e163bd22227fe2f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:57.520056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c6a59645bf49088e163bd22227fe2f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:57.541650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 980/1940] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:57 2022] DELETE /identity/v3/users/94c6a59645bf49088e163bd22227fe2f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:57.546693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b763a-7246-4999-98a6-74afeaa7b6e5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:57.547065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b763a-7246-4999-98a6-74afeaa7b6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:57.547341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b763a-7246-4999-98a6-74afeaa7b6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:57.567565 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-185b763a-7246-4999-98a6-74afeaa7b6e5 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:57.568801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-185b763a-7246-4999-98a6-74afeaa7b6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:57.598133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:57.634487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 961/1941] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:14:57.644571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:57.646044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:57.707593 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888f41f-6e56-4684-946a-c510b036f99c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:57.711583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f767a-ae82-4c87-b45e-d300c3856a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:57.712223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f767a-ae82-4c87-b45e-d300c3856a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:57.712505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f767a-ae82-4c87-b45e-d300c3856a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:57.712773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f767a-ae82-4c87-b45e-d300c3856a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:57.722746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f767a-ae82-4c87-b45e-d300c3856a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:57.724235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f767a-ae82-4c87-b45e-d300c3856a66 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:57.734526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 981/1942] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:14:58.030933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b763a-7246-4999-98a6-74afeaa7b6e5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:58.033164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-185b763a-7246-4999-98a6-74afeaa7b6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:58.054300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b763a-7246-4999-98a6-74afeaa7b6e5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:58.072601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:58.073485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:58.073677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:58.074075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] PATH_INFO: `/v3/projects/ba9b804bd6a149e0b686738dc2b61bda` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:58.075367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9b804bd6a149e0b686738dc2b61bda)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:58.077583 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:58.148379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9b804bd6a149e0b686738dc2b61bda', 'request_id': 'req-df7acdb1-25f8-4642-8446-5fe3259c900a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.157665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9b804bd6a149e0b686738dc2b61bda', 'request_id': 'req-df7acdb1-25f8-4642-8446-5fe3259c900a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.167861 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9b804bd6a149e0b686738dc2b61bda', 'request_id': 'req-df7acdb1-25f8-4642-8446-5fe3259c900a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.186058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] The token cache is being invalidate because project ba9b804bd6a149e0b686738dc2b61bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:58.186329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.187050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.188669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 962/1943] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:58 2022] DELETE /identity/v3/projects/ba9b804bd6a149e0b686738dc2b61bda => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:14:58.192685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f767a-ae82-4c87-b45e-d300c3856a66 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:58.203151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f767a-ae82-4c87-b45e-d300c3856a66 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:58.264237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929a5c7-7f34-43e7-8148-44e0568a8807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:58.265029 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a5c7-7f34-43e7-8148-44e0568a8807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:58.265406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a5c7-7f34-43e7-8148-44e0568a8807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:58.265680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929a5c7-7f34-43e7-8148-44e0568a8807 admin admin] PATH_INFO: `/v3/users/d2956af0285a4365b8a145c947fb300b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:58.266904 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929a5c7-7f34-43e7-8148-44e0568a8807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2956af0285a4365b8a145c947fb300b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:58.269057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929a5c7-7f34-43e7-8148-44e0568a8807 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:58.324969 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a929a5c7-7f34-43e7-8148-44e0568a8807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2956af0285a4365b8a145c947fb300b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.325774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a929a5c7-7f34-43e7-8148-44e0568a8807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2956af0285a4365b8a145c947fb300b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.327457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:58.334708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a929a5c7-7f34-43e7-8148-44e0568a8807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2956af0285a4365b8a145c947fb300b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.335808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a929a5c7-7f34-43e7-8148-44e0568a8807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2956af0285a4365b8a145c947fb300b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.350732 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a929a5c7-7f34-43e7-8148-44e0568a8807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2956af0285a4365b8a145c947fb300b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.364105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 982/1944] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:14:58 2022] DELETE /identity/v3/users/d2956af0285a4365b8a145c947fb300b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:58.683586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:58.685294 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:58.721357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7acdb1-25f8-4642-8446-5fe3259c900a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:58.784368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:58.785066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:58.785349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:58.785702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2 admin admin] PATH_INFO: `/v3/projects/d90bd347c20148478cadf1f3a95cb57d` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:58.786909 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90bd347c20148478cadf1f3a95cb57d)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:58.789092 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:58.851336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90bd347c20148478cadf1f3a95cb57d', 'request_id': 'req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.876062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90bd347c20148478cadf1f3a95cb57d', 'request_id': 'req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.877947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:58.892188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90bd347c20148478cadf1f3a95cb57d', 'request_id': 'req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.905871 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2 admin admin] The token cache is being invalidate because project d90bd347c20148478cadf1f3a95cb57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:14:58.906132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.906795 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b0e17f04-25cc-49d1-af3b-d6b7c23095b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:14:58.908402 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 963/1945] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:14:58 2022] DELETE /identity/v3/projects/d90bd347c20148478cadf1f3a95cb57d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:58.913495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04414a-a0e3-4ef8-9f57-30a44da9ab19 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:58.913785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04414a-a0e3-4ef8-9f57-30a44da9ab19 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:58.914056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04414a-a0e3-4ef8-9f57-30a44da9ab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:58.936280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3e04414a-a0e3-4ef8-9f57-30a44da9ab19 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:58.937762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3e04414a-a0e3-4ef8-9f57-30a44da9ab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:59.004604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 983/1946] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:59.012535 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098040b1-0aa0-43bf-a40c-286639570cac None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.012998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098040b1-0aa0-43bf-a40c-286639570cac None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.013415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098040b1-0aa0-43bf-a40c-286639570cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.035090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-098040b1-0aa0-43bf-a40c-286639570cac None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:59.036239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-098040b1-0aa0-43bf-a40c-286639570cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:59.045432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 964/1947] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:59.049943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04414a-a0e3-4ef8-9f57-30a44da9ab19 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:59.060499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04414a-a0e3-4ef8-9f57-30a44da9ab19 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:59.065953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fec5fe-765b-4d06-bb64-ce8fa254e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:59.066598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fec5fe-765b-4d06-bb64-ce8fa254e4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.066914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fec5fe-765b-4d06-bb64-ce8fa254e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.067182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fec5fe-765b-4d06-bb64-ce8fa254e4a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.067901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fec5fe-765b-4d06-bb64-ce8fa254e4a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:14:59.068210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fec5fe-765b-4d06-bb64-ce8fa254e4a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:59.069867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fec5fe-765b-4d06-bb64-ce8fa254e4a1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:59.082871 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 984/1948] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:14:59.087546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098040b1-0aa0-43bf-a40c-286639570cac None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:59.097314 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098040b1-0aa0-43bf-a40c-286639570cac None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:59.102765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26b210-d17c-4280-947f-b89ab6e9e872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:59.103391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26b210-d17c-4280-947f-b89ab6e9e872 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.103674 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26b210-d17c-4280-947f-b89ab6e9e872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.103943 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26b210-d17c-4280-947f-b89ab6e9e872 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.104611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26b210-d17c-4280-947f-b89ab6e9e872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:59.106561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26b210-d17c-4280-947f-b89ab6e9e872 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:59.139533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 965/1949] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:59 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:59.145772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fec5fe-765b-4d06-bb64-ce8fa254e4a1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:59.158122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fec5fe-765b-4d06-bb64-ce8fa254e4a1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:59.226773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206873e-b7ba-4772-b716-af3297c3e014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:59.227440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206873e-b7ba-4772-b716-af3297c3e014 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.227723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206873e-b7ba-4772-b716-af3297c3e014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.228068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206873e-b7ba-4772-b716-af3297c3e014 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.228701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206873e-b7ba-4772-b716-af3297c3e014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:59.230772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206873e-b7ba-4772-b716-af3297c3e014 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:59.254426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 985/1950] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:59 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:59.258931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26b210-d17c-4280-947f-b89ab6e9e872 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:59.272041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26b210-d17c-4280-947f-b89ab6e9e872 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:59.276197 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d14af-f329-44f5-9932-cec1af8c0de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:59.278061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d14af-f329-44f5-9932-cec1af8c0de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.278061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d14af-f329-44f5-9932-cec1af8c0de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.278061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d14af-f329-44f5-9932-cec1af8c0de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.282990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d14af-f329-44f5-9932-cec1af8c0de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:59.282990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d14af-f329-44f5-9932-cec1af8c0de9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:59.291676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 966/1951] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:59.296592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206873e-b7ba-4772-b716-af3297c3e014 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:59.310843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206873e-b7ba-4772-b716-af3297c3e014 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:59.316947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5204d31-4115-461d-8abb-5f22a2af6c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:59.317499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5204d31-4115-461d-8abb-5f22a2af6c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.317865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5204d31-4115-461d-8abb-5f22a2af6c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.318146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5204d31-4115-461d-8abb-5f22a2af6c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.321158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5204d31-4115-461d-8abb-5f22a2af6c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:59.321158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5204d31-4115-461d-8abb-5f22a2af6c44 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:59.332823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 986/1952] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:59.337302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d14af-f329-44f5-9932-cec1af8c0de9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:59.348343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d14af-f329-44f5-9932-cec1af8c0de9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:59.353454 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b433b3-137f-40e3-a441-40b90de6158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:59.354170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b433b3-137f-40e3-a441-40b90de6158b admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.354449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b433b3-137f-40e3-a441-40b90de6158b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.354722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b433b3-137f-40e3-a441-40b90de6158b admin admin] PATH_INFO: `/v3/projects/d5c1b0a88da24aa08c827172ceba1c38/users/efda4cbcd9294db788dedf7d6b9d6ba9/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.371191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b433b3-137f-40e3-a441-40b90de6158b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c1b0a88da24aa08c827172ceba1c38, user_id=efda4cbcd9294db788dedf7d6b9d6ba9, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:59.374056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b433b3-137f-40e3-a441-40b90de6158b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:59.389492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 967/1953] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:59 2022] PUT /identity/v3/projects/d5c1b0a88da24aa08c827172ceba1c38/users/efda4cbcd9294db788dedf7d6b9d6ba9/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:59.400434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7639-bfcf-449b-b9c3-99a9ff5efdb3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.400721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7639-bfcf-449b-b9c3-99a9ff5efdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.401037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f7639-bfcf-449b-b9c3-99a9ff5efdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.434943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9b2f7639-bfcf-449b-b9c3-99a9ff5efdb3 None None] MFA Rules not processed for user `efda4cbcd9294db788dedf7d6b9d6ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:14:59.436354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9b2f7639-bfcf-449b-b9c3-99a9ff5efdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:14:59.456769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:59.512321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 987/1954] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:14:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:14:59.517531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b433b3-137f-40e3-a441-40b90de6158b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:59.586973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b433b3-137f-40e3-a441-40b90de6158b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:59.592795 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76d6ea-15b1-4f13-a648-3a86f6378382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:59.593488 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76d6ea-15b1-4f13-a648-3a86f6378382 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.593744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76d6ea-15b1-4f13-a648-3a86f6378382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.594015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76d6ea-15b1-4f13-a648-3a86f6378382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.594692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76d6ea-15b1-4f13-a648-3a86f6378382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:59.596639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76d6ea-15b1-4f13-a648-3a86f6378382 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:59.628407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 968/1955] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:14:59 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:14:59.633399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f7639-bfcf-449b-b9c3-99a9ff5efdb3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:59.645098 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f7639-bfcf-449b-b9c3-99a9ff5efdb3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:59.705207 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b16403-9268-4fad-8e1e-e3ec17cc906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:59.705838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b16403-9268-4fad-8e1e-e3ec17cc906f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.706176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b16403-9268-4fad-8e1e-e3ec17cc906f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.706447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b16403-9268-4fad-8e1e-e3ec17cc906f admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.707123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b16403-9268-4fad-8e1e-e3ec17cc906f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:59.709211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b16403-9268-4fad-8e1e-e3ec17cc906f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:59.732049 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 988/1956] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:14:59 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:14:59.736473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76d6ea-15b1-4f13-a648-3a86f6378382 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:59.747647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76d6ea-15b1-4f13-a648-3a86f6378382 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:59.752540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6939e31-e7fc-45a6-ad8e-ba916009fb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:59.753278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6939e31-e7fc-45a6-ad8e-ba916009fb75 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.753623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6939e31-e7fc-45a6-ad8e-ba916009fb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.753987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6939e31-e7fc-45a6-ad8e-ba916009fb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.754730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6939e31-e7fc-45a6-ad8e-ba916009fb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:59.756374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6939e31-e7fc-45a6-ad8e-ba916009fb75 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:59.767870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 969/1957] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:14:59.772296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b16403-9268-4fad-8e1e-e3ec17cc906f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:59.783402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b16403-9268-4fad-8e1e-e3ec17cc906f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:59.788500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001176f-34da-4613-9ebc-b91bd70217af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:59.789353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001176f-34da-4613-9ebc-b91bd70217af admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.789631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001176f-34da-4613-9ebc-b91bd70217af admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.789905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001176f-34da-4613-9ebc-b91bd70217af admin admin] PATH_INFO: `/v3/projects/ac85a1b63dd844159c8d747993429af8/users/d28a427983ce4278811187d2fd0aa620/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.806117 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001176f-34da-4613-9ebc-b91bd70217af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac85a1b63dd844159c8d747993429af8, user_id=d28a427983ce4278811187d2fd0aa620, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:59.808925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001176f-34da-4613-9ebc-b91bd70217af admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:59.828328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 989/1958] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:59 2022] PUT /identity/v3/projects/ac85a1b63dd844159c8d747993429af8/users/d28a427983ce4278811187d2fd0aa620/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:14:59.832510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6939e31-e7fc-45a6-ad8e-ba916009fb75 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:59.845058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6939e31-e7fc-45a6-ad8e-ba916009fb75 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:59.919324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:14:59.930246 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818bfd0-9a7c-4e11-be79-38781e33922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:59.930902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818bfd0-9a7c-4e11-be79-38781e33922d admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.931181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818bfd0-9a7c-4e11-be79-38781e33922d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.931513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818bfd0-9a7c-4e11-be79-38781e33922d admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.932376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818bfd0-9a7c-4e11-be79-38781e33922d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:14:59.935342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818bfd0-9a7c-4e11-be79-38781e33922d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:14:59.949798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 970/1959] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:14:59.954528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001176f-34da-4613-9ebc-b91bd70217af admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:14:59.971475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001176f-34da-4613-9ebc-b91bd70217af admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:14:59.987095 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235361c9-aefe-4b7b-8660-0820c53fbb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:14:59.987807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235361c9-aefe-4b7b-8660-0820c53fbb89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:14:59.988096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235361c9-aefe-4b7b-8660-0820c53fbb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:14:59.988371 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235361c9-aefe-4b7b-8660-0820c53fbb89 admin admin] PATH_INFO: `/v3/projects/ac85a1b63dd844159c8d747993429af8/users/d28a427983ce4278811187d2fd0aa620/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:14:59.991176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235361c9-aefe-4b7b-8660-0820c53fbb89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac85a1b63dd844159c8d747993429af8, user_id=d28a427983ce4278811187d2fd0aa620, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:00.002460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235361c9-aefe-4b7b-8660-0820c53fbb89 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:00.027047 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 990/1960] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:14:59 2022] PUT /identity/v3/projects/ac85a1b63dd844159c8d747993429af8/users/d28a427983ce4278811187d2fd0aa620/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:00.039272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e8c54-2b06-42d8-ac95-5bbe07f8f425 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:00.039706 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e8c54-2b06-42d8-ac95-5bbe07f8f425 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:00.039865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e8c54-2b06-42d8-ac95-5bbe07f8f425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:00.093137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b52e8c54-2b06-42d8-ac95-5bbe07f8f425 None None] MFA Rules not processed for user `d28a427983ce4278811187d2fd0aa620`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:00.094699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b52e8c54-2b06-42d8-ac95-5bbe07f8f425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:00.200918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 971/1961] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:00.214363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235361c9-aefe-4b7b-8660-0820c53fbb89 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:00.216329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-235361c9-aefe-4b7b-8660-0820c53fbb89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:00.306863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235361c9-aefe-4b7b-8660-0820c53fbb89 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:00.315442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090b9ed-d734-4654-a0f5-c2d4195c4adf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:00.316101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b9ed-d734-4654-a0f5-c2d4195c4adf service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:00.316374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b9ed-d734-4654-a0f5-c2d4195c4adf service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:00.316657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b9ed-d734-4654-a0f5-c2d4195c4adf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:00.372936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:00.423555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090b9ed-d734-4654-a0f5-c2d4195c4adf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:00.425055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090b9ed-d734-4654-a0f5-c2d4195c4adf service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:00.435051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 991/1962] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:07.416814 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e8c54-2b06-42d8-ac95-5bbe07f8f425 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:07.564456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e8c54-2b06-42d8-ac95-5bbe07f8f425 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:07.569719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:07.570648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:07.571393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:07.571393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] PATH_INFO: `/v3/users/efda4cbcd9294db788dedf7d6b9d6ba9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:07.573257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=efda4cbcd9294db788dedf7d6b9d6ba9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:07.575196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:07.660144 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efda4cbcd9294db788dedf7d6b9d6ba9'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:07.672203 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efda4cbcd9294db788dedf7d6b9d6ba9'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:07.686409 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efda4cbcd9294db788dedf7d6b9d6ba9'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:07.687271 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efda4cbcd9294db788dedf7d6b9d6ba9'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:07.699228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:07.700741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efda4cbcd9294db788dedf7d6b9d6ba9'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:07.708802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 972/1963] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:07 2022] DELETE /identity/v3/users/efda4cbcd9294db788dedf7d6b9d6ba9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:07.713467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc96c9-fefc-4749-ba86-f1bcd17fe999 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:07.714104 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc96c9-fefc-4749-ba86-f1bcd17fe999 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:07.714104 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc96c9-fefc-4749-ba86-f1bcd17fe999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:07.733599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-62dc96c9-fefc-4749-ba86-f1bcd17fe999 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:07.734821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-62dc96c9-fefc-4749-ba86-f1bcd17fe999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:07.811818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 992/1964] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:07.823813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:07.825583 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:07.908348 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3074ec4-091a-432f-9fd4-791751510f9f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:07.918656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ff99b-b4f6-4d60-b9a5-8548704c9f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:07.918656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ff99b-b4f6-4d60-b9a5-8548704c9f34 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:07.918656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ff99b-b4f6-4d60-b9a5-8548704c9f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:07.919426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ff99b-b4f6-4d60-b9a5-8548704c9f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:07.937690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ff99b-b4f6-4d60-b9a5-8548704c9f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:07.939326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ff99b-b4f6-4d60-b9a5-8548704c9f34 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:07.954014 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 973/1965] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:08.326913 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc96c9-fefc-4749-ba86-f1bcd17fe999 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:08.328671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-62dc96c9-fefc-4749-ba86-f1bcd17fe999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:08.350102 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc96c9-fefc-4749-ba86-f1bcd17fe999 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:08.355187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:08.362762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:08.363051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:08.363330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] PATH_INFO: `/v3/projects/d5c1b0a88da24aa08c827172ceba1c38` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:08.364698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c1b0a88da24aa08c827172ceba1c38)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:08.366670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:08.418691 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c1b0a88da24aa08c827172ceba1c38', 'request_id': 'req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:08.426426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c1b0a88da24aa08c827172ceba1c38', 'request_id': 'req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:08.432286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c1b0a88da24aa08c827172ceba1c38', 'request_id': 'req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:08.443706 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] The token cache is being invalidate because project d5c1b0a88da24aa08c827172ceba1c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:08.443993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:08.444659 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:08.446229 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 993/1966] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:08 2022] DELETE /identity/v3/projects/d5c1b0a88da24aa08c827172ceba1c38 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:08.450335 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ff99b-b4f6-4d60-b9a5-8548704c9f34 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:08.460752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ff99b-b4f6-4d60-b9a5-8548704c9f34 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:08.521394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:08.522050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:08.522411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:08.522813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] PATH_INFO: `/v3/users/d28a427983ce4278811187d2fd0aa620` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:08.524038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28a427983ce4278811187d2fd0aa620)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:08.526029 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:08.579397 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28a427983ce4278811187d2fd0aa620'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:08.587033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28a427983ce4278811187d2fd0aa620'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:08.598393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28a427983ce4278811187d2fd0aa620'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:08.599079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28a427983ce4278811187d2fd0aa620'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:08.615747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28a427983ce4278811187d2fd0aa620'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:08.623242 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 974/1967] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:08 2022] DELETE /identity/v3/users/d28a427983ce4278811187d2fd0aa620 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:09.003314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:09.004880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:09.041269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e9015-f9bf-4e2a-9dcf-ed7f1af0db21 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:09.109316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:09.125698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:09.126768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.129867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.129867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2 admin admin] PATH_INFO: `/v3/projects/ac85a1b63dd844159c8d747993429af8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:09.131454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac85a1b63dd844159c8d747993429af8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:09.133838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:09.230057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac85a1b63dd844159c8d747993429af8', 'request_id': 'req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:09.230385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:09.233492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:09.242858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac85a1b63dd844159c8d747993429af8', 'request_id': 'req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:09.251200 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827b22c-0a73-4a00-a526-3b567ad0dedc admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:09.252850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac85a1b63dd844159c8d747993429af8', 'request_id': 'req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:09.269564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2 admin admin] The token cache is being invalidate because project ac85a1b63dd844159c8d747993429af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:09.269949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:09.270684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0f1c85e2-9d6c-4ee5-8850-f3148a2ea3a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:09.271345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:09.272710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 994/1968] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:09 2022] DELETE /identity/v3/projects/ac85a1b63dd844159c8d747993429af8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:09.279853 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81b3b0-dfd6-42f0-9ff2-477ce0cfd1a1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.280138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81b3b0-dfd6-42f0-9ff2-477ce0cfd1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.280490 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81b3b0-dfd6-42f0-9ff2-477ce0cfd1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:09.303380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-df81b3b0-dfd6-42f0-9ff2-477ce0cfd1a1 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:09.305615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-df81b3b0-dfd6-42f0-9ff2-477ce0cfd1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:09.333908 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec85444-5542-40e8-bec0-587532b5e9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:09.334479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec85444-5542-40e8-bec0-587532b5e9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.334765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec85444-5542-40e8-bec0-587532b5e9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.335038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec85444-5542-40e8-bec0-587532b5e9fb admin admin] PATH_INFO: `/v3/users/d126585de5dd46738d706f9140da615c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:09.336327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec85444-5542-40e8-bec0-587532b5e9fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d126585de5dd46738d706f9140da615c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:09.338332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec85444-5542-40e8-bec0-587532b5e9fb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:09.387686 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 995/1969] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:09.401734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4974f0-e569-424e-ab87-ec7beb00e9fb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.402020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4974f0-e569-424e-ab87-ec7beb00e9fb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.402656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4974f0-e569-424e-ab87-ec7beb00e9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:09.403610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-dec85444-5542-40e8-bec0-587532b5e9fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd126585de5dd46738d706f9140da615c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:09.412591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-dec85444-5542-40e8-bec0-587532b5e9fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd126585de5dd46738d706f9140da615c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:09.425269 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-dec85444-5542-40e8-bec0-587532b5e9fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd126585de5dd46738d706f9140da615c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:09.426394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6d4974f0-e569-424e-ab87-ec7beb00e9fb None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:09.427334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-dec85444-5542-40e8-bec0-587532b5e9fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd126585de5dd46738d706f9140da615c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:09.428347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6d4974f0-e569-424e-ab87-ec7beb00e9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:09.437745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 996/1970] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:09.442607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4974f0-e569-424e-ab87-ec7beb00e9fb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:09.448471 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-dec85444-5542-40e8-bec0-587532b5e9fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd126585de5dd46738d706f9140da615c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:09.454099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4974f0-e569-424e-ab87-ec7beb00e9fb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:09.455616 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 975/1971] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:09 2022] DELETE /identity/v3/users/d126585de5dd46738d706f9140da615c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:09.461215 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a620f-131d-4369-a773-efd6beb8a0fe None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.461516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a620f-131d-4369-a773-efd6beb8a0fe None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.461802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a620f-131d-4369-a773-efd6beb8a0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:09.485978 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-417a620f-131d-4369-a773-efd6beb8a0fe None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:09.487232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-417a620f-131d-4369-a773-efd6beb8a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:09.542615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec3f9c-ad3a-4fdf-95c9-1adabed22e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:09.543517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec3f9c-ad3a-4fdf-95c9-1adabed22e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.543847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec3f9c-ad3a-4fdf-95c9-1adabed22e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.544220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec3f9c-ad3a-4fdf-95c9-1adabed22e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:09.545317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec3f9c-ad3a-4fdf-95c9-1adabed22e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:09.545642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec3f9c-ad3a-4fdf-95c9-1adabed22e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:09.547604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec3f9c-ad3a-4fdf-95c9-1adabed22e97 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:09.567077 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 976/1972] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:09.581774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 997/1973] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:15:09.581977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a620f-131d-4369-a773-efd6beb8a0fe None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:09.583310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec3f9c-ad3a-4fdf-95c9-1adabed22e97 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:09.584167 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-417a620f-131d-4369-a773-efd6beb8a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:09.589707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-50ec3f9c-ad3a-4fdf-95c9-1adabed22e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:09.611299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec3f9c-ad3a-4fdf-95c9-1adabed22e97 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:09.622988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625f182-4474-4a61-833f-c360c8348e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:09.623779 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625f182-4474-4a61-833f-c360c8348e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.625174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625f182-4474-4a61-833f-c360c8348e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.625468 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625f182-4474-4a61-833f-c360c8348e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:09.626169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625f182-4474-4a61-833f-c360c8348e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:09.628112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625f182-4474-4a61-833f-c360c8348e55 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:09.635777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:09.649229 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:09.675210 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a620f-131d-4369-a773-efd6beb8a0fe None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:09.679374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67809b4-77e8-4848-aa4e-110a4169ff57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:09.680144 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67809b4-77e8-4848-aa4e-110a4169ff57 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.680710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67809b4-77e8-4848-aa4e-110a4169ff57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.681239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67809b4-77e8-4848-aa4e-110a4169ff57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:09.687440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 998/1974] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:09 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:09.688924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625f182-4474-4a61-833f-c360c8348e55 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:09.697332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67809b4-77e8-4848-aa4e-110a4169ff57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:09.701418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67809b4-77e8-4848-aa4e-110a4169ff57 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:09.717076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 977/1975] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:09.776453 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625f182-4474-4a61-833f-c360c8348e55 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:09.786572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078c25c-27a3-4869-bdbe-d4b6d433dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:09.787330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078c25c-27a3-4869-bdbe-d4b6d433dd9b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.787694 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078c25c-27a3-4869-bdbe-d4b6d433dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.788035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078c25c-27a3-4869-bdbe-d4b6d433dd9b admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:09.788823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078c25c-27a3-4869-bdbe-d4b6d433dd9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:09.790953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078c25c-27a3-4869-bdbe-d4b6d433dd9b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:09.815553 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 999/1976] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:09 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:09.819956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67809b4-77e8-4848-aa4e-110a4169ff57 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:09.830589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67809b4-77e8-4848-aa4e-110a4169ff57 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:09.837172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55a91c-a17d-4a4d-ba67-92acf6633ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:09.837172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55a91c-a17d-4a4d-ba67-92acf6633ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.837172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55a91c-a17d-4a4d-ba67-92acf6633ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.837172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55a91c-a17d-4a4d-ba67-92acf6633ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:09.837921 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55a91c-a17d-4a4d-ba67-92acf6633ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:09.839972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55a91c-a17d-4a4d-ba67-92acf6633ff6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:09.854700 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 978/1977] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:09.857652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078c25c-27a3-4869-bdbe-d4b6d433dd9b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:09.872634 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078c25c-27a3-4869-bdbe-d4b6d433dd9b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:09.878301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c6cd7-7a0a-486b-ba92-2772c0eb9cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:09.879138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c6cd7-7a0a-486b-ba92-2772c0eb9cef admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.879506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c6cd7-7a0a-486b-ba92-2772c0eb9cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.879854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c6cd7-7a0a-486b-ba92-2772c0eb9cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:09.880755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c6cd7-7a0a-486b-ba92-2772c0eb9cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:09.882797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c6cd7-7a0a-486b-ba92-2772c0eb9cef admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:09.897538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1000/1978] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:09.901648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55a91c-a17d-4a4d-ba67-92acf6633ff6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:09.916969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55a91c-a17d-4a4d-ba67-92acf6633ff6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:09.922037 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d8e1-c2f2-4678-9dfe-3282475e35df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:09.922762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d8e1-c2f2-4678-9dfe-3282475e35df admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.923048 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d8e1-c2f2-4678-9dfe-3282475e35df admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.923312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0d8e1-c2f2-4678-9dfe-3282475e35df admin admin] PATH_INFO: `/v3/projects/8a54b1a289344aeabff94a47f16abe07/users/7812f08158f54169b25b0a5398b57276/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:09.949407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d8e1-c2f2-4678-9dfe-3282475e35df admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a54b1a289344aeabff94a47f16abe07, user_id=7812f08158f54169b25b0a5398b57276, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:09.952196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0d8e1-c2f2-4678-9dfe-3282475e35df admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:09.971592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 979/1979] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:09 2022] PUT /identity/v3/projects/8a54b1a289344aeabff94a47f16abe07/users/7812f08158f54169b25b0a5398b57276/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:09.982620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f085e5-4166-498d-a11e-6a3ee5ce96dc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:09.982991 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f085e5-4166-498d-a11e-6a3ee5ce96dc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:09.983355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f085e5-4166-498d-a11e-6a3ee5ce96dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:10.021316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-32f085e5-4166-498d-a11e-6a3ee5ce96dc None None] MFA Rules not processed for user `7812f08158f54169b25b0a5398b57276`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:10.022745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-32f085e5-4166-498d-a11e-6a3ee5ce96dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:10.138013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1001/1980] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:10.162372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d8e1-c2f2-4678-9dfe-3282475e35df admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:10.163990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-04a0d8e1-c2f2-4678-9dfe-3282475e35df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:10.186429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f085e5-4166-498d-a11e-6a3ee5ce96dc None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:10.193377 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-32f085e5-4166-498d-a11e-6a3ee5ce96dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:10.263224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0d8e1-c2f2-4678-9dfe-3282475e35df admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:10.269828 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b461b-625b-475c-89cf-f07c736256b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:10.270475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b461b-625b-475c-89cf-f07c736256b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:10.270755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b461b-625b-475c-89cf-f07c736256b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:10.271039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b461b-625b-475c-89cf-f07c736256b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:10.275627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:10.282175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b461b-625b-475c-89cf-f07c736256b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:10.283655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b461b-625b-475c-89cf-f07c736256b5 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:10.288343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f085e5-4166-498d-a11e-6a3ee5ce96dc None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:10.296305 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 980/1981] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:10.320024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:10.320024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:10.320369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:10.320614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] PATH_INFO: `/v3/projects/311b44854c864702bfba21fcbacb0997` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:10.322205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=311b44854c864702bfba21fcbacb0997)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:10.324096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:10.393077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311b44854c864702bfba21fcbacb0997', 'request_id': 'req-dcdf71ee-b929-48e0-8991-18dbf81b79ec'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:10.403980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311b44854c864702bfba21fcbacb0997', 'request_id': 'req-dcdf71ee-b929-48e0-8991-18dbf81b79ec'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:10.410642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311b44854c864702bfba21fcbacb0997', 'request_id': 'req-dcdf71ee-b929-48e0-8991-18dbf81b79ec'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:10.424878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] The token cache is being invalidate because project 311b44854c864702bfba21fcbacb0997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:10.425290 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:10.426061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:10.428199 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1002/1982] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:10 2022] DELETE /identity/v3/projects/311b44854c864702bfba21fcbacb0997 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:10.432454 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b461b-625b-475c-89cf-f07c736256b5 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:10.450206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b461b-625b-475c-89cf-f07c736256b5 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:10.524448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe4356-033f-41e8-9024-fb79a3528198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:10.525214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe4356-033f-41e8-9024-fb79a3528198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:10.525524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe4356-033f-41e8-9024-fb79a3528198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:10.525916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe4356-033f-41e8-9024-fb79a3528198 admin admin] PATH_INFO: `/v3/users/41b02fb146de40ccbf23fede9be11ca3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:10.527668 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe4356-033f-41e8-9024-fb79a3528198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b02fb146de40ccbf23fede9be11ca3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:10.530149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe4356-033f-41e8-9024-fb79a3528198 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:10.586663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83fe4356-033f-41e8-9024-fb79a3528198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b02fb146de40ccbf23fede9be11ca3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:10.589513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:10.598539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83fe4356-033f-41e8-9024-fb79a3528198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b02fb146de40ccbf23fede9be11ca3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:10.609171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83fe4356-033f-41e8-9024-fb79a3528198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b02fb146de40ccbf23fede9be11ca3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:10.610273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83fe4356-033f-41e8-9024-fb79a3528198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b02fb146de40ccbf23fede9be11ca3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:10.647450 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83fe4356-033f-41e8-9024-fb79a3528198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b02fb146de40ccbf23fede9be11ca3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:10.658571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 981/1983] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:10 2022] DELETE /identity/v3/users/41b02fb146de40ccbf23fede9be11ca3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:11.127303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:11.128863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:11.145340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf71ee-b929-48e0-8991-18dbf81b79ec admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:11.258985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a70aa-2a77-4e93-87af-8834c7b52e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:11.260250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a70aa-2a77-4e93-87af-8834c7b52e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:11.260923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a70aa-2a77-4e93-87af-8834c7b52e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:11.261655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a70aa-2a77-4e93-87af-8834c7b52e68 admin admin] PATH_INFO: `/v3/projects/b6ecc6ec46de4e3484121380a90802e7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:11.263163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a70aa-2a77-4e93-87af-8834c7b52e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ecc6ec46de4e3484121380a90802e7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:11.265723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a70aa-2a77-4e93-87af-8834c7b52e68 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:11.345721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-263a70aa-2a77-4e93-87af-8834c7b52e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ecc6ec46de4e3484121380a90802e7', 'request_id': 'req-263a70aa-2a77-4e93-87af-8834c7b52e68'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:11.367586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-263a70aa-2a77-4e93-87af-8834c7b52e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ecc6ec46de4e3484121380a90802e7', 'request_id': 'req-263a70aa-2a77-4e93-87af-8834c7b52e68'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:11.381920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-263a70aa-2a77-4e93-87af-8834c7b52e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ecc6ec46de4e3484121380a90802e7', 'request_id': 'req-263a70aa-2a77-4e93-87af-8834c7b52e68'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:11.418505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-263a70aa-2a77-4e93-87af-8834c7b52e68 admin admin] The token cache is being invalidate because project b6ecc6ec46de4e3484121380a90802e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:11.419070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-263a70aa-2a77-4e93-87af-8834c7b52e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:11.420292 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-263a70aa-2a77-4e93-87af-8834c7b52e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:11.422301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1003/1984] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:11 2022] DELETE /identity/v3/projects/b6ecc6ec46de4e3484121380a90802e7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:11.428469 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bb671-c331-48f2-91e9-83e5a927f482 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:11.428806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bb671-c331-48f2-91e9-83e5a927f482 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:11.429115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bb671-c331-48f2-91e9-83e5a927f482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:11.456784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0e8bb671-c331-48f2-91e9-83e5a927f482 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:11.458180 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0e8bb671-c331-48f2-91e9-83e5a927f482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:11.565606 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 982/1985] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:11.572253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43851-f70a-4ac1-bd92-edb9663ba467 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:11.572621 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43851-f70a-4ac1-bd92-edb9663ba467 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:11.573045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43851-f70a-4ac1-bd92-edb9663ba467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:11.598065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-56b43851-f70a-4ac1-bd92-edb9663ba467 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:11.599322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-56b43851-f70a-4ac1-bd92-edb9663ba467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:11.611515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1004/1986] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:11.615950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bb671-c331-48f2-91e9-83e5a927f482 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:11.638749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bb671-c331-48f2-91e9-83e5a927f482 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:11.649334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be184dd2-3e4a-4254-98db-6e476fa3f800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:11.650144 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be184dd2-3e4a-4254-98db-6e476fa3f800 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:11.650426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be184dd2-3e4a-4254-98db-6e476fa3f800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:11.650684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be184dd2-3e4a-4254-98db-6e476fa3f800 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:11.651890 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be184dd2-3e4a-4254-98db-6e476fa3f800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:11.652752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be184dd2-3e4a-4254-98db-6e476fa3f800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:11.654974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be184dd2-3e4a-4254-98db-6e476fa3f800 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:11.669595 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 983/1987] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:15:11.675077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b43851-f70a-4ac1-bd92-edb9663ba467 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:11.689586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b43851-f70a-4ac1-bd92-edb9663ba467 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:11.699740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758d6a5-b8d9-4a44-b4da-2179af07d100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:11.700388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758d6a5-b8d9-4a44-b4da-2179af07d100 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:11.700753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758d6a5-b8d9-4a44-b4da-2179af07d100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:11.701522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758d6a5-b8d9-4a44-b4da-2179af07d100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:11.702500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758d6a5-b8d9-4a44-b4da-2179af07d100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:11.704963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758d6a5-b8d9-4a44-b4da-2179af07d100 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:11.711899 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:11.756258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1005/1988] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:11 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:11.760699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be184dd2-3e4a-4254-98db-6e476fa3f800 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:11.774873 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be184dd2-3e4a-4254-98db-6e476fa3f800 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:11.866315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6440c2-a497-474e-8a7a-9f4cbd94d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:11.867663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6440c2-a497-474e-8a7a-9f4cbd94d72c admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:11.868297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6440c2-a497-474e-8a7a-9f4cbd94d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:11.868713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6440c2-a497-474e-8a7a-9f4cbd94d72c admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:11.869620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6440c2-a497-474e-8a7a-9f4cbd94d72c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:11.872655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6440c2-a497-474e-8a7a-9f4cbd94d72c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:11.911810 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758d6a5-b8d9-4a44-b4da-2179af07d100 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:11.914090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7758d6a5-b8d9-4a44-b4da-2179af07d100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:11.922002 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 984/1989] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:11 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:11.926577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6440c2-a497-474e-8a7a-9f4cbd94d72c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:11.938833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758d6a5-b8d9-4a44-b4da-2179af07d100 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:11.949286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc74c45-bc0d-459e-8381-381c80e82b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:11.952808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc74c45-bc0d-459e-8381-381c80e82b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:11.953267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc74c45-bc0d-459e-8381-381c80e82b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:11.953562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc74c45-bc0d-459e-8381-381c80e82b7d admin admin] PATH_INFO: `/v3/users/9de318c1c96440e490bf1dd2d97caedf` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:11.958490 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc74c45-bc0d-459e-8381-381c80e82b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de318c1c96440e490bf1dd2d97caedf)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:11.963288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6440c2-a497-474e-8a7a-9f4cbd94d72c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:11.963500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc74c45-bc0d-459e-8381-381c80e82b7d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:11.969941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcad0c-2b77-47f3-a315-d2aa319173ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:11.970741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcad0c-2b77-47f3-a315-d2aa319173ba admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:11.971024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcad0c-2b77-47f3-a315-d2aa319173ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:11.971301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcad0c-2b77-47f3-a315-d2aa319173ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:11.972181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcad0c-2b77-47f3-a315-d2aa319173ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:11.973947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcad0c-2b77-47f3-a315-d2aa319173ba admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:11.988118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 985/1990] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:11.988975 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcad0c-2b77-47f3-a315-d2aa319173ba admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:11.999746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcad0c-2b77-47f3-a315-d2aa319173ba admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:12.005580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f5d03-b1e0-409e-8f6e-88d18f57efea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:12.006356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f5d03-b1e0-409e-8f6e-88d18f57efea admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:12.006788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f5d03-b1e0-409e-8f6e-88d18f57efea admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:12.007063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f5d03-b1e0-409e-8f6e-88d18f57efea admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:12.007839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f5d03-b1e0-409e-8f6e-88d18f57efea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:12.009813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f5d03-b1e0-409e-8f6e-88d18f57efea admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:12.028931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 986/1991] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:12.033915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f5d03-b1e0-409e-8f6e-88d18f57efea admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:12.073695 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f5d03-b1e0-409e-8f6e-88d18f57efea admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:12.088198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065c26b-b946-49d9-b156-693bfba09618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:12.088198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c26b-b946-49d9-b156-693bfba09618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:12.088529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c26b-b946-49d9-b156-693bfba09618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:12.088724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065c26b-b946-49d9-b156-693bfba09618 admin admin] PATH_INFO: `/v3/projects/74a2c81d61e64127bae590f620044dfa/users/a51fa289d2ee4f63b0fcdb62c79aad50/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:12.102450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5bc74c45-bc0d-459e-8381-381c80e82b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de318c1c96440e490bf1dd2d97caedf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:12.104563 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5bc74c45-bc0d-459e-8381-381c80e82b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de318c1c96440e490bf1dd2d97caedf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:12.126688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5bc74c45-bc0d-459e-8381-381c80e82b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de318c1c96440e490bf1dd2d97caedf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:12.127463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5bc74c45-bc0d-459e-8381-381c80e82b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de318c1c96440e490bf1dd2d97caedf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:12.129523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065c26b-b946-49d9-b156-693bfba09618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a2c81d61e64127bae590f620044dfa, user_id=a51fa289d2ee4f63b0fcdb62c79aad50, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:12.132328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065c26b-b946-49d9-b156-693bfba09618 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:12.142601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5bc74c45-bc0d-459e-8381-381c80e82b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de318c1c96440e490bf1dd2d97caedf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:12.150643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:12.159893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 987/1992] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:12 2022] PUT /identity/v3/projects/74a2c81d61e64127bae590f620044dfa/users/a51fa289d2ee4f63b0fcdb62c79aad50/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:12.169408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1006/1993] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:11 2022] DELETE /identity/v3/users/9de318c1c96440e490bf1dd2d97caedf => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:12.176491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f4622-e336-47e8-97e2-612a9396c265 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:12.178433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2c12f-daaa-4b80-89e0-1fd467acc1ae None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:12.178996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f4622-e336-47e8-97e2-612a9396c265 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:12.179452 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f4622-e336-47e8-97e2-612a9396c265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:12.180956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2c12f-daaa-4b80-89e0-1fd467acc1ae None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:12.180956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2c12f-daaa-4b80-89e0-1fd467acc1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:12.212972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-853f4622-e336-47e8-97e2-612a9396c265 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:12.216019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-853f4622-e336-47e8-97e2-612a9396c265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:12.233099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-26f2c12f-daaa-4b80-89e0-1fd467acc1ae None None] MFA Rules not processed for user `a51fa289d2ee4f63b0fcdb62c79aad50`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:12.234870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-26f2c12f-daaa-4b80-89e0-1fd467acc1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:12.334634 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1007/1994] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:12.346795 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f4622-e336-47e8-97e2-612a9396c265 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:12.349661 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-853f4622-e336-47e8-97e2-612a9396c265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:12.372804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 988/1995] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:12.380220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2c12f-daaa-4b80-89e0-1fd467acc1ae None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:12.384076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-26f2c12f-daaa-4b80-89e0-1fd467acc1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:12.408510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2c12f-daaa-4b80-89e0-1fd467acc1ae None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:12.445948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2a129-36be-4ef6-b870-2b5a965b0721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:12.446672 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2a129-36be-4ef6-b870-2b5a965b0721 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:12.446957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2a129-36be-4ef6-b870-2b5a965b0721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:12.447233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2a129-36be-4ef6-b870-2b5a965b0721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:12.447985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2a129-36be-4ef6-b870-2b5a965b0721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:12.449970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2a129-36be-4ef6-b870-2b5a965b0721 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:12.457469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f4622-e336-47e8-97e2-612a9396c265 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:12.462030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0203b-0c85-44a9-99f1-6ce00739a66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:12.462777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0203b-0c85-44a9-99f1-6ce00739a66f service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:12.463122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0203b-0c85-44a9-99f1-6ce00739a66f service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:12.464033 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0203b-0c85-44a9-99f1-6ce00739a66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:12.474860 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0203b-0c85-44a9-99f1-6ce00739a66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:12.476710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0203b-0c85-44a9-99f1-6ce00739a66f service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:12.489772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1008/1996] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:12.510400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 989/1997] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:12 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:12.511839 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0203b-0c85-44a9-99f1-6ce00739a66f service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:12.517432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:12.524717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0203b-0c85-44a9-99f1-6ce00739a66f service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:12.606474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b72112-1ab0-47c6-a3b5-c836bff92ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:12.607618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b72112-1ab0-47c6-a3b5-c836bff92ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:12.608055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b72112-1ab0-47c6-a3b5-c836bff92ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:12.608341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b72112-1ab0-47c6-a3b5-c836bff92ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:12.611524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b72112-1ab0-47c6-a3b5-c836bff92ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:12.613879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b72112-1ab0-47c6-a3b5-c836bff92ae2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:12.654943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1009/1998] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:12 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:12.659504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2a129-36be-4ef6-b870-2b5a965b0721 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:12.671489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2a129-36be-4ef6-b870-2b5a965b0721 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:12.678233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72511ca-b28e-4d76-8fd4-f05b670f5cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:12.679187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72511ca-b28e-4d76-8fd4-f05b670f5cce admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:12.679614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72511ca-b28e-4d76-8fd4-f05b670f5cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:12.680083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72511ca-b28e-4d76-8fd4-f05b670f5cce admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:12.680808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72511ca-b28e-4d76-8fd4-f05b670f5cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:12.682667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72511ca-b28e-4d76-8fd4-f05b670f5cce admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:12.694613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 990/1999] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:15:12.699020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b72112-1ab0-47c6-a3b5-c836bff92ae2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:12.710952 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b72112-1ab0-47c6-a3b5-c836bff92ae2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:12.717888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153354e-9aed-46be-8b11-d27281fb5899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:12.718938 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153354e-9aed-46be-8b11-d27281fb5899 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:12.719454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153354e-9aed-46be-8b11-d27281fb5899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:12.719880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153354e-9aed-46be-8b11-d27281fb5899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:12.721142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153354e-9aed-46be-8b11-d27281fb5899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:12.724073 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153354e-9aed-46be-8b11-d27281fb5899 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:12.743995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1010/2000] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:15:12.745237 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72511ca-b28e-4d76-8fd4-f05b670f5cce admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:12.765859 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72511ca-b28e-4d76-8fd4-f05b670f5cce admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:12.778712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8cdc0-b54e-44d1-a87e-35d9a29b3ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:12.779820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8cdc0-b54e-44d1-a87e-35d9a29b3ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:12.780223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8cdc0-b54e-44d1-a87e-35d9a29b3ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:12.780477 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8cdc0-b54e-44d1-a87e-35d9a29b3ac8 admin admin] PATH_INFO: `/v3/projects/7cbab49b36cb432abfdf86d12da692c3/users/7e78df08849347acb55e3b86c565f97b/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:12.803528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8cdc0-b54e-44d1-a87e-35d9a29b3ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cbab49b36cb432abfdf86d12da692c3, user_id=7e78df08849347acb55e3b86c565f97b, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:12.807150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8cdc0-b54e-44d1-a87e-35d9a29b3ac8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:12.824914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 991/2001] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:12 2022] PUT /identity/v3/projects/7cbab49b36cb432abfdf86d12da692c3/users/7e78df08849347acb55e3b86c565f97b/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:12.836679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280914ea-ba73-4a08-ba11-902a56f4806d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:12.837738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280914ea-ba73-4a08-ba11-902a56f4806d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:12.838030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280914ea-ba73-4a08-ba11-902a56f4806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:12.884147 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-280914ea-ba73-4a08-ba11-902a56f4806d None None] MFA Rules not processed for user `7e78df08849347acb55e3b86c565f97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:12.886345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-280914ea-ba73-4a08-ba11-902a56f4806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:13.059068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1011/2002] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:13.063749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8cdc0-b54e-44d1-a87e-35d9a29b3ac8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:13.101606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280914ea-ba73-4a08-ba11-902a56f4806d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:13.104040 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-280914ea-ba73-4a08-ba11-902a56f4806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:13.175277 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8cdc0-b54e-44d1-a87e-35d9a29b3ac8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:13.184644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7d886-77c8-42b9-94b8-483d2775e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:13.185406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7d886-77c8-42b9-94b8-483d2775e8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:13.185955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7d886-77c8-42b9-94b8-483d2775e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:13.186789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7d886-77c8-42b9-94b8-483d2775e8a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:13.187125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7d886-77c8-42b9-94b8-483d2775e8a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:13.189298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7d886-77c8-42b9-94b8-483d2775e8a1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:13.201768 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280914ea-ba73-4a08-ba11-902a56f4806d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:13.208671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e44cf6-ec08-4a97-b99c-d6cf173e0291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:13.209606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e44cf6-ec08-4a97-b99c-d6cf173e0291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:13.209939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e44cf6-ec08-4a97-b99c-d6cf173e0291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:13.210317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e44cf6-ec08-4a97-b99c-d6cf173e0291 admin admin] PATH_INFO: `/v3/users/7812f08158f54169b25b0a5398b57276` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:13.212296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e44cf6-ec08-4a97-b99c-d6cf173e0291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7812f08158f54169b25b0a5398b57276)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:13.215338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e44cf6-ec08-4a97-b99c-d6cf173e0291 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:13.237431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 992/2003] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:13 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:13.238893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7d886-77c8-42b9-94b8-483d2775e8a1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:13.239344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:13.275599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:13.326856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c9e44cf6-ec08-4a97-b99c-d6cf173e0291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7812f08158f54169b25b0a5398b57276'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:13.327577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c9e44cf6-ec08-4a97-b99c-d6cf173e0291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7812f08158f54169b25b0a5398b57276'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:13.345266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c9e44cf6-ec08-4a97-b99c-d6cf173e0291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7812f08158f54169b25b0a5398b57276'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:13.347209 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c9e44cf6-ec08-4a97-b99c-d6cf173e0291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7812f08158f54169b25b0a5398b57276'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:13.358382 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7d886-77c8-42b9-94b8-483d2775e8a1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:13.365357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccd585-ef2b-433a-96a8-e2391825a84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:13.366008 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccd585-ef2b-433a-96a8-e2391825a84e admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:13.366288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccd585-ef2b-433a-96a8-e2391825a84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:13.367249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccd585-ef2b-433a-96a8-e2391825a84e admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:13.367249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccd585-ef2b-433a-96a8-e2391825a84e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:13.370086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccd585-ef2b-433a-96a8-e2391825a84e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:13.391826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c9e44cf6-ec08-4a97-b99c-d6cf173e0291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7812f08158f54169b25b0a5398b57276'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:13.414321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 993/2004] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:13 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:13.415376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccd585-ef2b-433a-96a8-e2391825a84e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:13.418590 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-26ccd585-ef2b-433a-96a8-e2391825a84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:13.427231 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1012/2005] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:13 2022] DELETE /identity/v3/users/7812f08158f54169b25b0a5398b57276 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:13.430710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dab362-613b-47c8-8f35-41683e59f497 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:13.431019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dab362-613b-47c8-8f35-41683e59f497 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:13.431266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dab362-613b-47c8-8f35-41683e59f497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:13.437827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccd585-ef2b-433a-96a8-e2391825a84e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:13.469606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-86dab362-613b-47c8-8f35-41683e59f497 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:13.472773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-86dab362-613b-47c8-8f35-41683e59f497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:13.575159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28bc15-11d4-4606-b324-af52f663e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:13.577313 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28bc15-11d4-4606-b324-af52f663e440 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:13.577635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28bc15-11d4-4606-b324-af52f663e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:13.577928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28bc15-11d4-4606-b324-af52f663e440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:13.579306 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1013/2006] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:13.581671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28bc15-11d4-4606-b324-af52f663e440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:13.583626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28bc15-11d4-4606-b324-af52f663e440 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:13.600140 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 994/2007] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:13.601632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dab362-613b-47c8-8f35-41683e59f497 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:13.603280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-86dab362-613b-47c8-8f35-41683e59f497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:13.613210 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28bc15-11d4-4606-b324-af52f663e440 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:13.636381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dab362-613b-47c8-8f35-41683e59f497 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:13.644373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28bc15-11d4-4606-b324-af52f663e440 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:13.647433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:13.648112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:13.648389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:13.648665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] PATH_INFO: `/v3/projects/86f0d0247ff14d77b7a19f9e4395e823` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:13.650982 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f0d0247ff14d77b7a19f9e4395e823)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:13.653455 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:13.659149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18013166-1c82-4300-a37f-b79e3d073ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:13.659779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18013166-1c82-4300-a37f-b79e3d073ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:13.660341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18013166-1c82-4300-a37f-b79e3d073ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:13.660341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18013166-1c82-4300-a37f-b79e3d073ad9 admin admin] PATH_INFO: `/v3/projects/a850d60b580843179709efcb3a1ffdbd/users/3c0ae5fdb9c54d959b3699dfe61c8be4/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:13.700509 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18013166-1c82-4300-a37f-b79e3d073ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a850d60b580843179709efcb3a1ffdbd, user_id=3c0ae5fdb9c54d959b3699dfe61c8be4, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:13.703255 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18013166-1c82-4300-a37f-b79e3d073ad9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:13.723805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 995/2008] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:13 2022] PUT /identity/v3/projects/a850d60b580843179709efcb3a1ffdbd/users/3c0ae5fdb9c54d959b3699dfe61c8be4/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:13.724471 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18013166-1c82-4300-a37f-b79e3d073ad9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:13.726458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-18013166-1c82-4300-a37f-b79e3d073ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:13.734687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f0d0247ff14d77b7a19f9e4395e823', 'request_id': 'req-70c15670-824e-4f67-a080-71257dc622c4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:13.745615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f0d0247ff14d77b7a19f9e4395e823', 'request_id': 'req-70c15670-824e-4f67-a080-71257dc622c4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:13.754166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f0d0247ff14d77b7a19f9e4395e823', 'request_id': 'req-70c15670-824e-4f67-a080-71257dc622c4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:13.769747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] The token cache is being invalidate because project 86f0d0247ff14d77b7a19f9e4395e823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:13.770052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:13.771478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:13.774168 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1014/2009] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:13 2022] DELETE /identity/v3/projects/86f0d0247ff14d77b7a19f9e4395e823 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:13.775087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:13.776999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:13.798045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:13.798747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18013166-1c82-4300-a37f-b79e3d073ad9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:13.804149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c04071-8245-4a8b-9e48-f289b8547c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:13.804585 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04071-8245-4a8b-9e48-f289b8547c26 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:13.804872 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04071-8245-4a8b-9e48-f289b8547c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:13.805190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04071-8245-4a8b-9e48-f289b8547c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:13.807754 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-71c04071-8245-4a8b-9e48-f289b8547c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:13.846703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:13.881436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c15670-824e-4f67-a080-71257dc622c4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:13.898660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c04071-8245-4a8b-9e48-f289b8547c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:13.900410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c04071-8245-4a8b-9e48-f289b8547c26 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:13.911736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 996/2010] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:13.912838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c04071-8245-4a8b-9e48-f289b8547c26 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:13.914605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-71c04071-8245-4a8b-9e48-f289b8547c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:13.927189 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c04071-8245-4a8b-9e48-f289b8547c26 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:13.933470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80251de-4c2d-46a9-9a13-d252a1bb374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:13.934215 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80251de-4c2d-46a9-9a13-d252a1bb374d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:13.934566 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80251de-4c2d-46a9-9a13-d252a1bb374d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:13.935606 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80251de-4c2d-46a9-9a13-d252a1bb374d admin admin] PATH_INFO: `/v3/users/567d0a707c90416e927c511fad5cf2f4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:13.936886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80251de-4c2d-46a9-9a13-d252a1bb374d admin admin] RBAC: Authorizing `identity:delete_user(user_id=567d0a707c90416e927c511fad5cf2f4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:13.939301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80251de-4c2d-46a9-9a13-d252a1bb374d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:13.959933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61b9f5-791f-43d7-bd5d-2cee54187680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:13.960702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61b9f5-791f-43d7-bd5d-2cee54187680 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:13.961024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61b9f5-791f-43d7-bd5d-2cee54187680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:13.961303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61b9f5-791f-43d7-bd5d-2cee54187680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:13.962153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61b9f5-791f-43d7-bd5d-2cee54187680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:13.963835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61b9f5-791f-43d7-bd5d-2cee54187680 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:13.976755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1015/2011] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:13.981403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61b9f5-791f-43d7-bd5d-2cee54187680 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:13.994305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61b9f5-791f-43d7-bd5d-2cee54187680 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:14.003434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2b698-1394-4b89-a29b-ee72a896788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:14.004304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2b698-1394-4b89-a29b-ee72a896788b admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:14.004793 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2b698-1394-4b89-a29b-ee72a896788b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:14.005184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2b698-1394-4b89-a29b-ee72a896788b admin admin] PATH_INFO: `/v3/projects/a850d60b580843179709efcb3a1ffdbd/users/3c0ae5fdb9c54d959b3699dfe61c8be4/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:14.007728 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2b698-1394-4b89-a29b-ee72a896788b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a850d60b580843179709efcb3a1ffdbd, user_id=3c0ae5fdb9c54d959b3699dfe61c8be4, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:14.011528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2b698-1394-4b89-a29b-ee72a896788b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:14.024468 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c80251de-4c2d-46a9-9a13-d252a1bb374d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567d0a707c90416e927c511fad5cf2f4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.031849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1016/2012] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:13 2022] PUT /identity/v3/projects/a850d60b580843179709efcb3a1ffdbd/users/3c0ae5fdb9c54d959b3699dfe61c8be4/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:14.034016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c80251de-4c2d-46a9-9a13-d252a1bb374d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567d0a707c90416e927c511fad5cf2f4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.042195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2b698-1394-4b89-a29b-ee72a896788b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:14.044147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c80251de-4c2d-46a9-9a13-d252a1bb374d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567d0a707c90416e927c511fad5cf2f4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.044374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-01c2b698-1394-4b89-a29b-ee72a896788b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:14.045118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c80251de-4c2d-46a9-9a13-d252a1bb374d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567d0a707c90416e927c511fad5cf2f4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.072217 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c80251de-4c2d-46a9-9a13-d252a1bb374d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567d0a707c90416e927c511fad5cf2f4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.106175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 997/2013] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:13 2022] DELETE /identity/v3/users/567d0a707c90416e927c511fad5cf2f4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:14.108054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f9f0-fa7f-4a28-92ff-a9a3e5b963bf None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:14.108526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f9f0-fa7f-4a28-92ff-a9a3e5b963bf None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:14.109815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f9f0-fa7f-4a28-92ff-a9a3e5b963bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:14.153657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-52f3f9f0-fa7f-4a28-92ff-a9a3e5b963bf None None] MFA Rules not processed for user `3c0ae5fdb9c54d959b3699dfe61c8be4`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:14.157029 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-52f3f9f0-fa7f-4a28-92ff-a9a3e5b963bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:14.183084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2b698-1394-4b89-a29b-ee72a896788b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:14.300483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 998/2014] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:14.321328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3f9f0-fa7f-4a28-92ff-a9a3e5b963bf None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:14.323581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-52f3f9f0-fa7f-4a28-92ff-a9a3e5b963bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:14.340301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:14.366873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:14.367655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:14.368008 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:14.368381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] PATH_INFO: `/v3/users/15bcd9f971634cebae306dcb7fdf7517` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:14.373882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] RBAC: Authorizing `identity:delete_user(user_id=15bcd9f971634cebae306dcb7fdf7517)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:14.376045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:14.383095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:14.451288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3f9f0-fa7f-4a28-92ff-a9a3e5b963bf None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:14.460872 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c19d0-869b-462d-95a4-2b0cbefad9fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:14.463377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c19d0-869b-462d-95a4-2b0cbefad9fe service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:14.464711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c19d0-869b-462d-95a4-2b0cbefad9fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:14.466399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c19d0-869b-462d-95a4-2b0cbefad9fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:14.467512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15bcd9f971634cebae306dcb7fdf7517'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.468409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15bcd9f971634cebae306dcb7fdf7517'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.473082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b40c19d0-869b-462d-95a4-2b0cbefad9fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:14.493608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15bcd9f971634cebae306dcb7fdf7517'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.494524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15bcd9f971634cebae306dcb7fdf7517'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.516265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15bcd9f971634cebae306dcb7fdf7517'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.536509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1017/2015] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:14 2022] DELETE /identity/v3/users/15bcd9f971634cebae306dcb7fdf7517 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:14.540362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:14.544023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:14.560941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c19d0-869b-462d-95a4-2b0cbefad9fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:14.563729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c19d0-869b-462d-95a4-2b0cbefad9fe service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:14.579878 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 999/2016] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:15:14.701003 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4a06e-7469-47ba-88cd-b1c0f9cb676b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:14.709260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:14.710401 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:14.711555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:14.712193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] PATH_INFO: `/v3/projects/8a54b1a289344aeabff94a47f16abe07` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:14.713916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a54b1a289344aeabff94a47f16abe07)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:14.716735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:14.809129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a54b1a289344aeabff94a47f16abe07', 'request_id': 'req-1cc11741-6803-4245-a3d6-78c6a17a836b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.815641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c19d0-869b-462d-95a4-2b0cbefad9fe service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:14.817431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b40c19d0-869b-462d-95a4-2b0cbefad9fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:14.825218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a54b1a289344aeabff94a47f16abe07', 'request_id': 'req-1cc11741-6803-4245-a3d6-78c6a17a836b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.851556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a54b1a289344aeabff94a47f16abe07', 'request_id': 'req-1cc11741-6803-4245-a3d6-78c6a17a836b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.863701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:14.872840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] The token cache is being invalidate because project 8a54b1a289344aeabff94a47f16abe07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:14.874251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.876504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:14.879970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1018/2017] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:14 2022] DELETE /identity/v3/projects/8a54b1a289344aeabff94a47f16abe07 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:14.923050 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:14.925230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:14.934658 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c19d0-869b-462d-95a4-2b0cbefad9fe service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:15.067213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec345f-6484-4a86-aa2d-72b34299831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:15.068330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec345f-6484-4a86-aa2d-72b34299831e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.068842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec345f-6484-4a86-aa2d-72b34299831e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.069518 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec345f-6484-4a86-aa2d-72b34299831e admin admin] PATH_INFO: `/v3/projects/41b30043ff8e43dc8e9def65f05c00ce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.071310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec345f-6484-4a86-aa2d-72b34299831e admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b30043ff8e43dc8e9def65f05c00ce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:15.073651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec345f-6484-4a86-aa2d-72b34299831e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:15.108674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc11741-6803-4245-a3d6-78c6a17a836b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:15.115404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:15.116501 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.117065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.117520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] PATH_INFO: `/v3/projects/b016214ad494450b8cf2c4673bac987d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.120058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b016214ad494450b8cf2c4673bac987d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:15.123655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:15.182948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-85ec345f-6484-4a86-aa2d-72b34299831e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b30043ff8e43dc8e9def65f05c00ce', 'request_id': 'req-85ec345f-6484-4a86-aa2d-72b34299831e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.195311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-85ec345f-6484-4a86-aa2d-72b34299831e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b30043ff8e43dc8e9def65f05c00ce', 'request_id': 'req-85ec345f-6484-4a86-aa2d-72b34299831e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.203885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-85ec345f-6484-4a86-aa2d-72b34299831e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b30043ff8e43dc8e9def65f05c00ce', 'request_id': 'req-85ec345f-6484-4a86-aa2d-72b34299831e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.207481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b016214ad494450b8cf2c4673bac987d', 'request_id': 'req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.218532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b016214ad494450b8cf2c4673bac987d', 'request_id': 'req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.222528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-85ec345f-6484-4a86-aa2d-72b34299831e admin admin] The token cache is being invalidate because project 41b30043ff8e43dc8e9def65f05c00ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:15.222897 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-85ec345f-6484-4a86-aa2d-72b34299831e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.223514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-85ec345f-6484-4a86-aa2d-72b34299831e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.225567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1000/2018] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:14 2022] DELETE /identity/v3/projects/41b30043ff8e43dc8e9def65f05c00ce => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:15.227635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b016214ad494450b8cf2c4673bac987d', 'request_id': 'req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.231402 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2731c-2376-4ed7-a7fd-268e473add23 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.231737 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2731c-2376-4ed7-a7fd-268e473add23 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.232025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2731c-2376-4ed7-a7fd-268e473add23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.241524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] The token cache is being invalidate because project b016214ad494450b8cf2c4673bac987d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:15.241821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.243409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.244390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1019/2019] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:14 2022] DELETE /identity/v3/projects/b016214ad494450b8cf2c4673bac987d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:15.248883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:15.250842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:15.260268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-30a2731c-2376-4ed7-a7fd-268e473add23 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:15.262756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-30a2731c-2376-4ed7-a7fd-268e473add23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:15.333245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b89c1-bd34-45de-a3a1-d979f4e7c73f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:15.342031 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:15.342808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.343048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.343331 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] PATH_INFO: `/v3/users/7be8308727f9430b88576ecf4d4fe4ad` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.345294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be8308727f9430b88576ecf4d4fe4ad)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:15.347566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:15.348936 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:15.372976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1001/2020] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:15.374792 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2fb17-a8ad-4de5-91eb-8bd5adb6451d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.375432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2fb17-a8ad-4de5-91eb-8bd5adb6451d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.384627 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2fb17-a8ad-4de5-91eb-8bd5adb6451d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.403854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-27d2fb17-a8ad-4de5-91eb-8bd5adb6451d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:15.405175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-27d2fb17-a8ad-4de5-91eb-8bd5adb6451d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:15.413969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1002/2021] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:15.415688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:15.418249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2fb17-a8ad-4de5-91eb-8bd5adb6451d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:15.435469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be8308727f9430b88576ecf4d4fe4ad'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.436550 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be8308727f9430b88576ecf4d4fe4ad'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.439741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2fb17-a8ad-4de5-91eb-8bd5adb6451d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:15.445908 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c61a7-3554-41da-8182-6b3d09e8ce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:15.446554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c61a7-3554-41da-8182-6b3d09e8ce15 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.446834 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c61a7-3554-41da-8182-6b3d09e8ce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.447110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c61a7-3554-41da-8182-6b3d09e8ce15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.447836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c61a7-3554-41da-8182-6b3d09e8ce15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:15.448120 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c61a7-3554-41da-8182-6b3d09e8ce15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:15.448294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be8308727f9430b88576ecf4d4fe4ad'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.449099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be8308727f9430b88576ecf4d4fe4ad'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.449909 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c61a7-3554-41da-8182-6b3d09e8ce15 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:15.463800 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1003/2022] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:15:15.468732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c61a7-3554-41da-8182-6b3d09e8ce15 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:15.470329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be8308727f9430b88576ecf4d4fe4ad'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:15.479033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1f1c61a7-3554-41da-8182-6b3d09e8ce15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:15.485423 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c61a7-3554-41da-8182-6b3d09e8ce15 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:15.490422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75677d91-4283-4c6a-8728-cd09cb9d01a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:15.491061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75677d91-4283-4c6a-8728-cd09cb9d01a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.491525 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75677d91-4283-4c6a-8728-cd09cb9d01a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.492003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75677d91-4283-4c6a-8728-cd09cb9d01a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.492647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75677d91-4283-4c6a-8728-cd09cb9d01a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:15.494683 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1020/2023] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:15 2022] DELETE /identity/v3/users/7be8308727f9430b88576ecf4d4fe4ad => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:15.494801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75677d91-4283-4c6a-8728-cd09cb9d01a8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:15.555278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:15.556932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:15.558610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1004/2024] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:15 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:15.563941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75677d91-4283-4c6a-8728-cd09cb9d01a8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:15.632655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85362b56-81ad-4d53-8563-eb4713765fb8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:15.640330 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75677d91-4283-4c6a-8728-cd09cb9d01a8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:15.646196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a92de-1dae-4724-beac-9416ffb56428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:15.646853 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a92de-1dae-4724-beac-9416ffb56428 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.647133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a92de-1dae-4724-beac-9416ffb56428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.647412 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a92de-1dae-4724-beac-9416ffb56428 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.648099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a92de-1dae-4724-beac-9416ffb56428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:15.650307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a92de-1dae-4724-beac-9416ffb56428 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:15.692297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1005/2025] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:15 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:15.696720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a92de-1dae-4724-beac-9416ffb56428 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:15.708357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a92de-1dae-4724-beac-9416ffb56428 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:15.714508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06285cda-f9a7-4830-b494-e8e15ca9f89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:15.715421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06285cda-f9a7-4830-b494-e8e15ca9f89e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.715840 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06285cda-f9a7-4830-b494-e8e15ca9f89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.716306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06285cda-f9a7-4830-b494-e8e15ca9f89e admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.717309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06285cda-f9a7-4830-b494-e8e15ca9f89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:15.720680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06285cda-f9a7-4830-b494-e8e15ca9f89e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:15.732941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1006/2026] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:15:15.733962 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f10d8-0cc0-48cd-8c61-c76cdd41f3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:15.734804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f10d8-0cc0-48cd-8c61-c76cdd41f3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.735565 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f10d8-0cc0-48cd-8c61-c76cdd41f3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.735851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f10d8-0cc0-48cd-8c61-c76cdd41f3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.737264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06285cda-f9a7-4830-b494-e8e15ca9f89e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:15.738201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-371f10d8-0cc0-48cd-8c61-c76cdd41f3b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:15.748067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06285cda-f9a7-4830-b494-e8e15ca9f89e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:15.754212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f458b-e047-408d-af5a-d7742bfe55ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:15.755007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f458b-e047-408d-af5a-d7742bfe55ba admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.755225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f458b-e047-408d-af5a-d7742bfe55ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.755461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f458b-e047-408d-af5a-d7742bfe55ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.756348 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f458b-e047-408d-af5a-d7742bfe55ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:15.758263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f458b-e047-408d-af5a-d7742bfe55ba admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:15.785248 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1007/2027] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:15.789367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f458b-e047-408d-af5a-d7742bfe55ba admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:15.802858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f458b-e047-408d-af5a-d7742bfe55ba admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:15.808285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5781887-ab16-480a-bb0b-4f8e3e8fbeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:15.808854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5781887-ab16-480a-bb0b-4f8e3e8fbeb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.809251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5781887-ab16-480a-bb0b-4f8e3e8fbeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.809464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5781887-ab16-480a-bb0b-4f8e3e8fbeb9 admin admin] PATH_INFO: `/v3/projects/056acb2ccf7343cf8cf52fd0164a6135/users/2c71fba2492543a4b64595c3a6dcc95f/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.826686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5781887-ab16-480a-bb0b-4f8e3e8fbeb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056acb2ccf7343cf8cf52fd0164a6135, user_id=2c71fba2492543a4b64595c3a6dcc95f, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:15.829657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5781887-ab16-480a-bb0b-4f8e3e8fbeb9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:15.833211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f10d8-0cc0-48cd-8c61-c76cdd41f3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:15.836237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f10d8-0cc0-48cd-8c61-c76cdd41f3b0 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:15.845425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1008/2028] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:15 2022] PUT /identity/v3/projects/056acb2ccf7343cf8cf52fd0164a6135/users/2c71fba2492543a4b64595c3a6dcc95f/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:15.849997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5781887-ab16-480a-bb0b-4f8e3e8fbeb9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:15.850183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1021/2029] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:15:15.851919 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c5781887-ab16-480a-bb0b-4f8e3e8fbeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:15.855961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693cc3-1b49-4b3f-9549-9c78fdb6c39b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.856360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693cc3-1b49-4b3f-9549-9c78fdb6c39b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.856652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67693cc3-1b49-4b3f-9549-9c78fdb6c39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.888153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-67693cc3-1b49-4b3f-9549-9c78fdb6c39b None None] MFA Rules not processed for user `2c71fba2492543a4b64595c3a6dcc95f`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:15.889492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-67693cc3-1b49-4b3f-9549-9c78fdb6c39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:15.900392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:15.932110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5781887-ab16-480a-bb0b-4f8e3e8fbeb9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:15.939009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:15.939677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:15.939957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:15.940417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd admin admin] PATH_INFO: `/v3/projects/01d5fdd9054a44b28957ba69c41a9839` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:15.941642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d5fdd9054a44b28957ba69c41a9839)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:15.944150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:15.946288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:15.977348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1022/2030] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:15.982046 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693cc3-1b49-4b3f-9549-9c78fdb6c39b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:15.995438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67693cc3-1b49-4b3f-9549-9c78fdb6c39b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:16.017035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d5fdd9054a44b28957ba69c41a9839', 'request_id': 'req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:16.028227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d5fdd9054a44b28957ba69c41a9839', 'request_id': 'req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:16.039693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d5fdd9054a44b28957ba69c41a9839', 'request_id': 'req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:16.069096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd admin admin] The token cache is being invalidate because project 01d5fdd9054a44b28957ba69c41a9839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:16.069631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:16.071452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2272b84a-60bd-4d1d-8ce1-2bdb027505bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:16.076539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1009/2031] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:15 2022] DELETE /identity/v3/projects/01d5fdd9054a44b28957ba69c41a9839 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:16.081413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81a0f1-9bec-4484-9bc2-50c5e87a6458 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.081786 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81a0f1-9bec-4484-9bc2-50c5e87a6458 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.082137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81a0f1-9bec-4484-9bc2-50c5e87a6458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.092143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a41b2-cc30-4b89-911a-0f7e49a582cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:16.093113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a41b2-cc30-4b89-911a-0f7e49a582cf admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.093537 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a41b2-cc30-4b89-911a-0f7e49a582cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.093888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a41b2-cc30-4b89-911a-0f7e49a582cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.094747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a41b2-cc30-4b89-911a-0f7e49a582cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:16.097770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a41b2-cc30-4b89-911a-0f7e49a582cf admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:16.124061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-fd81a0f1-9bec-4484-9bc2-50c5e87a6458 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:16.125431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fd81a0f1-9bec-4484-9bc2-50c5e87a6458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:16.139275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1010/2032] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:16.147676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af5567-98af-42a4-adcc-3a37c28eb3a7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.148055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af5567-98af-42a4-adcc-3a37c28eb3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.148401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af5567-98af-42a4-adcc-3a37c28eb3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.152822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1023/2033] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:15 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:16.159084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a41b2-cc30-4b89-911a-0f7e49a582cf admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:16.166161 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-580a41b2-cc30-4b89-911a-0f7e49a582cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:16.246123 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d1af5567-98af-42a4-adcc-3a37c28eb3a7 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:16.249888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d1af5567-98af-42a4-adcc-3a37c28eb3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:16.273103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a41b2-cc30-4b89-911a-0f7e49a582cf admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:16.274957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1011/2034] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:16.276232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af5567-98af-42a4-adcc-3a37c28eb3a7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:16.280750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47755cc4-d00a-4f72-afe4-463b450d8790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:16.281678 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47755cc4-d00a-4f72-afe4-463b450d8790 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.282027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47755cc4-d00a-4f72-afe4-463b450d8790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.282365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47755cc4-d00a-4f72-afe4-463b450d8790 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.283193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47755cc4-d00a-4f72-afe4-463b450d8790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:16.285915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47755cc4-d00a-4f72-afe4-463b450d8790 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:16.302220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af5567-98af-42a4-adcc-3a37c28eb3a7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:16.335481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1024/2035] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:16 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:16.336654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47755cc4-d00a-4f72-afe4-463b450d8790 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:16.340484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3b6d1-bb89-4a5e-a3be-c88eea35f1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:16.341307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3b6d1-bb89-4a5e-a3be-c88eea35f1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.341656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3b6d1-bb89-4a5e-a3be-c88eea35f1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.342013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3b6d1-bb89-4a5e-a3be-c88eea35f1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.343187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3b6d1-bb89-4a5e-a3be-c88eea35f1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:16.347026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3b6d1-bb89-4a5e-a3be-c88eea35f1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:16.348870 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3b6d1-bb89-4a5e-a3be-c88eea35f1e8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:16.359930 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47755cc4-d00a-4f72-afe4-463b450d8790 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:16.383140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b3746-f63a-4baf-8290-e7cd374a201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:16.384046 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b3746-f63a-4baf-8290-e7cd374a201b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.384393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b3746-f63a-4baf-8290-e7cd374a201b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.385224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b3746-f63a-4baf-8290-e7cd374a201b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.385566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b3746-f63a-4baf-8290-e7cd374a201b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:16.387543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b3746-f63a-4baf-8290-e7cd374a201b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:16.388739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1012/2036] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:15:16.389950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3b6d1-bb89-4a5e-a3be-c88eea35f1e8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:16.407574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3b6d1-bb89-4a5e-a3be-c88eea35f1e8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:16.411967 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1025/2037] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:16.414416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e11e0e-8259-448a-9ee4-1d0b5281094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:16.415549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e11e0e-8259-448a-9ee4-1d0b5281094d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.415932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e11e0e-8259-448a-9ee4-1d0b5281094d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.416323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e11e0e-8259-448a-9ee4-1d0b5281094d admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.417228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e11e0e-8259-448a-9ee4-1d0b5281094d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:16.418333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b3746-f63a-4baf-8290-e7cd374a201b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:16.419802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e11e0e-8259-448a-9ee4-1d0b5281094d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:16.441806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b3746-f63a-4baf-8290-e7cd374a201b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:16.458429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dca82-8574-4277-9563-4feb302d8bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:16.459388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dca82-8574-4277-9563-4feb302d8bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.459681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dca82-8574-4277-9563-4feb302d8bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.460022 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dca82-8574-4277-9563-4feb302d8bb1 admin admin] PATH_INFO: `/v3/projects/f54d3ea9e5f64df287dd10b774d2dd16/users/1089387f399848bfafbce61e9f8172ba/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.466555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1013/2038] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:16 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:16.473702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e11e0e-8259-448a-9ee4-1d0b5281094d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:16.490687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:16.501535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dca82-8574-4277-9563-4feb302d8bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54d3ea9e5f64df287dd10b774d2dd16, user_id=1089387f399848bfafbce61e9f8172ba, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:16.504309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dca82-8574-4277-9563-4feb302d8bb1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:16.534011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1026/2039] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:16 2022] PUT /identity/v3/projects/f54d3ea9e5f64df287dd10b774d2dd16/users/1089387f399848bfafbce61e9f8172ba/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:16.535007 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dca82-8574-4277-9563-4feb302d8bb1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:16.567869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e11e0e-8259-448a-9ee4-1d0b5281094d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:16.644582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:16.686935 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9348a71-f7d2-470b-ae66-d5a7ab5f8d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:16.688916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9348a71-f7d2-470b-ae66-d5a7ab5f8d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.688916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9348a71-f7d2-470b-ae66-d5a7ab5f8d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.688916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9348a71-f7d2-470b-ae66-d5a7ab5f8d5c admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.688916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9348a71-f7d2-470b-ae66-d5a7ab5f8d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:16.691075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9348a71-f7d2-470b-ae66-d5a7ab5f8d5c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:16.701773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dca82-8574-4277-9563-4feb302d8bb1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:16.706748 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486cb42-4ac3-4f1a-8c51-0105b67f2631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:16.707416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486cb42-4ac3-4f1a-8c51-0105b67f2631 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.707699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486cb42-4ac3-4f1a-8c51-0105b67f2631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.708040 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486cb42-4ac3-4f1a-8c51-0105b67f2631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.708790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486cb42-4ac3-4f1a-8c51-0105b67f2631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:16.710711 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486cb42-4ac3-4f1a-8c51-0105b67f2631 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:16.723664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1014/2040] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:16 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:16.727698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9348a71-f7d2-470b-ae66-d5a7ab5f8d5c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:16.732253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1027/2041] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:16.736968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486cb42-4ac3-4f1a-8c51-0105b67f2631 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:16.746080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9348a71-f7d2-470b-ae66-d5a7ab5f8d5c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:16.753409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486cb42-4ac3-4f1a-8c51-0105b67f2631 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:16.756366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f39b84-bde3-4915-aa53-72676cba75ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:16.757231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39b84-bde3-4915-aa53-72676cba75ba admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.757591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39b84-bde3-4915-aa53-72676cba75ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.758205 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39b84-bde3-4915-aa53-72676cba75ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.759131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f39b84-bde3-4915-aa53-72676cba75ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:16.761331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f39b84-bde3-4915-aa53-72676cba75ba admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:16.769178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d622eb-a2af-4c6a-a151-39f10831e3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:16.770194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d622eb-a2af-4c6a-a151-39f10831e3e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.770194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d622eb-a2af-4c6a-a151-39f10831e3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.770506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d622eb-a2af-4c6a-a151-39f10831e3e2 admin admin] PATH_INFO: `/v3/projects/f54d3ea9e5f64df287dd10b774d2dd16/users/1089387f399848bfafbce61e9f8172ba/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.773175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d622eb-a2af-4c6a-a151-39f10831e3e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54d3ea9e5f64df287dd10b774d2dd16, user_id=1089387f399848bfafbce61e9f8172ba, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:16.778552 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1015/2042] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:15:16.778733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d622eb-a2af-4c6a-a151-39f10831e3e2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:16.779871 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f39b84-bde3-4915-aa53-72676cba75ba admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:16.791114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1028/2043] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:16 2022] PUT /identity/v3/projects/f54d3ea9e5f64df287dd10b774d2dd16/users/1089387f399848bfafbce61e9f8172ba/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:16.796555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f39b84-bde3-4915-aa53-72676cba75ba admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:16.806594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab141c8c-aa23-4e78-9e44-633533edfd6b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.806889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab141c8c-aa23-4e78-9e44-633533edfd6b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.807657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab141c8c-aa23-4e78-9e44-633533edfd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.854777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ab141c8c-aa23-4e78-9e44-633533edfd6b None None] MFA Rules not processed for user `1089387f399848bfafbce61e9f8172ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:16.856607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ab141c8c-aa23-4e78-9e44-633533edfd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:16.879331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64efd3b-873b-4b66-a95f-8d6753f9e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:16.880105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64efd3b-873b-4b66-a95f-8d6753f9e9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.880459 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64efd3b-873b-4b66-a95f-8d6753f9e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.880797 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64efd3b-873b-4b66-a95f-8d6753f9e9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.881634 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64efd3b-873b-4b66-a95f-8d6753f9e9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:16.883331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64efd3b-873b-4b66-a95f-8d6753f9e9e9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:16.894473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1016/2044] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:16.899075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64efd3b-873b-4b66-a95f-8d6753f9e9e9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:16.910335 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64efd3b-873b-4b66-a95f-8d6753f9e9e9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:16.915198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4533967-b3ef-4e76-82bf-31410bd5ef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:16.915893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4533967-b3ef-4e76-82bf-31410bd5ef76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.916171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4533967-b3ef-4e76-82bf-31410bd5ef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.916450 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4533967-b3ef-4e76-82bf-31410bd5ef76 admin admin] PATH_INFO: `/v3/projects/d5b16a4a76224aefa5ad3073474d184c/users/7e78a7553e934b929b4640a3882fa423/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.934742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4533967-b3ef-4e76-82bf-31410bd5ef76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b16a4a76224aefa5ad3073474d184c, user_id=7e78a7553e934b929b4640a3882fa423, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:16.938020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4533967-b3ef-4e76-82bf-31410bd5ef76 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:16.961009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1029/2045] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:16.961771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1017/2046] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:16 2022] PUT /identity/v3/projects/d5b16a4a76224aefa5ad3073474d184c/users/7e78a7553e934b929b4640a3882fa423/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:16.969426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5ef6e-6faf-41d2-ad25-c7fe98bdb768 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:16.970217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5ef6e-6faf-41d2-ad25-c7fe98bdb768 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:16.970526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5ef6e-6faf-41d2-ad25-c7fe98bdb768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:16.971192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4533967-b3ef-4e76-82bf-31410bd5ef76 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:16.973889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c4533967-b3ef-4e76-82bf-31410bd5ef76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:17.006547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3db5ef6e-6faf-41d2-ad25-c7fe98bdb768 None None] MFA Rules not processed for user `7e78a7553e934b929b4640a3882fa423`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:17.007840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3db5ef6e-6faf-41d2-ad25-c7fe98bdb768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:17.062418 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4533967-b3ef-4e76-82bf-31410bd5ef76 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:17.073411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230870ef-8354-4009-9efd-1f429bca9826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:17.074645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230870ef-8354-4009-9efd-1f429bca9826 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:17.075064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230870ef-8354-4009-9efd-1f429bca9826 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:17.075431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230870ef-8354-4009-9efd-1f429bca9826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:17.077715 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:17.153108 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1030/2047] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:17.172580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:17.197803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230870ef-8354-4009-9efd-1f429bca9826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:17.199762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230870ef-8354-4009-9efd-1f429bca9826 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:17.217311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1018/2048] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:17.341808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5ef6e-6faf-41d2-ad25-c7fe98bdb768 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:17.357970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5ef6e-6faf-41d2-ad25-c7fe98bdb768 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:17.369543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d86d1e-3e48-41ed-9529-7c7798dec339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:17.372087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d86d1e-3e48-41ed-9529-7c7798dec339 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:17.372586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d86d1e-3e48-41ed-9529-7c7798dec339 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:17.375334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d86d1e-3e48-41ed-9529-7c7798dec339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:17.393581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d86d1e-3e48-41ed-9529-7c7798dec339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:17.396438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d86d1e-3e48-41ed-9529-7c7798dec339 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:17.416432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1031/2049] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:17.451486 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230870ef-8354-4009-9efd-1f429bca9826 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:17.453258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-230870ef-8354-4009-9efd-1f429bca9826 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:17.458480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d86d1e-3e48-41ed-9529-7c7798dec339 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:17.470660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230870ef-8354-4009-9efd-1f429bca9826 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:17.475532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864ad90-d821-4f73-8698-dbf9b9df5cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:17.476236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864ad90-d821-4f73-8698-dbf9b9df5cdd service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:17.477144 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864ad90-d821-4f73-8698-dbf9b9df5cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:17.477425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864ad90-d821-4f73-8698-dbf9b9df5cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:17.479539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2864ad90-d821-4f73-8698-dbf9b9df5cdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:17.540872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d86d1e-3e48-41ed-9529-7c7798dec339 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:17.547315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:17.552118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:17.552118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:17.552118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] PATH_INFO: `/v3/users/7e78a7553e934b929b4640a3882fa423` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:17.552118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e78a7553e934b929b4640a3882fa423)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:17.554309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:17.585259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864ad90-d821-4f73-8698-dbf9b9df5cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:17.588081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864ad90-d821-4f73-8698-dbf9b9df5cdd service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:17.612005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1019/2050] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:17.651109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e78a7553e934b929b4640a3882fa423'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:17.653261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e78a7553e934b929b4640a3882fa423'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:17.694954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e78a7553e934b929b4640a3882fa423'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:17.696124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e78a7553e934b929b4640a3882fa423'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:17.723390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e78a7553e934b929b4640a3882fa423'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:17.758530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1032/2051] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:17 2022] DELETE /identity/v3/users/7e78a7553e934b929b4640a3882fa423 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:17.765258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd0386-d183-4e78-b215-9baffcc8df01 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:17.765526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd0386-d183-4e78-b215-9baffcc8df01 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:17.765805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd0386-d183-4e78-b215-9baffcc8df01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:17.792318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a6bd0386-d183-4e78-b215-9baffcc8df01 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:17.793538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a6bd0386-d183-4e78-b215-9baffcc8df01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:17.951640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1020/2052] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:17.979474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:17.981120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:18.090490 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4040c6-7796-42c5-8f40-7c7ad960dab3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:18.096148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d6686-c5bd-4e7e-bd51-fbe2aee02274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:18.097514 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d6686-c5bd-4e7e-bd51-fbe2aee02274 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:18.097831 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d6686-c5bd-4e7e-bd51-fbe2aee02274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:18.098158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d6686-c5bd-4e7e-bd51-fbe2aee02274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:18.108493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:18.111407 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d6686-c5bd-4e7e-bd51-fbe2aee02274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:18.112870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d6686-c5bd-4e7e-bd51-fbe2aee02274 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:18.134114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1033/2053] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:18.554837 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd0386-d183-4e78-b215-9baffcc8df01 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:18.556435 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a6bd0386-d183-4e78-b215-9baffcc8df01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:18.575600 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd0386-d183-4e78-b215-9baffcc8df01 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:18.592090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:18.592981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:18.593453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:18.593715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662 admin admin] PATH_INFO: `/v3/projects/d5b16a4a76224aefa5ad3073474d184c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:18.594995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b16a4a76224aefa5ad3073474d184c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:18.596999 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:18.653805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b16a4a76224aefa5ad3073474d184c', 'request_id': 'req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:18.664465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b16a4a76224aefa5ad3073474d184c', 'request_id': 'req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:18.673697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b16a4a76224aefa5ad3073474d184c', 'request_id': 'req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:18.695224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662 admin admin] The token cache is being invalidate because project d5b16a4a76224aefa5ad3073474d184c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:18.695521 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:18.696268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bd9ac0c7-5949-42f2-bb7e-0eb50dce0662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:18.698475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1021/2054] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:18 2022] DELETE /identity/v3/projects/d5b16a4a76224aefa5ad3073474d184c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:18.703453 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875262f5-f30d-47be-bb74-b8bf651473e1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:18.703975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875262f5-f30d-47be-bb74-b8bf651473e1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:18.704112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875262f5-f30d-47be-bb74-b8bf651473e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:18.736667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-875262f5-f30d-47be-bb74-b8bf651473e1 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:18.738368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-875262f5-f30d-47be-bb74-b8bf651473e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:18.810280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1034/2055] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:18.819132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e213c28-72a6-4565-98b3-d7545ab2bf23 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:18.819413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e213c28-72a6-4565-98b3-d7545ab2bf23 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:18.819710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e213c28-72a6-4565-98b3-d7545ab2bf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:18.841785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7e213c28-72a6-4565-98b3-d7545ab2bf23 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:18.843035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7e213c28-72a6-4565-98b3-d7545ab2bf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:18.852769 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1022/2056] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:18.857362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875262f5-f30d-47be-bb74-b8bf651473e1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:18.871307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875262f5-f30d-47be-bb74-b8bf651473e1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:18.876289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bca0a5-f9e5-440b-939d-520b7efc325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:18.878228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bca0a5-f9e5-440b-939d-520b7efc325e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:18.878521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bca0a5-f9e5-440b-939d-520b7efc325e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:18.878854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bca0a5-f9e5-440b-939d-520b7efc325e admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:18.879989 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bca0a5-f9e5-440b-939d-520b7efc325e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:18.880933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bca0a5-f9e5-440b-939d-520b7efc325e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:18.882575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bca0a5-f9e5-440b-939d-520b7efc325e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:18.900015 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1035/2057] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:15:18.905062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e213c28-72a6-4565-98b3-d7545ab2bf23 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:18.917378 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:18.920787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e213c28-72a6-4565-98b3-d7545ab2bf23 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:18.927776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f226f3-bbfb-4c3e-9792-1a44b6dc7c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:18.928463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f226f3-bbfb-4c3e-9792-1a44b6dc7c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:18.928809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f226f3-bbfb-4c3e-9792-1a44b6dc7c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:18.929139 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f226f3-bbfb-4c3e-9792-1a44b6dc7c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:18.930396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f226f3-bbfb-4c3e-9792-1a44b6dc7c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:18.933333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f226f3-bbfb-4c3e-9792-1a44b6dc7c1b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:18.976567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1023/2058] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:18 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:18.979089 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bca0a5-f9e5-440b-939d-520b7efc325e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:18.992218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bca0a5-f9e5-440b-939d-520b7efc325e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:19.078351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc90e1-c02c-48ab-bcfc-cb3beee8102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:19.079771 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc90e1-c02c-48ab-bcfc-cb3beee8102e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:19.080039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc90e1-c02c-48ab-bcfc-cb3beee8102e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:19.080362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc90e1-c02c-48ab-bcfc-cb3beee8102e admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:19.081082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc90e1-c02c-48ab-bcfc-cb3beee8102e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:19.083130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc90e1-c02c-48ab-bcfc-cb3beee8102e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:19.107333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1036/2059] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:18 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:19.111584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f226f3-bbfb-4c3e-9792-1a44b6dc7c1b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:19.122460 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f226f3-bbfb-4c3e-9792-1a44b6dc7c1b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:19.127437 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bca23-7a04-4ff0-87c3-ccac52f37f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:19.128020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bca23-7a04-4ff0-87c3-ccac52f37f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:19.128295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bca23-7a04-4ff0-87c3-ccac52f37f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:19.128562 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73bca23-7a04-4ff0-87c3-ccac52f37f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:19.129296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bca23-7a04-4ff0-87c3-ccac52f37f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:19.130888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73bca23-7a04-4ff0-87c3-ccac52f37f57 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:19.142068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1024/2060] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:19.146483 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc90e1-c02c-48ab-bcfc-cb3beee8102e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:19.157281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc90e1-c02c-48ab-bcfc-cb3beee8102e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:19.162136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f84f4-9f1a-43ad-b3ea-5a236361da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:19.162759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f84f4-9f1a-43ad-b3ea-5a236361da4b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:19.163035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f84f4-9f1a-43ad-b3ea-5a236361da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:19.163303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f84f4-9f1a-43ad-b3ea-5a236361da4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:19.164000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f84f4-9f1a-43ad-b3ea-5a236361da4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:19.165634 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f84f4-9f1a-43ad-b3ea-5a236361da4b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:19.176858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1037/2061] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:15:19.181358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bca23-7a04-4ff0-87c3-ccac52f37f57 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:19.191924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73bca23-7a04-4ff0-87c3-ccac52f37f57 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:19.197177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca2ba8-a0f2-4b39-a6ba-8e8e394ba73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:19.197892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2ba8-a0f2-4b39-a6ba-8e8e394ba73a admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:19.198171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2ba8-a0f2-4b39-a6ba-8e8e394ba73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:19.198459 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca2ba8-a0f2-4b39-a6ba-8e8e394ba73a admin admin] PATH_INFO: `/v3/projects/83f3618f370541ee9c0b6826f9dfafed/users/85083765ea5246bb90601320b4b27abc/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:19.216071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca2ba8-a0f2-4b39-a6ba-8e8e394ba73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f3618f370541ee9c0b6826f9dfafed, user_id=85083765ea5246bb90601320b4b27abc, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:19.218784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca2ba8-a0f2-4b39-a6ba-8e8e394ba73a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:19.236260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1025/2062] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:19 2022] PUT /identity/v3/projects/83f3618f370541ee9c0b6826f9dfafed/users/85083765ea5246bb90601320b4b27abc/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:19.246879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296336-1467-4945-b18d-8a51ef8f5520 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:19.247171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296336-1467-4945-b18d-8a51ef8f5520 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:19.247469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c296336-1467-4945-b18d-8a51ef8f5520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:19.291185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4c296336-1467-4945-b18d-8a51ef8f5520 None None] MFA Rules not processed for user `85083765ea5246bb90601320b4b27abc`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:19.292458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4c296336-1467-4945-b18d-8a51ef8f5520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:19.392389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:19.427482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca2ba8-a0f2-4b39-a6ba-8e8e394ba73a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:19.433848 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1038/2063] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:19.532165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca2ba8-a0f2-4b39-a6ba-8e8e394ba73a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:19.537089 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d8610-9d0c-4a61-81b1-e661c47a4dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:19.538158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8610-9d0c-4a61-81b1-e661c47a4dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:19.538444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8610-9d0c-4a61-81b1-e661c47a4dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:19.538723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8610-9d0c-4a61-81b1-e661c47a4dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:19.539411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d8610-9d0c-4a61-81b1-e661c47a4dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:19.542906 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d8610-9d0c-4a61-81b1-e661c47a4dbb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:19.589230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1026/2064] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:19 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:19.593973 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c296336-1467-4945-b18d-8a51ef8f5520 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:19.608120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c296336-1467-4945-b18d-8a51ef8f5520 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:19.684617 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902db6ee-bf2c-43b0-bc78-14e1b058475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:19.685425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902db6ee-bf2c-43b0-bc78-14e1b058475f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:19.685837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902db6ee-bf2c-43b0-bc78-14e1b058475f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:19.686048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902db6ee-bf2c-43b0-bc78-14e1b058475f admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:19.686726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902db6ee-bf2c-43b0-bc78-14e1b058475f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:19.688695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902db6ee-bf2c-43b0-bc78-14e1b058475f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:19.734029 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1039/2065] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:19 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:19.742801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d8610-9d0c-4a61-81b1-e661c47a4dbb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:19.757080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d8610-9d0c-4a61-81b1-e661c47a4dbb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:19.765210 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464eb7e8-6260-40be-ac2e-67fb4f3c371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:19.765830 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464eb7e8-6260-40be-ac2e-67fb4f3c371a admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:19.766114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464eb7e8-6260-40be-ac2e-67fb4f3c371a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:19.766390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464eb7e8-6260-40be-ac2e-67fb4f3c371a admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:19.767105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464eb7e8-6260-40be-ac2e-67fb4f3c371a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:19.768933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464eb7e8-6260-40be-ac2e-67fb4f3c371a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:19.782881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1027/2066] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:19.786630 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902db6ee-bf2c-43b0-bc78-14e1b058475f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:19.799485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902db6ee-bf2c-43b0-bc78-14e1b058475f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:19.805308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acdfcb-ef6c-4b63-be44-8fb390a813b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:19.805950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acdfcb-ef6c-4b63-be44-8fb390a813b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:19.806231 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acdfcb-ef6c-4b63-be44-8fb390a813b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:19.806506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acdfcb-ef6c-4b63-be44-8fb390a813b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:19.807366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acdfcb-ef6c-4b63-be44-8fb390a813b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:19.808858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acdfcb-ef6c-4b63-be44-8fb390a813b1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:19.820885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1040/2067] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:15:19.825325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464eb7e8-6260-40be-ac2e-67fb4f3c371a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:19.837660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464eb7e8-6260-40be-ac2e-67fb4f3c371a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:19.843165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b167d4b-0513-4088-b8a6-06acbf4fa9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:19.844071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b167d4b-0513-4088-b8a6-06acbf4fa9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:19.844413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b167d4b-0513-4088-b8a6-06acbf4fa9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:19.844751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b167d4b-0513-4088-b8a6-06acbf4fa9ec admin admin] PATH_INFO: `/v3/projects/7bf6efb0757042948d9da8ad3557ca0c/users/b27788bd5ba34a1d99807bd2c9ea2a99/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:19.861559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b167d4b-0513-4088-b8a6-06acbf4fa9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf6efb0757042948d9da8ad3557ca0c, user_id=b27788bd5ba34a1d99807bd2c9ea2a99, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:19.864260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b167d4b-0513-4088-b8a6-06acbf4fa9ec admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:19.879016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1028/2068] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:19 2022] PUT /identity/v3/projects/7bf6efb0757042948d9da8ad3557ca0c/users/b27788bd5ba34a1d99807bd2c9ea2a99/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:19.890578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bcb44-f53c-4596-a07d-ce79f8b31897 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:19.890957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bcb44-f53c-4596-a07d-ce79f8b31897 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:19.891373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bcb44-f53c-4596-a07d-ce79f8b31897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:19.920510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7b5bcb44-f53c-4596-a07d-ce79f8b31897 None None] MFA Rules not processed for user `b27788bd5ba34a1d99807bd2c9ea2a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:19.921778 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7b5bcb44-f53c-4596-a07d-ce79f8b31897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:20.002774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1041/2069] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:20.007439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b167d4b-0513-4088-b8a6-06acbf4fa9ec admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:20.074237 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:20.078855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b167d4b-0513-4088-b8a6-06acbf4fa9ec admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:20.088061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a2b65-b24c-406b-a204-5501e2a538e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:20.088703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a2b65-b24c-406b-a204-5501e2a538e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:20.089016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a2b65-b24c-406b-a204-5501e2a538e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:20.089292 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a2b65-b24c-406b-a204-5501e2a538e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:20.090620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a2b65-b24c-406b-a204-5501e2a538e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:20.093635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a2b65-b24c-406b-a204-5501e2a538e9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:20.128910 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1029/2070] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:20 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:20.133114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bcb44-f53c-4596-a07d-ce79f8b31897 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:20.144442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bcb44-f53c-4596-a07d-ce79f8b31897 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:20.213334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f092ad-4999-464c-8c12-63a7e70c693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:20.213942 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f092ad-4999-464c-8c12-63a7e70c693a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:20.214217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f092ad-4999-464c-8c12-63a7e70c693a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:20.214493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f092ad-4999-464c-8c12-63a7e70c693a admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:20.215174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f092ad-4999-464c-8c12-63a7e70c693a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:20.217660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f092ad-4999-464c-8c12-63a7e70c693a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:20.227982 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:20.247770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1042/2071] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:20 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:20.251657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a2b65-b24c-406b-a204-5501e2a538e9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:20.265745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a2b65-b24c-406b-a204-5501e2a538e9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:20.274065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ff2a9-68c6-4f56-840d-ab0ba0142165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:20.274856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ff2a9-68c6-4f56-840d-ab0ba0142165 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:20.275191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ff2a9-68c6-4f56-840d-ab0ba0142165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:20.275531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ff2a9-68c6-4f56-840d-ab0ba0142165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:20.276310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ff2a9-68c6-4f56-840d-ab0ba0142165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:20.278785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ff2a9-68c6-4f56-840d-ab0ba0142165 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:20.294663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1030/2072] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:20.299005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f092ad-4999-464c-8c12-63a7e70c693a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:20.310915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f092ad-4999-464c-8c12-63a7e70c693a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:20.320485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d7c76-1ea9-4857-b5b3-92cd5626a504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:20.321246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d7c76-1ea9-4857-b5b3-92cd5626a504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:20.321525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d7c76-1ea9-4857-b5b3-92cd5626a504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:20.321802 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d7c76-1ea9-4857-b5b3-92cd5626a504 admin admin] PATH_INFO: `/v3/projects/a07d246381be483d8a7f38c4f5d5cfc7/users/72e6c4ad8c6348a486031df288445bb6/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:20.338283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d7c76-1ea9-4857-b5b3-92cd5626a504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07d246381be483d8a7f38c4f5d5cfc7, user_id=72e6c4ad8c6348a486031df288445bb6, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:20.341087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d7c76-1ea9-4857-b5b3-92cd5626a504 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:20.356307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1043/2073] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:20 2022] PUT /identity/v3/projects/a07d246381be483d8a7f38c4f5d5cfc7/users/72e6c4ad8c6348a486031df288445bb6/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:20.360632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ff2a9-68c6-4f56-840d-ab0ba0142165 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:20.371199 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ff2a9-68c6-4f56-840d-ab0ba0142165 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:20.440556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027aa93-b49b-4bed-abfd-34e3327d5a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:20.441326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027aa93-b49b-4bed-abfd-34e3327d5a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:20.441612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027aa93-b49b-4bed-abfd-34e3327d5a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:20.441893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027aa93-b49b-4bed-abfd-34e3327d5a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:20.442602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027aa93-b49b-4bed-abfd-34e3327d5a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:20.444235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027aa93-b49b-4bed-abfd-34e3327d5a81 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:20.456573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1031/2074] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:20.459947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d7c76-1ea9-4857-b5b3-92cd5626a504 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:20.471834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d7c76-1ea9-4857-b5b3-92cd5626a504 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:20.477605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4277635-ba6c-49df-b13e-f6b7f6d93d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:20.478571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4277635-ba6c-49df-b13e-f6b7f6d93d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:20.478950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4277635-ba6c-49df-b13e-f6b7f6d93d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:20.479330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4277635-ba6c-49df-b13e-f6b7f6d93d89 admin admin] PATH_INFO: `/v3/projects/a07d246381be483d8a7f38c4f5d5cfc7/users/72e6c4ad8c6348a486031df288445bb6/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:20.481611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4277635-ba6c-49df-b13e-f6b7f6d93d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07d246381be483d8a7f38c4f5d5cfc7, user_id=72e6c4ad8c6348a486031df288445bb6, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:20.484475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4277635-ba6c-49df-b13e-f6b7f6d93d89 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:20.498678 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1044/2075] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:20 2022] PUT /identity/v3/projects/a07d246381be483d8a7f38c4f5d5cfc7/users/72e6c4ad8c6348a486031df288445bb6/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:20.509663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1914-1daf-48ca-9837-cbb4abf9df71 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:20.509971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1914-1daf-48ca-9837-cbb4abf9df71 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:20.510253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e1914-1daf-48ca-9837-cbb4abf9df71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:20.543094 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8d6e1914-1daf-48ca-9837-cbb4abf9df71 None None] MFA Rules not processed for user `72e6c4ad8c6348a486031df288445bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:20.544472 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8d6e1914-1daf-48ca-9837-cbb4abf9df71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:20.655275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1032/2076] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:20.696215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4277635-ba6c-49df-b13e-f6b7f6d93d89 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:20.698508 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a4277635-ba6c-49df-b13e-f6b7f6d93d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:20.783134 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4277635-ba6c-49df-b13e-f6b7f6d93d89 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:20.789613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3e24f-afac-4675-9428-cae1d30deb8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:20.790820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3e24f-afac-4675-9428-cae1d30deb8b service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:20.791179 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3e24f-afac-4675-9428-cae1d30deb8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:20.791706 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3e24f-afac-4675-9428-cae1d30deb8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:20.885937 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3e24f-afac-4675-9428-cae1d30deb8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:20.887687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3e24f-afac-4675-9428-cae1d30deb8b service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:20.898930 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1045/2077] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:21.027983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e1914-1daf-48ca-9837-cbb4abf9df71 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:21.030832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8d6e1914-1daf-48ca-9837-cbb4abf9df71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:21.057765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e1914-1daf-48ca-9837-cbb4abf9df71 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:21.068253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd3f9d-640a-4cf2-b36c-ea526ea3a011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:21.069238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3f9d-640a-4cf2-b36c-ea526ea3a011 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:21.069788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3f9d-640a-4cf2-b36c-ea526ea3a011 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:21.070276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd3f9d-640a-4cf2-b36c-ea526ea3a011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:21.072311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-edfd3f9d-640a-4cf2-b36c-ea526ea3a011 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:21.135970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:21.155420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd3f9d-640a-4cf2-b36c-ea526ea3a011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:21.156973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd3f9d-640a-4cf2-b36c-ea526ea3a011 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:21.168385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1033/2078] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:22.495988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3e24f-afac-4675-9428-cae1d30deb8b service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:22.497608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a5d3e24f-afac-4675-9428-cae1d30deb8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:22.647692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3e24f-afac-4675-9428-cae1d30deb8b service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:22.656187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:22.657593 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:22.657886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:22.658166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] PATH_INFO: `/v3/users/2c71fba2492543a4b64595c3a6dcc95f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:22.660525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c71fba2492543a4b64595c3a6dcc95f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:22.667280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:22.691560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:22.748069 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c71fba2492543a4b64595c3a6dcc95f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:22.748837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c71fba2492543a4b64595c3a6dcc95f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:22.774243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c71fba2492543a4b64595c3a6dcc95f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:22.775653 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c71fba2492543a4b64595c3a6dcc95f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:22.796325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c71fba2492543a4b64595c3a6dcc95f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:22.816395 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1046/2079] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:22 2022] DELETE /identity/v3/users/2c71fba2492543a4b64595c3a6dcc95f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:22.818957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5667cfe-7db1-4dec-8cf5-bd777172b089 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:22.819457 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5667cfe-7db1-4dec-8cf5-bd777172b089 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:22.819750 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5667cfe-7db1-4dec-8cf5-bd777172b089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:22.844343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c5667cfe-7db1-4dec-8cf5-bd777172b089 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:22.845907 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c5667cfe-7db1-4dec-8cf5-bd777172b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:22.848827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:22.850595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:22.942018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1034/2080] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:22.955825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5667cfe-7db1-4dec-8cf5-bd777172b089 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:22.957699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c5667cfe-7db1-4dec-8cf5-bd777172b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:22.978287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3e226-67b0-4d4a-a9dc-0daf809182a3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:22.982833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc5b1-17c7-4fdf-86aa-a3770794c6fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:22.984658 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc5b1-17c7-4fdf-86aa-a3770794c6fa service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:22.985011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc5b1-17c7-4fdf-86aa-a3770794c6fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:22.985274 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc5b1-17c7-4fdf-86aa-a3770794c6fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:22.987427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-682cc5b1-17c7-4fdf-86aa-a3770794c6fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:23.056955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5667cfe-7db1-4dec-8cf5-bd777172b089 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:23.062785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32b0b-4c26-4f1f-adbb-24cc0ac76fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:23.063577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32b0b-4c26-4f1f-adbb-24cc0ac76fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:23.064404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32b0b-4c26-4f1f-adbb-24cc0ac76fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:23.064587 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32b0b-4c26-4f1f-adbb-24cc0ac76fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:23.079260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd32b0b-4c26-4f1f-adbb-24cc0ac76fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:23.081316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd32b0b-4c26-4f1f-adbb-24cc0ac76fb3 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:23.085096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cc5b1-17c7-4fdf-86aa-a3770794c6fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:23.087635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cc5b1-17c7-4fdf-86aa-a3770794c6fa service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:23.095641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1035/2081] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:23.103975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1047/2082] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:23.813695 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32b0b-4c26-4f1f-adbb-24cc0ac76fb3 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:23.815208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4fd32b0b-4c26-4f1f-adbb-24cc0ac76fb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:23.833251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32b0b-4c26-4f1f-adbb-24cc0ac76fb3 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:23.846926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:23.848417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:23.848702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:23.849760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] PATH_INFO: `/v3/projects/056acb2ccf7343cf8cf52fd0164a6135` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:23.851124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=056acb2ccf7343cf8cf52fd0164a6135)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:23.853626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:23.952394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056acb2ccf7343cf8cf52fd0164a6135', 'request_id': 'req-7eac440f-9b74-4858-baed-4a985fdba9bb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:23.963842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056acb2ccf7343cf8cf52fd0164a6135', 'request_id': 'req-7eac440f-9b74-4858-baed-4a985fdba9bb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:23.985075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056acb2ccf7343cf8cf52fd0164a6135', 'request_id': 'req-7eac440f-9b74-4858-baed-4a985fdba9bb'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.001765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] The token cache is being invalidate because project 056acb2ccf7343cf8cf52fd0164a6135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:24.002287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.003115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.008010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1036/2083] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:23 2022] DELETE /identity/v3/projects/056acb2ccf7343cf8cf52fd0164a6135 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:24.009322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc5b1-17c7-4fdf-86aa-a3770794c6fa service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:24.020575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc5b1-17c7-4fdf-86aa-a3770794c6fa service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:24.024859 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:24.026712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:24.059599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:24.078044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:24.104121 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:24.104851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:24.105176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:24.105470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] PATH_INFO: `/v3/users/1089387f399848bfafbce61e9f8172ba` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:24.107041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1089387f399848bfafbce61e9f8172ba)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:24.109021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:24.115756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac440f-9b74-4858-baed-4a985fdba9bb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:24.120832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af68cd-94b5-4c94-a491-de64e0652fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:24.122160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af68cd-94b5-4c94-a491-de64e0652fbc service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:24.122642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af68cd-94b5-4c94-a491-de64e0652fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:24.123134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af68cd-94b5-4c94-a491-de64e0652fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:24.125482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-72af68cd-94b5-4c94-a491-de64e0652fbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:24.177472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1089387f399848bfafbce61e9f8172ba'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.178737 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1089387f399848bfafbce61e9f8172ba'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.189819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1089387f399848bfafbce61e9f8172ba'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.190987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1089387f399848bfafbce61e9f8172ba'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.207614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1089387f399848bfafbce61e9f8172ba'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.224983 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1048/2084] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:24 2022] DELETE /identity/v3/users/1089387f399848bfafbce61e9f8172ba => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:24.226363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af68cd-94b5-4c94-a491-de64e0652fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:24.233309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af68cd-94b5-4c94-a491-de64e0652fbc service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:24.263189 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1037/2085] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:24.315218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:24.318350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:24.438379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7f0c2-0ef5-4d5e-85c1-22f59e2ed77e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:24.443958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:24.444779 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:24.445188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:24.445560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] PATH_INFO: `/v3/users/a51fa289d2ee4f63b0fcdb62c79aad50` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:24.447141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51fa289d2ee4f63b0fcdb62c79aad50)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:24.449104 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:24.517287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51fa289d2ee4f63b0fcdb62c79aad50'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.518369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51fa289d2ee4f63b0fcdb62c79aad50'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.526772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51fa289d2ee4f63b0fcdb62c79aad50'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.527940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51fa289d2ee4f63b0fcdb62c79aad50'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.534503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:24.548672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51fa289d2ee4f63b0fcdb62c79aad50'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.563791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1049/2086] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:24 2022] DELETE /identity/v3/users/a51fa289d2ee4f63b0fcdb62c79aad50 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:24.568234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a2e55-4b89-42c3-a0d2-0b789289784d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:24.568503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a2e55-4b89-42c3-a0d2-0b789289784d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:24.568728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a2e55-4b89-42c3-a0d2-0b789289784d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:24.603426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e76a2e55-4b89-42c3-a0d2-0b789289784d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:24.606366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e76a2e55-4b89-42c3-a0d2-0b789289784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:24.656863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:24.659233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:24.686331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1038/2087] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:24.698709 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a2e55-4b89-42c3-a0d2-0b789289784d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:24.700520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e76a2e55-4b89-42c3-a0d2-0b789289784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:24.759600 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd041fd7-8416-4804-a8f3-519e9c42f268 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:24.766684 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae5fa1-52b4-4f03-aff5-0fff06326936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:24.767349 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae5fa1-52b4-4f03-aff5-0fff06326936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:24.767624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae5fa1-52b4-4f03-aff5-0fff06326936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:24.767897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae5fa1-52b4-4f03-aff5-0fff06326936 admin admin] PATH_INFO: `/v3/projects/f54d3ea9e5f64df287dd10b774d2dd16` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:24.770129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae5fa1-52b4-4f03-aff5-0fff06326936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54d3ea9e5f64df287dd10b774d2dd16)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:24.772364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae5fa1-52b4-4f03-aff5-0fff06326936 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:24.773614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a2e55-4b89-42c3-a0d2-0b789289784d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:24.779066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a94fe-3b70-4237-bb78-9772a8b062e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:24.779690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a94fe-3b70-4237-bb78-9772a8b062e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:24.779973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a94fe-3b70-4237-bb78-9772a8b062e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:24.780250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a94fe-3b70-4237-bb78-9772a8b062e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:24.796500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a94fe-3b70-4237-bb78-9772a8b062e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:24.798973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a94fe-3b70-4237-bb78-9772a8b062e4 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:24.813105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1039/2088] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:15:24.841148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8dae5fa1-52b4-4f03-aff5-0fff06326936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54d3ea9e5f64df287dd10b774d2dd16', 'request_id': 'req-8dae5fa1-52b4-4f03-aff5-0fff06326936'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.851280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8dae5fa1-52b4-4f03-aff5-0fff06326936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54d3ea9e5f64df287dd10b774d2dd16', 'request_id': 'req-8dae5fa1-52b4-4f03-aff5-0fff06326936'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.859432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8dae5fa1-52b4-4f03-aff5-0fff06326936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54d3ea9e5f64df287dd10b774d2dd16', 'request_id': 'req-8dae5fa1-52b4-4f03-aff5-0fff06326936'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.874547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8dae5fa1-52b4-4f03-aff5-0fff06326936 admin admin] The token cache is being invalidate because project f54d3ea9e5f64df287dd10b774d2dd16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:24.882435 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8dae5fa1-52b4-4f03-aff5-0fff06326936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.883378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8dae5fa1-52b4-4f03-aff5-0fff06326936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:24.888719 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1050/2089] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:24 2022] DELETE /identity/v3/projects/f54d3ea9e5f64df287dd10b774d2dd16 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:24.891837 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392864f-f751-4dbf-bb6a-8dda03e11f0d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:24.892379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392864f-f751-4dbf-bb6a-8dda03e11f0d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:24.892777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392864f-f751-4dbf-bb6a-8dda03e11f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:24.917225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a392864f-f751-4dbf-bb6a-8dda03e11f0d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:24.918655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a392864f-f751-4dbf-bb6a-8dda03e11f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:24.925078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:25.034408 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1040/2090] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:25.043433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b34c0-bdf4-46c1-8a7c-5fbafcca426d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:25.043933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b34c0-bdf4-46c1-8a7c-5fbafcca426d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:25.044027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b34c0-bdf4-46c1-8a7c-5fbafcca426d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:25.068336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d89b34c0-bdf4-46c1-8a7c-5fbafcca426d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:25.069800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d89b34c0-bdf4-46c1-8a7c-5fbafcca426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:25.079590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1051/2091] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:25.084166 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392864f-f751-4dbf-bb6a-8dda03e11f0d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:25.096082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392864f-f751-4dbf-bb6a-8dda03e11f0d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:25.102819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08b11f-22c7-41b2-99de-6d02550b71f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:25.103801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08b11f-22c7-41b2-99de-6d02550b71f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:25.104446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08b11f-22c7-41b2-99de-6d02550b71f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:25.104446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08b11f-22c7-41b2-99de-6d02550b71f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:25.105657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08b11f-22c7-41b2-99de-6d02550b71f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:25.106279 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08b11f-22c7-41b2-99de-6d02550b71f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:25.108125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08b11f-22c7-41b2-99de-6d02550b71f2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:25.124318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1041/2092] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:15:25.129568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b34c0-bdf4-46c1-8a7c-5fbafcca426d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:25.145039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b34c0-bdf4-46c1-8a7c-5fbafcca426d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:25.150830 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffb0fd-b487-4c44-827a-46237c8a12cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:25.151525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffb0fd-b487-4c44-827a-46237c8a12cc admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:25.152196 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffb0fd-b487-4c44-827a-46237c8a12cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:25.152473 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffb0fd-b487-4c44-827a-46237c8a12cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:25.152690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08b11f-22c7-41b2-99de-6d02550b71f2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:25.153428 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffb0fd-b487-4c44-827a-46237c8a12cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:25.154669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7d08b11f-22c7-41b2-99de-6d02550b71f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:25.155963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffb0fd-b487-4c44-827a-46237c8a12cc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:25.176236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08b11f-22c7-41b2-99de-6d02550b71f2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:25.181329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:25.182748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:25.182976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:25.183259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] PATH_INFO: `/v3/projects/74a2c81d61e64127bae590f620044dfa` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:25.184534 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a2c81d61e64127bae590f620044dfa)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:25.186860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:25.209280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1052/2093] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:25 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:25.213430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffb0fd-b487-4c44-827a-46237c8a12cc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:25.253025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a2c81d61e64127bae590f620044dfa', 'request_id': 'req-6f879481-739e-4c93-865c-9fba76b17685'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:25.263994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a2c81d61e64127bae590f620044dfa', 'request_id': 'req-6f879481-739e-4c93-865c-9fba76b17685'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:25.273877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a2c81d61e64127bae590f620044dfa', 'request_id': 'req-6f879481-739e-4c93-865c-9fba76b17685'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:25.289999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:25.291373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] The token cache is being invalidate because project 74a2c81d61e64127bae590f620044dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:25.292356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:25.293574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:25.302250 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1042/2094] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:25 2022] DELETE /identity/v3/projects/74a2c81d61e64127bae590f620044dfa => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:25.303300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:25.307852 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:25.323094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffb0fd-b487-4c44-827a-46237c8a12cc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:25.386341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f879481-739e-4c93-865c-9fba76b17685 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:25.393851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:25.394867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:25.395268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:25.395662 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] PATH_INFO: `/v3/users/7e78df08849347acb55e3b86c565f97b` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:25.397355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e78df08849347acb55e3b86c565f97b)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:25.399442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:25.405643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e706f1-94af-4572-bb25-8033661f5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:25.406842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e706f1-94af-4572-bb25-8033661f5335 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:25.407285 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e706f1-94af-4572-bb25-8033661f5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:25.407794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e706f1-94af-4572-bb25-8033661f5335 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:25.408613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e706f1-94af-4572-bb25-8033661f5335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:25.410956 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e706f1-94af-4572-bb25-8033661f5335 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:25.431022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:25.442859 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1053/2095] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:25 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:25.449100 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e706f1-94af-4572-bb25-8033661f5335 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:25.454564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-76e706f1-94af-4572-bb25-8033661f5335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:25.470043 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e706f1-94af-4572-bb25-8033661f5335 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:25.480463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d836383-0da2-4740-ba1a-29833e7b61ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:25.481751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e78df08849347acb55e3b86c565f97b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:25.483189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d836383-0da2-4740-ba1a-29833e7b61ab admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:25.483471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d836383-0da2-4740-ba1a-29833e7b61ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:25.484838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d836383-0da2-4740-ba1a-29833e7b61ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:25.484838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d836383-0da2-4740-ba1a-29833e7b61ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:25.486900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d836383-0da2-4740-ba1a-29833e7b61ab admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:25.501542 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e78df08849347acb55e3b86c565f97b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:25.517325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1054/2096] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:25.517686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e78df08849347acb55e3b86c565f97b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:25.519312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d836383-0da2-4740-ba1a-29833e7b61ab admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:25.522289 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e78df08849347acb55e3b86c565f97b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:25.533869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d836383-0da2-4740-ba1a-29833e7b61ab admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:25.550479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1608c-0cda-436e-8e62-5f4a8850da90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:25.554174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1608c-0cda-436e-8e62-5f4a8850da90 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:25.554575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1608c-0cda-436e-8e62-5f4a8850da90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:25.555108 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1608c-0cda-436e-8e62-5f4a8850da90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:25.555934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1608c-0cda-436e-8e62-5f4a8850da90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:25.560933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1608c-0cda-436e-8e62-5f4a8850da90 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:25.575299 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e78df08849347acb55e3b86c565f97b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:25.584163 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1043/2097] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:25 2022] DELETE /identity/v3/users/7e78df08849347acb55e3b86c565f97b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:25.588948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1055/2098] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:25.592017 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:25.593915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:25.748399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffc3d5-9358-49c9-9b31-6845107b4d2a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:25.763719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaf575-c473-4c8d-92ff-cda363e13afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:25.765969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaf575-c473-4c8d-92ff-cda363e13afc admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:25.766256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaf575-c473-4c8d-92ff-cda363e13afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:25.766535 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaf575-c473-4c8d-92ff-cda363e13afc admin admin] PATH_INFO: `/v3/projects/91c5fe965d4144c8b96ce71bb4c3c5e1/users/0077bfd49e9d42d2873ffc4c5eee65d7/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:25.807666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaf575-c473-4c8d-92ff-cda363e13afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c5fe965d4144c8b96ce71bb4c3c5e1, user_id=0077bfd49e9d42d2873ffc4c5eee65d7, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:25.814426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaf575-c473-4c8d-92ff-cda363e13afc admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:25.874257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1044/2099] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:25 2022] PUT /identity/v3/projects/91c5fe965d4144c8b96ce71bb4c3c5e1/users/0077bfd49e9d42d2873ffc4c5eee65d7/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:25.884613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89c479-ad34-42d5-8bea-e84df3a64fc4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:25.885012 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89c479-ad34-42d5-8bea-e84df3a64fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:25.885212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89c479-ad34-42d5-8bea-e84df3a64fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:25.927565 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8c89c479-ad34-42d5-8bea-e84df3a64fc4 None None] MFA Rules not processed for user `0077bfd49e9d42d2873ffc4c5eee65d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:25.928974 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8c89c479-ad34-42d5-8bea-e84df3a64fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:26.037129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1056/2100] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:26.042269 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaf575-c473-4c8d-92ff-cda363e13afc admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:26.104939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89c479-ad34-42d5-8bea-e84df3a64fc4 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:26.106792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8c89c479-ad34-42d5-8bea-e84df3a64fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:26.179849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:26.195720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaf575-c473-4c8d-92ff-cda363e13afc admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:26.201451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61ffb0-e78d-4ba3-9b74-1fbe5d7cb6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:26.202084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ffb0-e78d-4ba3-9b74-1fbe5d7cb6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:26.202365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ffb0-e78d-4ba3-9b74-1fbe5d7cb6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:26.202639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ffb0-e78d-4ba3-9b74-1fbe5d7cb6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:26.203177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89c479-ad34-42d5-8bea-e84df3a64fc4 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:26.203336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61ffb0-e78d-4ba3-9b74-1fbe5d7cb6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:26.205315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61ffb0-e78d-4ba3-9b74-1fbe5d7cb6c0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:26.210032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:26.211042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:26.211330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:26.211680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] PATH_INFO: `/v3/projects/7cbab49b36cb432abfdf86d12da692c3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:26.213624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cbab49b36cb432abfdf86d12da692c3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:26.215569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:26.242793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1045/2101] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:26 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:26.246847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61ffb0-e78d-4ba3-9b74-1fbe5d7cb6c0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:26.258151 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:26.278333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cbab49b36cb432abfdf86d12da692c3', 'request_id': 'req-20765620-916f-497b-b100-4ac597caa197'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:26.291856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cbab49b36cb432abfdf86d12da692c3', 'request_id': 'req-20765620-916f-497b-b100-4ac597caa197'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:26.299312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cbab49b36cb432abfdf86d12da692c3', 'request_id': 'req-20765620-916f-497b-b100-4ac597caa197'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:26.311124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] The token cache is being invalidate because project 7cbab49b36cb432abfdf86d12da692c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:26.311485 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:26.312219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:26.316879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1057/2102] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:26 2022] DELETE /identity/v3/projects/7cbab49b36cb432abfdf86d12da692c3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:26.317903 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:26.321187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:26.324368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61ffb0-e78d-4ba3-9b74-1fbe5d7cb6c0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:26.390261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25901cdb-2672-4092-87f5-7439a8d6267d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:26.390990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25901cdb-2672-4092-87f5-7439a8d6267d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:26.391891 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25901cdb-2672-4092-87f5-7439a8d6267d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:26.391891 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25901cdb-2672-4092-87f5-7439a8d6267d admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:26.392345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25901cdb-2672-4092-87f5-7439a8d6267d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:26.394585 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25901cdb-2672-4092-87f5-7439a8d6267d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:26.395872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765620-916f-497b-b100-4ac597caa197 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:26.403048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:26.403917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:26.404194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:26.404469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] PATH_INFO: `/v3/users/3c0ae5fdb9c54d959b3699dfe61c8be4` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:26.406129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0ae5fdb9c54d959b3699dfe61c8be4)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:26.408406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:26.423879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1046/2103] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:26 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:26.429822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25901cdb-2672-4092-87f5-7439a8d6267d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:26.432007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-25901cdb-2672-4092-87f5-7439a8d6267d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:26.445051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25901cdb-2672-4092-87f5-7439a8d6267d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:26.450309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcead5-f84c-4094-b27e-4178c0fad6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:26.451049 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcead5-f84c-4094-b27e-4178c0fad6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:26.451360 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcead5-f84c-4094-b27e-4178c0fad6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:26.451702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcead5-f84c-4094-b27e-4178c0fad6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:26.452404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcead5-f84c-4094-b27e-4178c0fad6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:26.454258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcead5-f84c-4094-b27e-4178c0fad6a4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:26.468956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1047/2104] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:15:26.471064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcead5-f84c-4094-b27e-4178c0fad6a4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:26.472373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0ae5fdb9c54d959b3699dfe61c8be4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:26.473988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0ae5fdb9c54d959b3699dfe61c8be4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:26.482133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcead5-f84c-4094-b27e-4178c0fad6a4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:26.485409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0ae5fdb9c54d959b3699dfe61c8be4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:26.486254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0ae5fdb9c54d959b3699dfe61c8be4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:26.488311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cabfb-d71f-4ab0-9b12-2cf8ff1299d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:26.489052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cabfb-d71f-4ab0-9b12-2cf8ff1299d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:26.489351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cabfb-d71f-4ab0-9b12-2cf8ff1299d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:26.489622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cabfb-d71f-4ab0-9b12-2cf8ff1299d5 admin admin] PATH_INFO: `/v3/projects/b5201a46141649638fcf0504b8cf99c9/users/a8fa197e12be48b7b1503f184492f294/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:26.500495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0ae5fdb9c54d959b3699dfe61c8be4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:26.505457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:26.510724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cabfb-d71f-4ab0-9b12-2cf8ff1299d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5201a46141649638fcf0504b8cf99c9, user_id=a8fa197e12be48b7b1503f184492f294, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:26.515644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cabfb-d71f-4ab0-9b12-2cf8ff1299d5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:26.518288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1058/2105] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:26 2022] DELETE /identity/v3/users/3c0ae5fdb9c54d959b3699dfe61c8be4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:26.537494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1048/2106] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:26 2022] PUT /identity/v3/projects/b5201a46141649638fcf0504b8cf99c9/users/a8fa197e12be48b7b1503f184492f294/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:26.542642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:26.546166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:26.633538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7884b7c-0a2d-4329-8495-1c6d43972a67 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:26.697748 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34fb7e-65b8-45b7-aeb3-cf151b4fc6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:26.698476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34fb7e-65b8-45b7-aeb3-cf151b4fc6af admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:26.698816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34fb7e-65b8-45b7-aeb3-cf151b4fc6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:26.699336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34fb7e-65b8-45b7-aeb3-cf151b4fc6af admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:26.700198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34fb7e-65b8-45b7-aeb3-cf151b4fc6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:26.702164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34fb7e-65b8-45b7-aeb3-cf151b4fc6af admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:26.713636 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1059/2107] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:26.717971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cabfb-d71f-4ab0-9b12-2cf8ff1299d5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:26.728985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cabfb-d71f-4ab0-9b12-2cf8ff1299d5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:26.734913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed7870-8221-4741-94d1-0cdecbcdda6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:26.736174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed7870-8221-4741-94d1-0cdecbcdda6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:26.736174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed7870-8221-4741-94d1-0cdecbcdda6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:26.736174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed7870-8221-4741-94d1-0cdecbcdda6d admin admin] PATH_INFO: `/v3/projects/b5201a46141649638fcf0504b8cf99c9/users/a8fa197e12be48b7b1503f184492f294/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:26.738072 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed7870-8221-4741-94d1-0cdecbcdda6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5201a46141649638fcf0504b8cf99c9, user_id=a8fa197e12be48b7b1503f184492f294, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:26.740796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed7870-8221-4741-94d1-0cdecbcdda6d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:26.752872 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1049/2108] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:26 2022] PUT /identity/v3/projects/b5201a46141649638fcf0504b8cf99c9/users/a8fa197e12be48b7b1503f184492f294/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:26.764571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b540a-06ab-4d1f-bc81-7c5aff46dc00 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:26.764865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b540a-06ab-4d1f-bc81-7c5aff46dc00 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:26.765179 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b540a-06ab-4d1f-bc81-7c5aff46dc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:26.795173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f48b540a-06ab-4d1f-bc81-7c5aff46dc00 None None] MFA Rules not processed for user `a8fa197e12be48b7b1503f184492f294`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:26.796423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f48b540a-06ab-4d1f-bc81-7c5aff46dc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:26.837881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed7870-8221-4741-94d1-0cdecbcdda6d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:26.839762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e3ed7870-8221-4741-94d1-0cdecbcdda6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:26.879173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1060/2109] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:26.890945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b540a-06ab-4d1f-bc81-7c5aff46dc00 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:26.893576 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f48b540a-06ab-4d1f-bc81-7c5aff46dc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:26.923884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:26.936512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:26.941236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed7870-8221-4741-94d1-0cdecbcdda6d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:26.950653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:26.951443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:26.951787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:26.952150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c admin admin] PATH_INFO: `/v3/projects/a850d60b580843179709efcb3a1ffdbd` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:26.953646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a850d60b580843179709efcb3a1ffdbd)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:26.955491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:26.961930 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b540a-06ab-4d1f-bc81-7c5aff46dc00 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:26.966579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16b026-b81c-4b7b-976c-308497fad2c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:26.967474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b026-b81c-4b7b-976c-308497fad2c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:26.967848 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b026-b81c-4b7b-976c-308497fad2c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:26.968207 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b026-b81c-4b7b-976c-308497fad2c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:26.982939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16b026-b81c-4b7b-976c-308497fad2c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:26.984525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16b026-b81c-4b7b-976c-308497fad2c7 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:26.995451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1061/2110] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:15:27.029453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a850d60b580843179709efcb3a1ffdbd', 'request_id': 'req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.029776 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16b026-b81c-4b7b-976c-308497fad2c7 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:27.039300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a850d60b580843179709efcb3a1ffdbd', 'request_id': 'req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.041630 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16b026-b81c-4b7b-976c-308497fad2c7 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:27.047962 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a850d60b580843179709efcb3a1ffdbd', 'request_id': 'req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.062754 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c admin admin] The token cache is being invalidate because project a850d60b580843179709efcb3a1ffdbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:27.063139 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.063897 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-96b290c8-2e42-43d5-9ac3-2ea62dd0006c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.065663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1050/2111] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:26 2022] DELETE /identity/v3/projects/a850d60b580843179709efcb3a1ffdbd => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:27.071778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5073331-0a1f-453c-93a8-b6ef9e8c1587 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.072058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5073331-0a1f-453c-93a8-b6ef9e8c1587 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.072334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5073331-0a1f-453c-93a8-b6ef9e8c1587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.094425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d5073331-0a1f-453c-93a8-b6ef9e8c1587 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:27.095483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d5073331-0a1f-453c-93a8-b6ef9e8c1587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:27.120183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe191bc0-1d3f-43fb-a753-a2cea94a3e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:27.121415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe191bc0-1d3f-43fb-a753-a2cea94a3e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.121868 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe191bc0-1d3f-43fb-a753-a2cea94a3e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.122393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe191bc0-1d3f-43fb-a753-a2cea94a3e08 admin admin] PATH_INFO: `/v3/users/0077bfd49e9d42d2873ffc4c5eee65d7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.123583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe191bc0-1d3f-43fb-a753-a2cea94a3e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0077bfd49e9d42d2873ffc4c5eee65d7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:27.125605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe191bc0-1d3f-43fb-a753-a2cea94a3e08 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:27.180861 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1051/2112] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:27.193130 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a335b9-3545-427b-84d8-e777151c8a27 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.193944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a335b9-3545-427b-84d8-e777151c8a27 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.194232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a335b9-3545-427b-84d8-e777151c8a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.203465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fe191bc0-1d3f-43fb-a753-a2cea94a3e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0077bfd49e9d42d2873ffc4c5eee65d7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.204507 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fe191bc0-1d3f-43fb-a753-a2cea94a3e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0077bfd49e9d42d2873ffc4c5eee65d7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.214624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fe191bc0-1d3f-43fb-a753-a2cea94a3e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0077bfd49e9d42d2873ffc4c5eee65d7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.215345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fe191bc0-1d3f-43fb-a753-a2cea94a3e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0077bfd49e9d42d2873ffc4c5eee65d7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.220481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-05a335b9-3545-427b-84d8-e777151c8a27 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:27.221941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-05a335b9-3545-427b-84d8-e777151c8a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:27.230288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fe191bc0-1d3f-43fb-a753-a2cea94a3e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0077bfd49e9d42d2873ffc4c5eee65d7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.232186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1052/2113] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:27.236307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a335b9-3545-427b-84d8-e777151c8a27 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:27.245734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a335b9-3545-427b-84d8-e777151c8a27 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:27.246475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1062/2114] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:27 2022] DELETE /identity/v3/users/0077bfd49e9d42d2873ffc4c5eee65d7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:27.251452 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924fbe-95f1-4c52-982b-14bb84394a30 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.253065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924fbe-95f1-4c52-982b-14bb84394a30 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.253065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89924fbe-95f1-4c52-982b-14bb84394a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.288923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-89924fbe-95f1-4c52-982b-14bb84394a30 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:27.288923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-89924fbe-95f1-4c52-982b-14bb84394a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:27.328510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d72d2f-0c90-4feb-8f21-8d6afd346df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:27.329455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d72d2f-0c90-4feb-8f21-8d6afd346df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.329887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d72d2f-0c90-4feb-8f21-8d6afd346df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.330507 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d72d2f-0c90-4feb-8f21-8d6afd346df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.331370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d72d2f-0c90-4feb-8f21-8d6afd346df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:27.331682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d72d2f-0c90-4feb-8f21-8d6afd346df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:27.333353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d72d2f-0c90-4feb-8f21-8d6afd346df2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:27.341087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:27.349605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1053/2115] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:15:27.357203 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d72d2f-0c90-4feb-8f21-8d6afd346df2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:27.367815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d72d2f-0c90-4feb-8f21-8d6afd346df2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:27.372942 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1063/2116] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:27.373108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c545c-4a5d-4ad1-906a-e39cd20e7490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:27.373600 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c545c-4a5d-4ad1-906a-e39cd20e7490 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.373884 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c545c-4a5d-4ad1-906a-e39cd20e7490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.374382 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c545c-4a5d-4ad1-906a-e39cd20e7490 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.375066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c545c-4a5d-4ad1-906a-e39cd20e7490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:27.377049 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c545c-4a5d-4ad1-906a-e39cd20e7490 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:27.382076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924fbe-95f1-4c52-982b-14bb84394a30 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:27.383720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-89924fbe-95f1-4c52-982b-14bb84394a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:27.396500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:27.422284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1054/2117] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:27 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:27.426682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c545c-4a5d-4ad1-906a-e39cd20e7490 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:27.458311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89924fbe-95f1-4c52-982b-14bb84394a30 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:27.510990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c545c-4a5d-4ad1-906a-e39cd20e7490 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:27.516021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39afa0-d50a-45d9-a325-3b12477916c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:27.516795 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39afa0-d50a-45d9-a325-3b12477916c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.517155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39afa0-d50a-45d9-a325-3b12477916c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.517525 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39afa0-d50a-45d9-a325-3b12477916c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.518613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39afa0-d50a-45d9-a325-3b12477916c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:27.520657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39afa0-d50a-45d9-a325-3b12477916c0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:27.527596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da499a5-80dc-4a2f-8a6b-cb0a62f09148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:27.528513 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da499a5-80dc-4a2f-8a6b-cb0a62f09148 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.528915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da499a5-80dc-4a2f-8a6b-cb0a62f09148 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.529272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da499a5-80dc-4a2f-8a6b-cb0a62f09148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.542500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da499a5-80dc-4a2f-8a6b-cb0a62f09148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:27.544502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da499a5-80dc-4a2f-8a6b-cb0a62f09148 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:27.551813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1055/2118] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:27 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:27.552690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39afa0-d50a-45d9-a325-3b12477916c0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:27.557422 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1064/2119] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:15:27.565129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39afa0-d50a-45d9-a325-3b12477916c0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:27.574723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10f1f3-6810-49a2-af93-8c374e253929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:27.575451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10f1f3-6810-49a2-af93-8c374e253929 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.575896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10f1f3-6810-49a2-af93-8c374e253929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.576174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10f1f3-6810-49a2-af93-8c374e253929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.576918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10f1f3-6810-49a2-af93-8c374e253929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:27.578611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10f1f3-6810-49a2-af93-8c374e253929 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:27.589967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1056/2120] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:27.594402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da499a5-80dc-4a2f-8a6b-cb0a62f09148 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:27.604586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da499a5-80dc-4a2f-8a6b-cb0a62f09148 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:27.609499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fae9a-1aa9-463c-a459-eed1a412e606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:27.610154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fae9a-1aa9-463c-a459-eed1a412e606 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.610436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fae9a-1aa9-463c-a459-eed1a412e606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.610737 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fae9a-1aa9-463c-a459-eed1a412e606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.611438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fae9a-1aa9-463c-a459-eed1a412e606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:27.613135 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fae9a-1aa9-463c-a459-eed1a412e606 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:27.624456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1065/2121] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:27.628782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10f1f3-6810-49a2-af93-8c374e253929 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:27.641486 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10f1f3-6810-49a2-af93-8c374e253929 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:27.647985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e76a5-2bdd-4c2c-b555-4a878ec8d3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:27.648803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e76a5-2bdd-4c2c-b555-4a878ec8d3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.649516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e76a5-2bdd-4c2c-b555-4a878ec8d3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.649937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e76a5-2bdd-4c2c-b555-4a878ec8d3bc admin admin] PATH_INFO: `/v3/projects/d004f0413929443a85d9fd8823bc5756/users/f0437a0912a441b481ef810fc1b01734/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.669690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e76a5-2bdd-4c2c-b555-4a878ec8d3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d004f0413929443a85d9fd8823bc5756, user_id=f0437a0912a441b481ef810fc1b01734, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:27.672661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e76a5-2bdd-4c2c-b555-4a878ec8d3bc admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:27.692582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1057/2122] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:27 2022] PUT /identity/v3/projects/d004f0413929443a85d9fd8823bc5756/users/f0437a0912a441b481ef810fc1b01734/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:27.704258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311f4f5-e13a-465a-a52e-b30c621f0937 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.704659 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311f4f5-e13a-465a-a52e-b30c621f0937 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.705549 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311f4f5-e13a-465a-a52e-b30c621f0937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.736672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1311f4f5-e13a-465a-a52e-b30c621f0937 None None] MFA Rules not processed for user `f0437a0912a441b481ef810fc1b01734`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:27.738218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1311f4f5-e13a-465a-a52e-b30c621f0937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:27.810592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1066/2123] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:27.815212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e76a5-2bdd-4c2c-b555-4a878ec8d3bc admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:27.868628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311f4f5-e13a-465a-a52e-b30c621f0937 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:27.870139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1311f4f5-e13a-465a-a52e-b30c621f0937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:27.880056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e76a5-2bdd-4c2c-b555-4a878ec8d3bc admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:27.886084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311f4f5-e13a-465a-a52e-b30c621f0937 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:27.886750 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d799d-502a-4eba-a1af-da0b9aaae90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:27.887484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d799d-502a-4eba-a1af-da0b9aaae90d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.887818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d799d-502a-4eba-a1af-da0b9aaae90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.888199 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d799d-502a-4eba-a1af-da0b9aaae90d admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.889203 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d799d-502a-4eba-a1af-da0b9aaae90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:27.890981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:27.891382 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d799d-502a-4eba-a1af-da0b9aaae90d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:27.891697 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:27.891921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:27.892203 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] PATH_INFO: `/v3/projects/91c5fe965d4144c8b96ce71bb4c3c5e1` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:27.893415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c5fe965d4144c8b96ce71bb4c3c5e1)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:27.895976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:27.917447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:27.922710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1058/2124] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:27 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:27.926863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d799d-502a-4eba-a1af-da0b9aaae90d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:27.959456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c5fe965d4144c8b96ce71bb4c3c5e1', 'request_id': 'req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.962268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:27.974941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c5fe965d4144c8b96ce71bb4c3c5e1', 'request_id': 'req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.983883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c5fe965d4144c8b96ce71bb4c3c5e1', 'request_id': 'req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.996969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d799d-502a-4eba-a1af-da0b9aaae90d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:27.997940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] The token cache is being invalidate because project 91c5fe965d4144c8b96ce71bb4c3c5e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:27.998313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:27.999093 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.000961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1067/2125] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:27 2022] DELETE /identity/v3/projects/91c5fe965d4144c8b96ce71bb4c3c5e1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:28.004958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:28.006533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:28.074880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4337c40-f82a-4702-b1e5-96ee63c7d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:28.075632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4337c40-f82a-4702-b1e5-96ee63c7d1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.076083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4337c40-f82a-4702-b1e5-96ee63c7d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.076480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4337c40-f82a-4702-b1e5-96ee63c7d1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.077286 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4337c40-f82a-4702-b1e5-96ee63c7d1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:28.080748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4337c40-f82a-4702-b1e5-96ee63c7d1c3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:28.084143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d24fd0-6f73-45a1-9f0b-737fe3d94ada admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:28.089313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:28.090182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.090627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.090990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] PATH_INFO: `/v3/users/a8fa197e12be48b7b1503f184492f294` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.092515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8fa197e12be48b7b1503f184492f294)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:28.095027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:28.112720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1059/2126] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:27 2022] POST /identity/v3/users => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:28.116415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4337c40-f82a-4702-b1e5-96ee63c7d1c3 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:28.118305 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d4337c40-f82a-4702-b1e5-96ee63c7d1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:28.131381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4337c40-f82a-4702-b1e5-96ee63c7d1c3 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:28.136483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36800faf-8ecf-479a-8500-3890aff8d532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:28.137455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36800faf-8ecf-479a-8500-3890aff8d532 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.137572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36800faf-8ecf-479a-8500-3890aff8d532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.137935 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36800faf-8ecf-479a-8500-3890aff8d532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.138732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36800faf-8ecf-479a-8500-3890aff8d532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:28.140424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36800faf-8ecf-479a-8500-3890aff8d532 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:28.157104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1060/2127] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:28.157611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8fa197e12be48b7b1503f184492f294'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.158342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8fa197e12be48b7b1503f184492f294'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.158713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36800faf-8ecf-479a-8500-3890aff8d532 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:28.160682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-36800faf-8ecf-479a-8500-3890aff8d532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:28.168938 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8fa197e12be48b7b1503f184492f294'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.169743 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8fa197e12be48b7b1503f184492f294'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.177320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36800faf-8ecf-479a-8500-3890aff8d532 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:28.183068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1c936-4978-4bcf-b898-8fb844325885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:28.183955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1c936-4978-4bcf-b898-8fb844325885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.184309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1c936-4978-4bcf-b898-8fb844325885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.184563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1c936-4978-4bcf-b898-8fb844325885 admin admin] PATH_INFO: `/v3/projects/fb7289a6ba264de49cee871be6ef5ef4/users/53e8303796504c7b8a3b5e0827f6aa1f/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.186232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8fa197e12be48b7b1503f184492f294'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.202160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1068/2128] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:28 2022] DELETE /identity/v3/users/a8fa197e12be48b7b1503f184492f294 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:28.205650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1c936-4978-4bcf-b898-8fb844325885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7289a6ba264de49cee871be6ef5ef4, user_id=53e8303796504c7b8a3b5e0827f6aa1f, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:28.208541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1c936-4978-4bcf-b898-8fb844325885 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:28.225850 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1061/2129] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:28 2022] PUT /identity/v3/projects/fb7289a6ba264de49cee871be6ef5ef4/users/53e8303796504c7b8a3b5e0827f6aa1f/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:28.230209 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:28.268164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:28.311956 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d9a1e-48ee-4eb3-9ad1-bb5b4ecb007a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:28.380651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d252f-e989-4fb4-b999-c14b38215c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:28.381497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d252f-e989-4fb4-b999-c14b38215c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.381776 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d252f-e989-4fb4-b999-c14b38215c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.382096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d252f-e989-4fb4-b999-c14b38215c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.382981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d252f-e989-4fb4-b999-c14b38215c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:28.384610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d252f-e989-4fb4-b999-c14b38215c22 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:28.395812 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1069/2130] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:28.400537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1c936-4978-4bcf-b898-8fb844325885 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:28.412291 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1c936-4978-4bcf-b898-8fb844325885 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:28.416989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1440d-c73a-4e9a-84d1-cdb2694daa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:28.417727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1440d-c73a-4e9a-84d1-cdb2694daa84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.417986 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1440d-c73a-4e9a-84d1-cdb2694daa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.418258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1440d-c73a-4e9a-84d1-cdb2694daa84 admin admin] PATH_INFO: `/v3/projects/fb7289a6ba264de49cee871be6ef5ef4/users/53e8303796504c7b8a3b5e0827f6aa1f/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.420312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1440d-c73a-4e9a-84d1-cdb2694daa84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7289a6ba264de49cee871be6ef5ef4, user_id=53e8303796504c7b8a3b5e0827f6aa1f, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:28.423044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1440d-c73a-4e9a-84d1-cdb2694daa84 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:28.434449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1062/2131] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:28 2022] PUT /identity/v3/projects/fb7289a6ba264de49cee871be6ef5ef4/users/53e8303796504c7b8a3b5e0827f6aa1f/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:28.446059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db78450-7827-4bd5-ae7f-573e2530fe58 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.446350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db78450-7827-4bd5-ae7f-573e2530fe58 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.446631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db78450-7827-4bd5-ae7f-573e2530fe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.476248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6db78450-7827-4bd5-ae7f-573e2530fe58 None None] MFA Rules not processed for user `53e8303796504c7b8a3b5e0827f6aa1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:28.477506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6db78450-7827-4bd5-ae7f-573e2530fe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:28.512784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1440d-c73a-4e9a-84d1-cdb2694daa84 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:28.514635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-aff1440d-c73a-4e9a-84d1-cdb2694daa84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:28.563260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1070/2132] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:28.574719 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db78450-7827-4bd5-ae7f-573e2530fe58 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:28.576180 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6db78450-7827-4bd5-ae7f-573e2530fe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:28.586485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1440d-c73a-4e9a-84d1-cdb2694daa84 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:28.591451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:28.592423 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.592856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.593168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e admin admin] PATH_INFO: `/v3/projects/b5201a46141649638fcf0504b8cf99c9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.594392 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5201a46141649638fcf0504b8cf99c9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:28.596347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:28.631888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:28.643529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db78450-7827-4bd5-ae7f-573e2530fe58 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:28.649102 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979f65-9ee0-44c7-95f0-8c9fdfc58932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:28.649896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979f65-9ee0-44c7-95f0-8c9fdfc58932 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.650182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979f65-9ee0-44c7-95f0-8c9fdfc58932 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.650524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6979f65-9ee0-44c7-95f0-8c9fdfc58932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.660728 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:28.663278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6979f65-9ee0-44c7-95f0-8c9fdfc58932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:28.663941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5201a46141649638fcf0504b8cf99c9', 'request_id': 'req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.665403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6979f65-9ee0-44c7-95f0-8c9fdfc58932 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:28.672773 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5201a46141649638fcf0504b8cf99c9', 'request_id': 'req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.675724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1071/2133] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:15:28.676543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979f65-9ee0-44c7-95f0-8c9fdfc58932 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:28.678018 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a6979f65-9ee0-44c7-95f0-8c9fdfc58932 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:28.679500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5201a46141649638fcf0504b8cf99c9', 'request_id': 'req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.691676 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6979f65-9ee0-44c7-95f0-8c9fdfc58932 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:28.692035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e admin admin] The token cache is being invalidate because project b5201a46141649638fcf0504b8cf99c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:28.692328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.693023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ac1198bc-a27d-4be5-8cfb-1ae18c767e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.694565 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1063/2134] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:28 2022] DELETE /identity/v3/projects/b5201a46141649638fcf0504b8cf99c9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:28.700535 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f866a0-d48d-4da8-8be0-974fd59f76ce None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.701399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f866a0-d48d-4da8-8be0-974fd59f76ce None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.701796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f866a0-d48d-4da8-8be0-974fd59f76ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.729225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d5f866a0-d48d-4da8-8be0-974fd59f76ce None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:28.730481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d5f866a0-d48d-4da8-8be0-974fd59f76ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:28.768631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a82780-71a6-431b-b9ea-c5296c050de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:28.769668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a82780-71a6-431b-b9ea-c5296c050de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.770154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a82780-71a6-431b-b9ea-c5296c050de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.770573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a82780-71a6-431b-b9ea-c5296c050de6 admin admin] PATH_INFO: `/v3/users/85083765ea5246bb90601320b4b27abc` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.772120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a82780-71a6-431b-b9ea-c5296c050de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85083765ea5246bb90601320b4b27abc)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:28.774577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a82780-71a6-431b-b9ea-c5296c050de6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:28.800241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1064/2135] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:28.801157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f866a0-d48d-4da8-8be0-974fd59f76ce None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:28.802622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d5f866a0-d48d-4da8-8be0-974fd59f76ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:28.838731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b8a82780-71a6-431b-b9ea-c5296c050de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85083765ea5246bb90601320b4b27abc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.839418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b8a82780-71a6-431b-b9ea-c5296c050de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85083765ea5246bb90601320b4b27abc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.849425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b8a82780-71a6-431b-b9ea-c5296c050de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85083765ea5246bb90601320b4b27abc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.850214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b8a82780-71a6-431b-b9ea-c5296c050de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85083765ea5246bb90601320b4b27abc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.862656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b8a82780-71a6-431b-b9ea-c5296c050de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85083765ea5246bb90601320b4b27abc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:28.872406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f866a0-d48d-4da8-8be0-974fd59f76ce None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:28.875332 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1072/2136] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:28 2022] DELETE /identity/v3/users/85083765ea5246bb90601320b4b27abc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:28.876643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8f4b3-5dae-48c2-a532-b35402af6250 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.876959 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8f4b3-5dae-48c2-a532-b35402af6250 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.877257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8f4b3-5dae-48c2-a532-b35402af6250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.879156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69df5aa-b04b-46dc-a5e6-552b8d28ab0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:28.879789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69df5aa-b04b-46dc-a5e6-552b8d28ab0f service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.880070 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69df5aa-b04b-46dc-a5e6-552b8d28ab0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.880344 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69df5aa-b04b-46dc-a5e6-552b8d28ab0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.882197 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c69df5aa-b04b-46dc-a5e6-552b8d28ab0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:28.897495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ead8f4b3-5dae-48c2-a532-b35402af6250 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:28.898728 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ead8f4b3-5dae-48c2-a532-b35402af6250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:28.945471 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69df5aa-b04b-46dc-a5e6-552b8d28ab0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:28.946861 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69df5aa-b04b-46dc-a5e6-552b8d28ab0f service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:28.956071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1065/2137] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:28.957516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2d092-32dc-4b37-8fc1-0cbf7a93a136 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.957847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2d092-32dc-4b37-8fc1-0cbf7a93a136 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.958389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2d092-32dc-4b37-8fc1-0cbf7a93a136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.959336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1073/2138] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:28.963623 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8f4b3-5dae-48c2-a532-b35402af6250 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:28.974454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8f4b3-5dae-48c2-a532-b35402af6250 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:28.976461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:28.979429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bc0ea-1d2a-4d77-a471-cd1579ddd955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:28.980076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc0ea-1d2a-4d77-a471-cd1579ddd955 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:28.980353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc0ea-1d2a-4d77-a471-cd1579ddd955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:28.980814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bc0ea-1d2a-4d77-a471-cd1579ddd955 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:28.981629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bc0ea-1d2a-4d77-a471-cd1579ddd955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:28.981972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bc0ea-1d2a-4d77-a471-cd1579ddd955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:28.983651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7bc0ea-1d2a-4d77-a471-cd1579ddd955 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:28.987393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-08d2d092-32dc-4b37-8fc1-0cbf7a93a136 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:28.988957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-08d2d092-32dc-4b37-8fc1-0cbf7a93a136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:28.995926 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1074/2139] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:15:28.999841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1066/2140] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:29.000786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bc0ea-1d2a-4d77-a471-cd1579ddd955 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.008488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:29.012183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2d092-32dc-4b37-8fc1-0cbf7a93a136 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.013766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-08d2d092-32dc-4b37-8fc1-0cbf7a93a136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:29.015873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bc0ea-1d2a-4d77-a471-cd1579ddd955 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:29.023403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336db30-e1a9-48b6-a28a-33c6eae97da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:29.024038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336db30-e1a9-48b6-a28a-33c6eae97da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.024322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336db30-e1a9-48b6-a28a-33c6eae97da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.024585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336db30-e1a9-48b6-a28a-33c6eae97da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.025346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336db30-e1a9-48b6-a28a-33c6eae97da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:29.027667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336db30-e1a9-48b6-a28a-33c6eae97da4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:29.061169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1075/2141] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:28 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:29.065668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336db30-e1a9-48b6-a28a-33c6eae97da4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.079934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2d092-32dc-4b37-8fc1-0cbf7a93a136 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:29.138334 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336db30-e1a9-48b6-a28a-33c6eae97da4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:29.142225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d2c57-9e2a-4f0a-9ee3-59f7392bedd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:29.143154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d2c57-9e2a-4f0a-9ee3-59f7392bedd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.143516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d2c57-9e2a-4f0a-9ee3-59f7392bedd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.143991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d2c57-9e2a-4f0a-9ee3-59f7392bedd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.144309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191a38f-7fc9-40fb-8450-978924ce9fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:29.145025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a38f-7fc9-40fb-8450-978924ce9fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.145400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a38f-7fc9-40fb-8450-978924ce9fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.145556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a38f-7fc9-40fb-8450-978924ce9fbe admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.146324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191a38f-7fc9-40fb-8450-978924ce9fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:29.148182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191a38f-7fc9-40fb-8450-978924ce9fbe admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:29.155482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d2c57-9e2a-4f0a-9ee3-59f7392bedd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:29.157044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d2c57-9e2a-4f0a-9ee3-59f7392bedd9 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:29.169675 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1067/2142] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:29.175997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1076/2143] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:29 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:29.177150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d2c57-9e2a-4f0a-9ee3-59f7392bedd9 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.186826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d2c57-9e2a-4f0a-9ee3-59f7392bedd9 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:29.192076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfb078-a783-41dd-95c0-f64a83c1fec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:29.192933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfb078-a783-41dd-95c0-f64a83c1fec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.193079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfb078-a783-41dd-95c0-f64a83c1fec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.193371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfb078-a783-41dd-95c0-f64a83c1fec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.194091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfb078-a783-41dd-95c0-f64a83c1fec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:29.196017 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfb078-a783-41dd-95c0-f64a83c1fec6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:29.210832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1068/2144] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:29.212125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191a38f-7fc9-40fb-8450-978924ce9fbe admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.223058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191a38f-7fc9-40fb-8450-978924ce9fbe admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:29.245654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca9032-e41f-42ee-bd9c-0512db2de371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:29.246613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca9032-e41f-42ee-bd9c-0512db2de371 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.247161 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca9032-e41f-42ee-bd9c-0512db2de371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.247559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca9032-e41f-42ee-bd9c-0512db2de371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.248737 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca9032-e41f-42ee-bd9c-0512db2de371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:29.250624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca9032-e41f-42ee-bd9c-0512db2de371 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:29.279928 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1077/2145] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:29.285087 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfb078-a783-41dd-95c0-f64a83c1fec6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.298482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfb078-a783-41dd-95c0-f64a83c1fec6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:29.306764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6155f2-da5e-443f-8625-939b4835f3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:29.307629 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6155f2-da5e-443f-8625-939b4835f3d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.307991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6155f2-da5e-443f-8625-939b4835f3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.308384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6155f2-da5e-443f-8625-939b4835f3d9 admin admin] PATH_INFO: `/v3/projects/b459c9c869fb41f98185a0fea735adcb/users/896fa35beb4c4f4cb5bc437e14ec0f81/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.340411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6155f2-da5e-443f-8625-939b4835f3d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b459c9c869fb41f98185a0fea735adcb, user_id=896fa35beb4c4f4cb5bc437e14ec0f81, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:29.357906 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6155f2-da5e-443f-8625-939b4835f3d9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:29.380167 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1069/2146] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:29 2022] PUT /identity/v3/projects/b459c9c869fb41f98185a0fea735adcb/users/896fa35beb4c4f4cb5bc437e14ec0f81/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:29.390795 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d7089-4e93-40b3-a92a-e9017b229b9a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.391161 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d7089-4e93-40b3-a92a-e9017b229b9a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.391502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d7089-4e93-40b3-a92a-e9017b229b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.424524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e55d7089-4e93-40b3-a92a-e9017b229b9a None None] MFA Rules not processed for user `896fa35beb4c4f4cb5bc437e14ec0f81`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:29.425778 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e55d7089-4e93-40b3-a92a-e9017b229b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:29.493665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1078/2147] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:29.499481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6155f2-da5e-443f-8625-939b4835f3d9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.569023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d7089-4e93-40b3-a92a-e9017b229b9a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.570805 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e55d7089-4e93-40b3-a92a-e9017b229b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:29.581018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6155f2-da5e-443f-8625-939b4835f3d9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:29.586383 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d7089-4e93-40b3-a92a-e9017b229b9a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:29.587455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b1061-409e-4d32-ad45-6f7b8e807b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:29.588187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b1061-409e-4d32-ad45-6f7b8e807b2a admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.588695 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b1061-409e-4d32-ad45-6f7b8e807b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.588874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b1061-409e-4d32-ad45-6f7b8e807b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.589598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b1061-409e-4d32-ad45-6f7b8e807b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:29.591599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b1061-409e-4d32-ad45-6f7b8e807b2a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:29.592754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:29.593592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.593966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.594358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] PATH_INFO: `/v3/projects/83f3618f370541ee9c0b6826f9dfafed` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.596084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f3618f370541ee9c0b6826f9dfafed)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:29.598656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:29.625506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1070/2148] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:29 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:29.629705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b1061-409e-4d32-ad45-6f7b8e807b2a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.640141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:29.649226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:29.653665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f3618f370541ee9c0b6826f9dfafed', 'request_id': 'req-0235443e-e42d-49a4-b758-985d92127170'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:29.662479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f3618f370541ee9c0b6826f9dfafed', 'request_id': 'req-0235443e-e42d-49a4-b758-985d92127170'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:29.669292 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f3618f370541ee9c0b6826f9dfafed', 'request_id': 'req-0235443e-e42d-49a4-b758-985d92127170'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:29.681415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] The token cache is being invalidate because project 83f3618f370541ee9c0b6826f9dfafed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:29.681733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:29.682569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:29.684398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1079/2149] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:29 2022] DELETE /identity/v3/projects/83f3618f370541ee9c0b6826f9dfafed => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:29.688391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.689777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:29.701781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b1061-409e-4d32-ad45-6f7b8e807b2a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:29.756190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235443e-e42d-49a4-b758-985d92127170 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:29.759680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c2bf-fc56-4c9d-98fd-fcf468d21571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:29.760315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c2bf-fc56-4c9d-98fd-fcf468d21571 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.760596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c2bf-fc56-4c9d-98fd-fcf468d21571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.760871 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5c2bf-fc56-4c9d-98fd-fcf468d21571 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.761157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:29.761579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5c2bf-fc56-4c9d-98fd-fcf468d21571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:29.761948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.762434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.762785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] PATH_INFO: `/v3/users/b27788bd5ba34a1d99807bd2c9ea2a99` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.763577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5c2bf-fc56-4c9d-98fd-fcf468d21571 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:29.764235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27788bd5ba34a1d99807bd2c9ea2a99)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:29.766247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:29.792082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1071/2150] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:29 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:29.793340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c2bf-fc56-4c9d-98fd-fcf468d21571 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.795430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-78c5c2bf-fc56-4c9d-98fd-fcf468d21571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:29.808118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5c2bf-fc56-4c9d-98fd-fcf468d21571 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:29.813404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3c29-3c5c-4c25-8786-87d9e33bb684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:29.814034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3c29-3c5c-4c25-8786-87d9e33bb684 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.814315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3c29-3c5c-4c25-8786-87d9e33bb684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.814643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3c29-3c5c-4c25-8786-87d9e33bb684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.815285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef3c29-3c5c-4c25-8786-87d9e33bb684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:29.816910 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef3c29-3c5c-4c25-8786-87d9e33bb684 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:29.818319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27788bd5ba34a1d99807bd2c9ea2a99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:29.818947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27788bd5ba34a1d99807bd2c9ea2a99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:29.828584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27788bd5ba34a1d99807bd2c9ea2a99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:29.829134 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1072/2151] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:15:29.829401 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27788bd5ba34a1d99807bd2c9ea2a99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:29.842804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3c29-3c5c-4c25-8786-87d9e33bb684 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.843138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27788bd5ba34a1d99807bd2c9ea2a99'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:29.844706 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e5ef3c29-3c5c-4c25-8786-87d9e33bb684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:29.855467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1080/2152] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:29 2022] DELETE /identity/v3/users/b27788bd5ba34a1d99807bd2c9ea2a99 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:29.860658 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3c29-3c5c-4c25-8786-87d9e33bb684 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:29.926643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acb19b-293c-4971-83fc-4e671fb00feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:29.927480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acb19b-293c-4971-83fc-4e671fb00feb admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:29.927785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acb19b-293c-4971-83fc-4e671fb00feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:29.928062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acb19b-293c-4971-83fc-4e671fb00feb admin admin] PATH_INFO: `/v3/projects/5e57645694ea4800a3f580f27bbbed66/users/fa468df7deb946d397ad1fe4513fd57f/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:29.943596 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acb19b-293c-4971-83fc-4e671fb00feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e57645694ea4800a3f580f27bbbed66, user_id=fa468df7deb946d397ad1fe4513fd57f, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:29.946375 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acb19b-293c-4971-83fc-4e671fb00feb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:29.960392 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1073/2153] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:29 2022] PUT /identity/v3/projects/5e57645694ea4800a3f580f27bbbed66/users/fa468df7deb946d397ad1fe4513fd57f/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:29.964957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:29.982701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31881667-9259-427e-a76d-790c1ef31a47 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:30.047530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:30.062461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369fcea-4618-4c8d-a278-0beb3f9237f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:30.063205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369fcea-4618-4c8d-a278-0beb3f9237f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:30.063549 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369fcea-4618-4c8d-a278-0beb3f9237f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:30.063891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369fcea-4618-4c8d-a278-0beb3f9237f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:30.064669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369fcea-4618-4c8d-a278-0beb3f9237f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:30.066390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369fcea-4618-4c8d-a278-0beb3f9237f4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:30.077209 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1081/2154] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:15:30.081268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acb19b-293c-4971-83fc-4e671fb00feb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:30.092183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acb19b-293c-4971-83fc-4e671fb00feb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:30.097168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd7d22-5aee-4f93-b7b0-32e9ee61e8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:30.097856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd7d22-5aee-4f93-b7b0-32e9ee61e8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:30.098131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd7d22-5aee-4f93-b7b0-32e9ee61e8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:30.098464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd7d22-5aee-4f93-b7b0-32e9ee61e8ea admin admin] PATH_INFO: `/v3/projects/5e57645694ea4800a3f580f27bbbed66/users/fa468df7deb946d397ad1fe4513fd57f/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:30.100449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd7d22-5aee-4f93-b7b0-32e9ee61e8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e57645694ea4800a3f580f27bbbed66, user_id=fa468df7deb946d397ad1fe4513fd57f, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:30.103135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd7d22-5aee-4f93-b7b0-32e9ee61e8ea admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:30.115816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1074/2155] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:30 2022] PUT /identity/v3/projects/5e57645694ea4800a3f580f27bbbed66/users/fa468df7deb946d397ad1fe4513fd57f/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:30.127849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604f63c-5fff-48c1-bbc2-2bcd32149ad7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:30.128165 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604f63c-5fff-48c1-bbc2-2bcd32149ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:30.128478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604f63c-5fff-48c1-bbc2-2bcd32149ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:30.154885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd7d22-5aee-4f93-b7b0-32e9ee61e8ea admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:30.157173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a6cd7d22-5aee-4f93-b7b0-32e9ee61e8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:30.159350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e604f63c-5fff-48c1-bbc2-2bcd32149ad7 None None] MFA Rules not processed for user `fa468df7deb946d397ad1fe4513fd57f`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:30.160996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e604f63c-5fff-48c1-bbc2-2bcd32149ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:30.163977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:30.233078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd7d22-5aee-4f93-b7b0-32e9ee61e8ea admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:30.237136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1082/2156] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:30.241410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:30.241410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:30.241410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:30.241410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] PATH_INFO: `/v3/projects/7bf6efb0757042948d9da8ad3557ca0c` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:30.241836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf6efb0757042948d9da8ad3557ca0c)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:30.242251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:30.249998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604f63c-5fff-48c1-bbc2-2bcd32149ad7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:30.251472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e604f63c-5fff-48c1-bbc2-2bcd32149ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:30.296622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf6efb0757042948d9da8ad3557ca0c', 'request_id': 'req-08524f65-b05c-4129-983d-0283f8b255fa'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:30.305118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf6efb0757042948d9da8ad3557ca0c', 'request_id': 'req-08524f65-b05c-4129-983d-0283f8b255fa'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:30.311381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf6efb0757042948d9da8ad3557ca0c', 'request_id': 'req-08524f65-b05c-4129-983d-0283f8b255fa'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:30.314419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604f63c-5fff-48c1-bbc2-2bcd32149ad7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:30.325329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] The token cache is being invalidate because project 7bf6efb0757042948d9da8ad3557ca0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:30.325486 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:30.326605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:30.328625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1075/2157] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:30 2022] DELETE /identity/v3/projects/7bf6efb0757042948d9da8ad3557ca0c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:30.333600 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:30.335367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:30.376523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7389c-9de1-433d-a8e9-1d3bfb51b370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:30.377669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7389c-9de1-433d-a8e9-1d3bfb51b370 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:30.378034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7389c-9de1-433d-a8e9-1d3bfb51b370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:30.378369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7389c-9de1-433d-a8e9-1d3bfb51b370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:30.380612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0ea7389c-9de1-433d-a8e9-1d3bfb51b370 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:30.413491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08524f65-b05c-4129-983d-0283f8b255fa admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:30.420188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:30.420819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:30.421147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:30.421424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] PATH_INFO: `/v3/users/72e6c4ad8c6348a486031df288445bb6` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:30.422633 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e6c4ad8c6348a486031df288445bb6)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:30.424584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:30.430526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:30.456211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7389c-9de1-433d-a8e9-1d3bfb51b370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:30.457700 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7389c-9de1-433d-a8e9-1d3bfb51b370 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:30.469847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1083/2158] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:15:30.470515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:30.483868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e6c4ad8c6348a486031df288445bb6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:30.492400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e6c4ad8c6348a486031df288445bb6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:30.505103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e6c4ad8c6348a486031df288445bb6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:30.507449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e6c4ad8c6348a486031df288445bb6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:30.522912 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e6c4ad8c6348a486031df288445bb6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:30.546734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1076/2159] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:30 2022] DELETE /identity/v3/users/72e6c4ad8c6348a486031df288445bb6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:31.009242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7389c-9de1-433d-a8e9-1d3bfb51b370 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:31.044059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7389c-9de1-433d-a8e9-1d3bfb51b370 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:31.095927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:31.098112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:31.115202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5501f0c-e331-4a3d-a213-e4c54075ae54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:31.116044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5501f0c-e331-4a3d-a213-e4c54075ae54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.116331 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5501f0c-e331-4a3d-a213-e4c54075ae54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.116613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5501f0c-e331-4a3d-a213-e4c54075ae54 admin admin] PATH_INFO: `/v3/projects/a07d246381be483d8a7f38c4f5d5cfc7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.118010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5501f0c-e331-4a3d-a213-e4c54075ae54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07d246381be483d8a7f38c4f5d5cfc7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:31.120286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5501f0c-e331-4a3d-a213-e4c54075ae54 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:31.176491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5501f0c-e331-4a3d-a213-e4c54075ae54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07d246381be483d8a7f38c4f5d5cfc7', 'request_id': 'req-a5501f0c-e331-4a3d-a213-e4c54075ae54'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:31.186967 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5501f0c-e331-4a3d-a213-e4c54075ae54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07d246381be483d8a7f38c4f5d5cfc7', 'request_id': 'req-a5501f0c-e331-4a3d-a213-e4c54075ae54'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:31.196333 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5501f0c-e331-4a3d-a213-e4c54075ae54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07d246381be483d8a7f38c4f5d5cfc7', 'request_id': 'req-a5501f0c-e331-4a3d-a213-e4c54075ae54'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:31.200565 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a71544-dcd1-4780-9f33-a2775761c435 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:31.212051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5501f0c-e331-4a3d-a213-e4c54075ae54 admin admin] The token cache is being invalidate because project a07d246381be483d8a7f38c4f5d5cfc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:31.212458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5501f0c-e331-4a3d-a213-e4c54075ae54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:31.213171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5501f0c-e331-4a3d-a213-e4c54075ae54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:31.216939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1084/2160] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:31 2022] DELETE /identity/v3/projects/a07d246381be483d8a7f38c4f5d5cfc7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:31.220427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49d574-c4f4-4516-9298-3a4f9d041581 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.220814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49d574-c4f4-4516-9298-3a4f9d041581 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.221197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49d574-c4f4-4516-9298-3a4f9d041581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.242681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1a49d574-c4f4-4516-9298-3a4f9d041581 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:31.244070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1a49d574-c4f4-4516-9298-3a4f9d041581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:31.281216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c12690-3dd7-44b1-831b-a8cf1bc74d19 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa468df7deb946d397ad1fe4513fd57f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e57645694ea4800a3f580f27bbbed66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:31.281992 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12690-3dd7-44b1-831b-a8cf1bc74d19 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.282921 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12690-3dd7-44b1-831b-a8cf1bc74d19 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.283209 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c12690-3dd7-44b1-831b-a8cf1bc74d19 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.283934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c12690-3dd7-44b1-831b-a8cf1bc74d19 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:31.284641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c12690-3dd7-44b1-831b-a8cf1bc74d19 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:31.286193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c12690-3dd7-44b1-831b-a8cf1bc74d19 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:31.305768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1077/2161] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:15:31.306966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c12690-3dd7-44b1-831b-a8cf1bc74d19 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:31.309709 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b6c12690-3dd7-44b1-831b-a8cf1bc74d19 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:31.325020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c12690-3dd7-44b1-831b-a8cf1bc74d19 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:31.331075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5921a1-8f3f-4144-bfd6-5bd61d32dbb0 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa468df7deb946d397ad1fe4513fd57f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e57645694ea4800a3f580f27bbbed66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:31.332841 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5921a1-8f3f-4144-bfd6-5bd61d32dbb0 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.333277 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5921a1-8f3f-4144-bfd6-5bd61d32dbb0 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.333566 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5921a1-8f3f-4144-bfd6-5bd61d32dbb0 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.334318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5921a1-8f3f-4144-bfd6-5bd61d32dbb0 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:31.336720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5921a1-8f3f-4144-bfd6-5bd61d32dbb0 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:31.338254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1085/2162] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:31.347747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a528e26-76eb-4159-b9eb-f5a296cb09ac None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.348156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a528e26-76eb-4159-b9eb-f5a296cb09ac None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.348336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a528e26-76eb-4159-b9eb-f5a296cb09ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.389391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9a528e26-76eb-4159-b9eb-f5a296cb09ac None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:31.390904 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9a528e26-76eb-4159-b9eb-f5a296cb09ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:31.399567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:31.402119 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1078/2163] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:31 2022] POST /identity/v3/projects => generated 354 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:31.407461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5921a1-8f3f-4144-bfd6-5bd61d32dbb0 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:31.473699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:31.493492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1086/2164] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:31.497610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a528e26-76eb-4159-b9eb-f5a296cb09ac None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:31.512188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a528e26-76eb-4159-b9eb-f5a296cb09ac None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:31.518068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9c28d-e75e-458b-bb4e-08a1e82f6153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:31.519559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9c28d-e75e-458b-bb4e-08a1e82f6153 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.519943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9c28d-e75e-458b-bb4e-08a1e82f6153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.520501 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9c28d-e75e-458b-bb4e-08a1e82f6153 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.521475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9c28d-e75e-458b-bb4e-08a1e82f6153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:31.522045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9c28d-e75e-458b-bb4e-08a1e82f6153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:31.525582 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9c28d-e75e-458b-bb4e-08a1e82f6153 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:31.528431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5921a1-8f3f-4144-bfd6-5bd61d32dbb0 tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:31.542283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdb8b7-6753-4e73-9b13-ad66473117ea tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa468df7deb946d397ad1fe4513fd57f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e57645694ea4800a3f580f27bbbed66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:31.542283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdb8b7-6753-4e73-9b13-ad66473117ea tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.542283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdb8b7-6753-4e73-9b13-ad66473117ea tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.542706 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdb8b7-6753-4e73-9b13-ad66473117ea tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.542706 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdb8b7-6753-4e73-9b13-ad66473117ea tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:31.542706 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdb8b7-6753-4e73-9b13-ad66473117ea tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:31.542706 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdb8b7-6753-4e73-9b13-ad66473117ea tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:31.552584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1087/2165] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:15:31.557941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9c28d-e75e-458b-bb4e-08a1e82f6153 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:31.561178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1079/2166] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:15:31.576529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9c28d-e75e-458b-bb4e-08a1e82f6153 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:31.581553 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db09c22-20e7-4586-ace0-6f5cf6b84df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:31.582179 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db09c22-20e7-4586-ace0-6f5cf6b84df6 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.582466 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db09c22-20e7-4586-ace0-6f5cf6b84df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.582737 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db09c22-20e7-4586-ace0-6f5cf6b84df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.583411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db09c22-20e7-4586-ace0-6f5cf6b84df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:31.585371 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db09c22-20e7-4586-ace0-6f5cf6b84df6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:31.599539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdb8b7-6753-4e73-9b13-ad66473117ea tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:31.610801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdb8b7-6753-4e73-9b13-ad66473117ea tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:31.615983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa468df7deb946d397ad1fe4513fd57f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e57645694ea4800a3f580f27bbbed66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:31.616159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1088/2167] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:31 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:31.616381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.616667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.616983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] PATH_INFO: `/v3/projects/8170772d7113478285dc97c22225c86d` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.618393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8170772d7113478285dc97c22225c86d)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:31.620218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db09c22-20e7-4586-ace0-6f5cf6b84df6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:31.620328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:31.671855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8170772d7113478285dc97c22225c86d', 'request_id': 'req-337c4721-c3de-497c-a152-8917bca1109e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:31.681128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8170772d7113478285dc97c22225c86d', 'request_id': 'req-337c4721-c3de-497c-a152-8917bca1109e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:31.687306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8170772d7113478285dc97c22225c86d', 'request_id': 'req-337c4721-c3de-497c-a152-8917bca1109e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:31.688693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db09c22-20e7-4586-ace0-6f5cf6b84df6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:31.700216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] The token cache is being invalidate because project 8170772d7113478285dc97c22225c86d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:31.700498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:31.701179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:31.702844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1080/2168] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:31 2022] DELETE /identity/v3/projects/8170772d7113478285dc97c22225c86d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:31.750228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851bb01-dad6-4dd6-a3c5-b48e654ba11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:31.750850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851bb01-dad6-4dd6-a3c5-b48e654ba11f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.751128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851bb01-dad6-4dd6-a3c5-b48e654ba11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.751399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851bb01-dad6-4dd6-a3c5-b48e654ba11f admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.752074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851bb01-dad6-4dd6-a3c5-b48e654ba11f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:31.754016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851bb01-dad6-4dd6-a3c5-b48e654ba11f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:31.779607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1089/2169] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:31 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:31.781020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:31.782958 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:31.798971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4721-c3de-497c-a152-8917bca1109e tempest-VolumeQuotaClassesTest-1472070289 tempest-VolumeQuotaClassesTest-1472070289-project-admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:31.804243 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdfa56-450b-4259-8eb4-8ead8a668599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:31.804872 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdfa56-450b-4259-8eb4-8ead8a668599 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.805457 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdfa56-450b-4259-8eb4-8ead8a668599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.805565 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdfa56-450b-4259-8eb4-8ead8a668599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.806410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdfa56-450b-4259-8eb4-8ead8a668599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:31.808224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdfa56-450b-4259-8eb4-8ead8a668599 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:31.820944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1081/2170] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:31.824782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851bb01-dad6-4dd6-a3c5-b48e654ba11f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:31.840828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851bb01-dad6-4dd6-a3c5-b48e654ba11f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:31.848379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae0a2f-5e72-49eb-9136-0d634fb7a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:31.849482 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae0a2f-5e72-49eb-9136-0d634fb7a4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.851685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae0a2f-5e72-49eb-9136-0d634fb7a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.851685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae0a2f-5e72-49eb-9136-0d634fb7a4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.851685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae0a2f-5e72-49eb-9136-0d634fb7a4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:31.853688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae0a2f-5e72-49eb-9136-0d634fb7a4a5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:31.867246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1090/2171] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:31.868462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:31.874043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdfa56-450b-4259-8eb4-8ead8a668599 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:31.890559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdfa56-450b-4259-8eb4-8ead8a668599 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:31.899257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68696f8-6260-44cd-aa24-00099eb6e7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:31.900329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68696f8-6260-44cd-aa24-00099eb6e7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.900771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68696f8-6260-44cd-aa24-00099eb6e7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.901235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68696f8-6260-44cd-aa24-00099eb6e7ac admin admin] PATH_INFO: `/v3/projects/a4b5fec00db343499dff928535b61829/users/7d6f9f8613ef4f32ade3d948b2033e9d/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.927606 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68696f8-6260-44cd-aa24-00099eb6e7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b5fec00db343499dff928535b61829, user_id=7d6f9f8613ef4f32ade3d948b2033e9d, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:31.930430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68696f8-6260-44cd-aa24-00099eb6e7ac admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:31.935146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae0a2f-5e72-49eb-9136-0d634fb7a4a5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:31.937017 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c7ae0a2f-5e72-49eb-9136-0d634fb7a4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:31.949752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1082/2172] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:31 2022] PUT /identity/v3/projects/a4b5fec00db343499dff928535b61829/users/7d6f9f8613ef4f32ade3d948b2033e9d/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:31.951154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae0a2f-5e72-49eb-9136-0d634fb7a4a5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:31.960013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abc58f-837b-4331-94a9-2f3d9faa1c79 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:31.960325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abc58f-837b-4331-94a9-2f3d9faa1c79 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:31.960606 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abc58f-837b-4331-94a9-2f3d9faa1c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:31.995269 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-57abc58f-837b-4331-94a9-2f3d9faa1c79 None None] MFA Rules not processed for user `7d6f9f8613ef4f32ade3d948b2033e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:31.996790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-57abc58f-837b-4331-94a9-2f3d9faa1c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:32.022588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5d750-9358-4345-a875-db55c456dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:32.023164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d750-9358-4345-a875-db55c456dcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:32.023765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d750-9358-4345-a875-db55c456dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:32.024054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d750-9358-4345-a875-db55c456dcaf admin admin] PATH_INFO: `/v3/users/896fa35beb4c4f4cb5bc437e14ec0f81` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:32.025356 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5d750-9358-4345-a875-db55c456dcaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=896fa35beb4c4f4cb5bc437e14ec0f81)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:32.027662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5d750-9358-4345-a875-db55c456dcaf admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:32.075168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1083/2173] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:32.083990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b8d5d750-9358-4345-a875-db55c456dcaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896fa35beb4c4f4cb5bc437e14ec0f81'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.084658 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b8d5d750-9358-4345-a875-db55c456dcaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896fa35beb4c4f4cb5bc437e14ec0f81'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.086931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abc58f-837b-4331-94a9-2f3d9faa1c79 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:32.088446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-57abc58f-837b-4331-94a9-2f3d9faa1c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:32.092938 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b8d5d750-9358-4345-a875-db55c456dcaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896fa35beb4c4f4cb5bc437e14ec0f81'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.093629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b8d5d750-9358-4345-a875-db55c456dcaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896fa35beb4c4f4cb5bc437e14ec0f81'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.094691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:32.108090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b8d5d750-9358-4345-a875-db55c456dcaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896fa35beb4c4f4cb5bc437e14ec0f81'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.121512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1091/2174] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:31 2022] DELETE /identity/v3/users/896fa35beb4c4f4cb5bc437e14ec0f81 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:32.126050 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763c6ff-1c45-4239-9c4a-b0d8b07b6715 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:32.126352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763c6ff-1c45-4239-9c4a-b0d8b07b6715 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:32.126616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763c6ff-1c45-4239-9c4a-b0d8b07b6715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:32.145387 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d763c6ff-1c45-4239-9c4a-b0d8b07b6715 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:32.146599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d763c6ff-1c45-4239-9c4a-b0d8b07b6715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:32.148660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abc58f-837b-4331-94a9-2f3d9faa1c79 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:32.200911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd582e60-a0cd-4276-a7df-99e0775415b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:32.201655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd582e60-a0cd-4276-a7df-99e0775415b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:32.201939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd582e60-a0cd-4276-a7df-99e0775415b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:32.202211 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd582e60-a0cd-4276-a7df-99e0775415b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:32.204191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fd582e60-a0cd-4276-a7df-99e0775415b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:32.207201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1092/2175] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:32.218169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763c6ff-1c45-4239-9c4a-b0d8b07b6715 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:32.219734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d763c6ff-1c45-4239-9c4a-b0d8b07b6715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:32.243137 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:32.272954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd582e60-a0cd-4276-a7df-99e0775415b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:32.274424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd582e60-a0cd-4276-a7df-99e0775415b9 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:32.284994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1084/2176] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:15:32.287147 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763c6ff-1c45-4239-9c4a-b0d8b07b6715 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:32.291196 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabd1f7-9f5c-466f-b6f7-ee5288d6d2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:32.291766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabd1f7-9f5c-466f-b6f7-ee5288d6d2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:32.292044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabd1f7-9f5c-466f-b6f7-ee5288d6d2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:32.292315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabd1f7-9f5c-466f-b6f7-ee5288d6d2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:32.302160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabd1f7-9f5c-466f-b6f7-ee5288d6d2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:32.303598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabd1f7-9f5c-466f-b6f7-ee5288d6d2f2 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:32.313381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1093/2177] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:32.657130 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd582e60-a0cd-4276-a7df-99e0775415b9 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:32.658842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fd582e60-a0cd-4276-a7df-99e0775415b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:32.674985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd582e60-a0cd-4276-a7df-99e0775415b9 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:32.680481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:32.681605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:32.683190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:32.683323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] PATH_INFO: `/v3/projects/b459c9c869fb41f98185a0fea735adcb` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:32.685081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b459c9c869fb41f98185a0fea735adcb)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:32.687950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:32.759658 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b459c9c869fb41f98185a0fea735adcb', 'request_id': 'req-612794e6-99bb-409a-b9eb-191c1952ceee'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.767911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b459c9c869fb41f98185a0fea735adcb', 'request_id': 'req-612794e6-99bb-409a-b9eb-191c1952ceee'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.777001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b459c9c869fb41f98185a0fea735adcb', 'request_id': 'req-612794e6-99bb-409a-b9eb-191c1952ceee'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.787241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:32.801390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] The token cache is being invalidate because project b459c9c869fb41f98185a0fea735adcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:32.801390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.801390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.801390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1085/2178] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:32 2022] DELETE /identity/v3/projects/b459c9c869fb41f98185a0fea735adcb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:32.810081 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabd1f7-9f5c-466f-b6f7-ee5288d6d2f2 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:32.811234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:32.812623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:32.820001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabd1f7-9f5c-466f-b6f7-ee5288d6d2f2 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:32.878375 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612794e6-99bb-409a-b9eb-191c1952ceee admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:32.881829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acedcea-4d7d-418f-bcd5-d33b0badf9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:32.882479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acedcea-4d7d-418f-bcd5-d33b0badf9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:32.882760 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acedcea-4d7d-418f-bcd5-d33b0badf9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:32.882868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:32.883038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acedcea-4d7d-418f-bcd5-d33b0badf9b9 admin admin] PATH_INFO: `/v3/users/fa468df7deb946d397ad1fe4513fd57f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:32.883499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:32.883782 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:32.884061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] PATH_INFO: `/v3/users/f0437a0912a441b481ef810fc1b01734` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:32.884247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acedcea-4d7d-418f-bcd5-d33b0badf9b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa468df7deb946d397ad1fe4513fd57f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:32.885369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0437a0912a441b481ef810fc1b01734)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:32.886250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acedcea-4d7d-418f-bcd5-d33b0badf9b9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:32.887416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:32.936730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3acedcea-4d7d-418f-bcd5-d33b0badf9b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa468df7deb946d397ad1fe4513fd57f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.937432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3acedcea-4d7d-418f-bcd5-d33b0badf9b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa468df7deb946d397ad1fe4513fd57f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.938056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0437a0912a441b481ef810fc1b01734'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.946742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3acedcea-4d7d-418f-bcd5-d33b0badf9b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa468df7deb946d397ad1fe4513fd57f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.946922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0437a0912a441b481ef810fc1b01734'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.947486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3acedcea-4d7d-418f-bcd5-d33b0badf9b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa468df7deb946d397ad1fe4513fd57f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.956440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0437a0912a441b481ef810fc1b01734'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.957778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0437a0912a441b481ef810fc1b01734'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.961297 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3acedcea-4d7d-418f-bcd5-d33b0badf9b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa468df7deb946d397ad1fe4513fd57f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.973332 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0437a0912a441b481ef810fc1b01734'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:32.974896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1094/2179] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:32 2022] DELETE /identity/v3/users/fa468df7deb946d397ad1fe4513fd57f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:32.980510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1086/2180] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:32 2022] DELETE /identity/v3/users/f0437a0912a441b481ef810fc1b01734 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:32.985198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a20f3-fa1b-4539-8979-0a3e054bf452 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:32.985478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a20f3-fa1b-4539-8979-0a3e054bf452 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:32.985807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a20f3-fa1b-4539-8979-0a3e054bf452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:33.005174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-584a20f3-fa1b-4539-8979-0a3e054bf452 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:33.006393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-584a20f3-fa1b-4539-8979-0a3e054bf452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:33.055924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:33.076972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1095/2181] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:33.088684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:33.090341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:33.149100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78a533-c154-4331-acc3-72823bf17a36 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:33.157358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe777c-b5ac-441d-bbeb-a28ba6c56709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:33.158129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe777c-b5ac-441d-bbeb-a28ba6c56709 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:33.158413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe777c-b5ac-441d-bbeb-a28ba6c56709 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:33.158740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe777c-b5ac-441d-bbeb-a28ba6c56709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:33.168734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe777c-b5ac-441d-bbeb-a28ba6c56709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:33.170219 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe777c-b5ac-441d-bbeb-a28ba6c56709 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:33.180015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1087/2182] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:15:33.376187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a20f3-fa1b-4539-8979-0a3e054bf452 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:33.377788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-584a20f3-fa1b-4539-8979-0a3e054bf452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:33.390416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a20f3-fa1b-4539-8979-0a3e054bf452 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:33.397590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298036d-0ba7-40d6-a07b-b2ec06c038ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:33.398604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298036d-0ba7-40d6-a07b-b2ec06c038ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:33.398890 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298036d-0ba7-40d6-a07b-b2ec06c038ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:33.399370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298036d-0ba7-40d6-a07b-b2ec06c038ed admin admin] PATH_INFO: `/v3/projects/5e57645694ea4800a3f580f27bbbed66` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:33.400613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298036d-0ba7-40d6-a07b-b2ec06c038ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e57645694ea4800a3f580f27bbbed66)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:33.404606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298036d-0ba7-40d6-a07b-b2ec06c038ed admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:33.456911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1298036d-0ba7-40d6-a07b-b2ec06c038ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e57645694ea4800a3f580f27bbbed66', 'request_id': 'req-1298036d-0ba7-40d6-a07b-b2ec06c038ed'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.466958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1298036d-0ba7-40d6-a07b-b2ec06c038ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e57645694ea4800a3f580f27bbbed66', 'request_id': 'req-1298036d-0ba7-40d6-a07b-b2ec06c038ed'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.477609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1298036d-0ba7-40d6-a07b-b2ec06c038ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e57645694ea4800a3f580f27bbbed66', 'request_id': 'req-1298036d-0ba7-40d6-a07b-b2ec06c038ed'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.490640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1298036d-0ba7-40d6-a07b-b2ec06c038ed admin admin] The token cache is being invalidate because project 5e57645694ea4800a3f580f27bbbed66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:33.491002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1298036d-0ba7-40d6-a07b-b2ec06c038ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.491670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1298036d-0ba7-40d6-a07b-b2ec06c038ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.495393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe777c-b5ac-441d-bbeb-a28ba6c56709 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:33.496976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1096/2183] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:33 2022] DELETE /identity/v3/projects/5e57645694ea4800a3f580f27bbbed66 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:33.497235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-11fe777c-b5ac-441d-bbeb-a28ba6c56709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:33.498298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d97af5-4d91-4d36-aaaf-b84eca7c0965 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:33.498586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d97af5-4d91-4d36-aaaf-b84eca7c0965 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:33.498863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d97af5-4d91-4d36-aaaf-b84eca7c0965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:33.512292 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe777c-b5ac-441d-bbeb-a28ba6c56709 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:33.521859 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-84d97af5-4d91-4d36-aaaf-b84eca7c0965 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:33.523127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-84d97af5-4d91-4d36-aaaf-b84eca7c0965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:33.534313 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:33.579433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:33.580019 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:33.580350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:33.580635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] PATH_INFO: `/v3/projects/d004f0413929443a85d9fd8823bc5756` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:33.581848 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d004f0413929443a85d9fd8823bc5756)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:33.583796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:33.588218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1097/2184] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:33.596053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af19228-4e62-4fd5-bfc5-480db459e5c3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:33.596339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af19228-4e62-4fd5-bfc5-480db459e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:33.596614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af19228-4e62-4fd5-bfc5-480db459e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:33.620880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7af19228-4e62-4fd5-bfc5-480db459e5c3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:33.624663 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7af19228-4e62-4fd5-bfc5-480db459e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:33.640493 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd004f0413929443a85d9fd8823bc5756', 'request_id': 'req-363a326d-988c-4bec-ab8f-fd07e49ca0d4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.652399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd004f0413929443a85d9fd8823bc5756', 'request_id': 'req-363a326d-988c-4bec-ab8f-fd07e49ca0d4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.660001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd004f0413929443a85d9fd8823bc5756', 'request_id': 'req-363a326d-988c-4bec-ab8f-fd07e49ca0d4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.674746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] The token cache is being invalidate because project d004f0413929443a85d9fd8823bc5756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:33.675109 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.675838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.677824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1088/2185] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:33 2022] DELETE /identity/v3/projects/d004f0413929443a85d9fd8823bc5756 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:33.681389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:33.683299 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:33.701243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1098/2186] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:33.703813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af19228-4e62-4fd5-bfc5-480db459e5c3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:33.715491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af19228-4e62-4fd5-bfc5-480db459e5c3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:33.734237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b531793-6bf3-4abc-a761-0a724dc0b20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:33.735044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531793-6bf3-4abc-a761-0a724dc0b20e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:33.735366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531793-6bf3-4abc-a761-0a724dc0b20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:33.735643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b531793-6bf3-4abc-a761-0a724dc0b20e admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:33.736550 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b531793-6bf3-4abc-a761-0a724dc0b20e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:33.737022 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b531793-6bf3-4abc-a761-0a724dc0b20e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:33.738782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b531793-6bf3-4abc-a761-0a724dc0b20e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:33.740677 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:33.753693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1099/2187] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:15:33.759685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b531793-6bf3-4abc-a761-0a724dc0b20e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:33.765150 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a326d-988c-4bec-ab8f-fd07e49ca0d4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:33.771283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:33.772182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b531793-6bf3-4abc-a761-0a724dc0b20e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:33.772323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:33.772548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:33.772847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] PATH_INFO: `/v3/users/53e8303796504c7b8a3b5e0827f6aa1f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:33.774205 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e8303796504c7b8a3b5e0827f6aa1f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:33.776151 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:33.779384 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d351c-fedc-4238-b4ae-ba78f7f952b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:33.780713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d351c-fedc-4238-b4ae-ba78f7f952b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:33.781091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d351c-fedc-4238-b4ae-ba78f7f952b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:33.781434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d351c-fedc-4238-b4ae-ba78f7f952b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:33.782307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d351c-fedc-4238-b4ae-ba78f7f952b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:33.784207 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d351c-fedc-4238-b4ae-ba78f7f952b6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:33.816953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1100/2188] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:33 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:33.823255 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d351c-fedc-4238-b4ae-ba78f7f952b6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:33.873063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e8303796504c7b8a3b5e0827f6aa1f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.880443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:33.885515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e8303796504c7b8a3b5e0827f6aa1f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.905028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e8303796504c7b8a3b5e0827f6aa1f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.905948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e8303796504c7b8a3b5e0827f6aa1f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.920159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d351c-fedc-4238-b4ae-ba78f7f952b6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:33.925579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff1263-1412-4b44-845f-132a4f6afc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:33.926653 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff1263-1412-4b44-845f-132a4f6afc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:33.927131 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff1263-1412-4b44-845f-132a4f6afc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:33.928284 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff1263-1412-4b44-845f-132a4f6afc61 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:33.929144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff1263-1412-4b44-845f-132a4f6afc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:33.931619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff1263-1412-4b44-845f-132a4f6afc61 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:33.937253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e8303796504c7b8a3b5e0827f6aa1f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:33.947208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1089/2189] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:33 2022] DELETE /identity/v3/users/53e8303796504c7b8a3b5e0827f6aa1f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:33.957941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1101/2190] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:33 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:33.962070 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:33.966138 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:34.066003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f9387-a070-4af1-93b1-a4675fdcaa8f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:34.072052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dc62c-cb88-453d-872f-f86adf5a9d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:34.073142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dc62c-cb88-453d-872f-f86adf5a9d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:34.073559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dc62c-cb88-453d-872f-f86adf5a9d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:34.073968 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dc62c-cb88-453d-872f-f86adf5a9d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:34.074839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dc62c-cb88-453d-872f-f86adf5a9d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:34.076681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dc62c-cb88-453d-872f-f86adf5a9d7e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:34.090646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1090/2191] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:34.094944 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff1263-1412-4b44-845f-132a4f6afc61 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:34.106621 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff1263-1412-4b44-845f-132a4f6afc61 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:34.112043 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab4ad7-c99f-46e0-8cba-ec8904c01275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:34.112741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab4ad7-c99f-46e0-8cba-ec8904c01275 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:34.113130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab4ad7-c99f-46e0-8cba-ec8904c01275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:34.113475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab4ad7-c99f-46e0-8cba-ec8904c01275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:34.114250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab4ad7-c99f-46e0-8cba-ec8904c01275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:34.116583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab4ad7-c99f-46e0-8cba-ec8904c01275 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:34.128275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1102/2192] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:34.133052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dc62c-cb88-453d-872f-f86adf5a9d7e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:34.151198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dc62c-cb88-453d-872f-f86adf5a9d7e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:34.165279 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581d7a7-1c40-45cf-b3cf-6a86de658b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:34.165774 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581d7a7-1c40-45cf-b3cf-6a86de658b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:34.166041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581d7a7-1c40-45cf-b3cf-6a86de658b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:34.166316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581d7a7-1c40-45cf-b3cf-6a86de658b74 admin admin] PATH_INFO: `/v3/projects/9fbebeaa080f4d7fac7c5cdd8127bc63/users/15108c3b40ca481bad6d5c9638db93d3/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:34.182102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8581d7a7-1c40-45cf-b3cf-6a86de658b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fbebeaa080f4d7fac7c5cdd8127bc63, user_id=15108c3b40ca481bad6d5c9638db93d3, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:34.184911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8581d7a7-1c40-45cf-b3cf-6a86de658b74 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:34.206124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1091/2193] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:34 2022] PUT /identity/v3/projects/9fbebeaa080f4d7fac7c5cdd8127bc63/users/15108c3b40ca481bad6d5c9638db93d3/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:34.218116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28190c62-c6cd-4053-9b36-4150889d30a8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:34.219699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28190c62-c6cd-4053-9b36-4150889d30a8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:34.219699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28190c62-c6cd-4053-9b36-4150889d30a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:34.292786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-28190c62-c6cd-4053-9b36-4150889d30a8 None None] MFA Rules not processed for user `15108c3b40ca481bad6d5c9638db93d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:34.294159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-28190c62-c6cd-4053-9b36-4150889d30a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:34.368875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581d7a7-1c40-45cf-b3cf-6a86de658b74 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:34.370678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8581d7a7-1c40-45cf-b3cf-6a86de658b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:34.428766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1103/2194] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:34.440384 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28190c62-c6cd-4053-9b36-4150889d30a8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:34.442083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-28190c62-c6cd-4053-9b36-4150889d30a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:34.492816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:34.500143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581d7a7-1c40-45cf-b3cf-6a86de658b74 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:34.506731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656ab32-1910-4131-af03-1805b84b06e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:34.508007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656ab32-1910-4131-af03-1805b84b06e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:34.508353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656ab32-1910-4131-af03-1805b84b06e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:34.508638 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656ab32-1910-4131-af03-1805b84b06e0 admin admin] PATH_INFO: `/v3/projects/fb7289a6ba264de49cee871be6ef5ef4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:34.510618 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656ab32-1910-4131-af03-1805b84b06e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb7289a6ba264de49cee871be6ef5ef4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:34.513953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656ab32-1910-4131-af03-1805b84b06e0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:34.539037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28190c62-c6cd-4053-9b36-4150889d30a8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:34.542848 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdbe04-1461-45a1-b302-26ad464a9a0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c3d7cdad7f44f0f8df944ec7f69de26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:34.543543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdbe04-1461-45a1-b302-26ad464a9a0e service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:34.543821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdbe04-1461-45a1-b302-26ad464a9a0e service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:34.544116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdbe04-1461-45a1-b302-26ad464a9a0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:34.553357 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdbe04-1461-45a1-b302-26ad464a9a0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:34.554816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdbe04-1461-45a1-b302-26ad464a9a0e service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:34.566283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1104/2195] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:15:34.575408 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:34.579779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5656ab32-1910-4131-af03-1805b84b06e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb7289a6ba264de49cee871be6ef5ef4', 'request_id': 'req-5656ab32-1910-4131-af03-1805b84b06e0'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:34.592239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5656ab32-1910-4131-af03-1805b84b06e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb7289a6ba264de49cee871be6ef5ef4', 'request_id': 'req-5656ab32-1910-4131-af03-1805b84b06e0'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:34.599278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5656ab32-1910-4131-af03-1805b84b06e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb7289a6ba264de49cee871be6ef5ef4', 'request_id': 'req-5656ab32-1910-4131-af03-1805b84b06e0'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:34.611934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5656ab32-1910-4131-af03-1805b84b06e0 admin admin] The token cache is being invalidate because project fb7289a6ba264de49cee871be6ef5ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:34.612378 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5656ab32-1910-4131-af03-1805b84b06e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:34.613557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5656ab32-1910-4131-af03-1805b84b06e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:34.615333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1092/2196] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:34 2022] DELETE /identity/v3/projects/fb7289a6ba264de49cee871be6ef5ef4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:34.620116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6b4e4-7846-477e-aa13-f24970841e95 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:34.620535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6b4e4-7846-477e-aa13-f24970841e95 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:34.620878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6b4e4-7846-477e-aa13-f24970841e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:34.642451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4fd6b4e4-7846-477e-aa13-f24970841e95 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:34.643733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4fd6b4e4-7846-477e-aa13-f24970841e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:34.730438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1105/2197] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:34.739090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc7341-cada-4976-bdc0-fac1ebb356d5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:34.739379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc7341-cada-4976-bdc0-fac1ebb356d5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:34.739663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc7341-cada-4976-bdc0-fac1ebb356d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:34.770254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c1cc7341-cada-4976-bdc0-fac1ebb356d5 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:34.772183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c1cc7341-cada-4976-bdc0-fac1ebb356d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:34.784036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1093/2198] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:34.788314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6b4e4-7846-477e-aa13-f24970841e95 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:34.798809 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6b4e4-7846-477e-aa13-f24970841e95 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:34.803898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ef458-065a-4718-8ea5-b7835ed922f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:34.804523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef458-065a-4718-8ea5-b7835ed922f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:34.804800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef458-065a-4718-8ea5-b7835ed922f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:34.805094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef458-065a-4718-8ea5-b7835ed922f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:34.806046 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ef458-065a-4718-8ea5-b7835ed922f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:34.806186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ef458-065a-4718-8ea5-b7835ed922f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:34.808407 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ef458-065a-4718-8ea5-b7835ed922f4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:34.832408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1106/2199] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:15:34.833658 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc7341-cada-4976-bdc0-fac1ebb356d5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:34.844743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc7341-cada-4976-bdc0-fac1ebb356d5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:34.852654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd162545-bd39-4cfe-9b1a-8b5ab465686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:34.853726 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd162545-bd39-4cfe-9b1a-8b5ab465686e admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:34.854200 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd162545-bd39-4cfe-9b1a-8b5ab465686e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:34.854644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd162545-bd39-4cfe-9b1a-8b5ab465686e admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:34.855490 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd162545-bd39-4cfe-9b1a-8b5ab465686e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:34.857686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd162545-bd39-4cfe-9b1a-8b5ab465686e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:34.924370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1094/2200] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:34 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:34.928574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ef458-065a-4718-8ea5-b7835ed922f4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:34.940630 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ef458-065a-4718-8ea5-b7835ed922f4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:35.003833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964ff52-c9ef-4b35-8e68-4f738dc48dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:35.004472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964ff52-c9ef-4b35-8e68-4f738dc48dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:35.004753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964ff52-c9ef-4b35-8e68-4f738dc48dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:35.005066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964ff52-c9ef-4b35-8e68-4f738dc48dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:35.005730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964ff52-c9ef-4b35-8e68-4f738dc48dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:35.007652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964ff52-c9ef-4b35-8e68-4f738dc48dd0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:35.037297 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1107/2201] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:34 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:35.041740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd162545-bd39-4cfe-9b1a-8b5ab465686e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:35.065711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd162545-bd39-4cfe-9b1a-8b5ab465686e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:35.083463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca911fb-278b-4087-b13e-79c3f27e0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:35.083463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca911fb-278b-4087-b13e-79c3f27e0d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:35.083463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca911fb-278b-4087-b13e-79c3f27e0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:35.083463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca911fb-278b-4087-b13e-79c3f27e0d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:35.083865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca911fb-278b-4087-b13e-79c3f27e0d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:35.083865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca911fb-278b-4087-b13e-79c3f27e0d4d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:35.089373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1095/2202] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:35.093592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964ff52-c9ef-4b35-8e68-4f738dc48dd0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:35.106555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964ff52-c9ef-4b35-8e68-4f738dc48dd0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:35.113673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e95625-0826-4d0b-90ff-3d40937ff42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:35.114797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e95625-0826-4d0b-90ff-3d40937ff42c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:35.115252 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e95625-0826-4d0b-90ff-3d40937ff42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:35.115703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e95625-0826-4d0b-90ff-3d40937ff42c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:35.116581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e95625-0826-4d0b-90ff-3d40937ff42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:35.119405 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e95625-0826-4d0b-90ff-3d40937ff42c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:35.139196 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1108/2203] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:35.149461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca911fb-278b-4087-b13e-79c3f27e0d4d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:35.160268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca911fb-278b-4087-b13e-79c3f27e0d4d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:35.164862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292434f8-5dbf-431a-a796-deea75dcfee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:35.165567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292434f8-5dbf-431a-a796-deea75dcfee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:35.165875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292434f8-5dbf-431a-a796-deea75dcfee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:35.166114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292434f8-5dbf-431a-a796-deea75dcfee1 admin admin] PATH_INFO: `/v3/projects/c7177c8fc8ea47c7803490e2581c5b0a/users/f2d6addad2724ce4aabb85fd1edba160/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:35.183499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292434f8-5dbf-431a-a796-deea75dcfee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7177c8fc8ea47c7803490e2581c5b0a, user_id=f2d6addad2724ce4aabb85fd1edba160, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:35.186452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292434f8-5dbf-431a-a796-deea75dcfee1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:35.202627 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1096/2204] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:35 2022] PUT /identity/v3/projects/c7177c8fc8ea47c7803490e2581c5b0a/users/f2d6addad2724ce4aabb85fd1edba160/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:35.213420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6fd4-54ba-46f9-b7ce-6df8d51fe3ba None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:35.213710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6fd4-54ba-46f9-b7ce-6df8d51fe3ba None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:35.213980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab6fd4-54ba-46f9-b7ce-6df8d51fe3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:35.245923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c7ab6fd4-54ba-46f9-b7ce-6df8d51fe3ba None None] MFA Rules not processed for user `f2d6addad2724ce4aabb85fd1edba160`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:35.247099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c7ab6fd4-54ba-46f9-b7ce-6df8d51fe3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:35.269909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:35.323733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1109/2205] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:35.328397 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292434f8-5dbf-431a-a796-deea75dcfee1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:35.394184 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292434f8-5dbf-431a-a796-deea75dcfee1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:35.399131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb349b1-c8c7-494e-96b2-2577e04993c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:35.399768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb349b1-c8c7-494e-96b2-2577e04993c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:35.400045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb349b1-c8c7-494e-96b2-2577e04993c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:35.400322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb349b1-c8c7-494e-96b2-2577e04993c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:35.401033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb349b1-c8c7-494e-96b2-2577e04993c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:35.403474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb349b1-c8c7-494e-96b2-2577e04993c0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:35.436966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1097/2206] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:35 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:35.438863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab6fd4-54ba-46f9-b7ce-6df8d51fe3ba None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:35.450381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab6fd4-54ba-46f9-b7ce-6df8d51fe3ba None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:35.529437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27ca4e-7f89-4a89-8026-88e89c9f6429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:35.530079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ca4e-7f89-4a89-8026-88e89c9f6429 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:35.530404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ca4e-7f89-4a89-8026-88e89c9f6429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:35.530687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ca4e-7f89-4a89-8026-88e89c9f6429 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:35.531381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27ca4e-7f89-4a89-8026-88e89c9f6429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:35.533676 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27ca4e-7f89-4a89-8026-88e89c9f6429 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:35.563016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1110/2207] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:35 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:35.567282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb349b1-c8c7-494e-96b2-2577e04993c0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:35.597028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb349b1-c8c7-494e-96b2-2577e04993c0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:35.602403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13ef7-991d-4f95-bfb8-f4f836694a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:35.603027 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13ef7-991d-4f95-bfb8-f4f836694a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:35.603431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13ef7-991d-4f95-bfb8-f4f836694a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:35.603860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13ef7-991d-4f95-bfb8-f4f836694a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:35.604796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f13ef7-991d-4f95-bfb8-f4f836694a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:35.606631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f13ef7-991d-4f95-bfb8-f4f836694a96 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:35.620945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1098/2208] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:15:35.624323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27ca4e-7f89-4a89-8026-88e89c9f6429 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:35.635462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27ca4e-7f89-4a89-8026-88e89c9f6429 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:35.641845 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d86efd-6f24-4afd-9285-8504fd255b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:35.642152 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d86efd-6f24-4afd-9285-8504fd255b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:35.642448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d86efd-6f24-4afd-9285-8504fd255b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:35.642707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d86efd-6f24-4afd-9285-8504fd255b2a admin admin] PATH_INFO: `/v3/projects/e62a5b53af694b33b1dd05109acdd560/users/1f7e28a984d14b59bc1a843ca880ed76/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:35.663162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d86efd-6f24-4afd-9285-8504fd255b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62a5b53af694b33b1dd05109acdd560, user_id=1f7e28a984d14b59bc1a843ca880ed76, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:35.666048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d86efd-6f24-4afd-9285-8504fd255b2a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:35.684364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1111/2209] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:35 2022] PUT /identity/v3/projects/e62a5b53af694b33b1dd05109acdd560/users/1f7e28a984d14b59bc1a843ca880ed76/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:35.688506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13ef7-991d-4f95-bfb8-f4f836694a96 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:35.700318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13ef7-991d-4f95-bfb8-f4f836694a96 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:35.745892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:35.764126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18536a3e-851c-4112-b864-5d5ca517f5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:35.764709 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18536a3e-851c-4112-b864-5d5ca517f5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:35.765026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18536a3e-851c-4112-b864-5d5ca517f5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:35.765304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18536a3e-851c-4112-b864-5d5ca517f5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:35.766003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18536a3e-851c-4112-b864-5d5ca517f5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:35.767620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18536a3e-851c-4112-b864-5d5ca517f5f5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:35.781534 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1099/2210] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:35.783050 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d86efd-6f24-4afd-9285-8504fd255b2a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:35.794687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d86efd-6f24-4afd-9285-8504fd255b2a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:35.800502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51600d55-4f28-4669-bc9b-f90421cb8797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:35.801187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51600d55-4f28-4669-bc9b-f90421cb8797 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:35.801486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51600d55-4f28-4669-bc9b-f90421cb8797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:35.801764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51600d55-4f28-4669-bc9b-f90421cb8797 admin admin] PATH_INFO: `/v3/projects/e62a5b53af694b33b1dd05109acdd560/users/1f7e28a984d14b59bc1a843ca880ed76/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:35.804017 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51600d55-4f28-4669-bc9b-f90421cb8797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62a5b53af694b33b1dd05109acdd560, user_id=1f7e28a984d14b59bc1a843ca880ed76, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:35.806832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51600d55-4f28-4669-bc9b-f90421cb8797 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:35.818666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1112/2211] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:35 2022] PUT /identity/v3/projects/e62a5b53af694b33b1dd05109acdd560/users/1f7e28a984d14b59bc1a843ca880ed76/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:35.830868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263253bf-013b-42f8-9548-038e3545220a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:35.831188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263253bf-013b-42f8-9548-038e3545220a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:35.831572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263253bf-013b-42f8-9548-038e3545220a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:35.862812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-263253bf-013b-42f8-9548-038e3545220a None None] MFA Rules not processed for user `1f7e28a984d14b59bc1a843ca880ed76`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:35.864059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-263253bf-013b-42f8-9548-038e3545220a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:35.938667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1100/2212] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:35.950398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51600d55-4f28-4669-bc9b-f90421cb8797 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:35.952469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-51600d55-4f28-4669-bc9b-f90421cb8797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:36.030616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51600d55-4f28-4669-bc9b-f90421cb8797 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:36.035941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a70cf3-7d8b-4613-8360-f8053c5a1be1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:36.036800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a70cf3-7d8b-4613-8360-f8053c5a1be1 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:36.037185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a70cf3-7d8b-4613-8360-f8053c5a1be1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:36.037579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a70cf3-7d8b-4613-8360-f8053c5a1be1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:36.051966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a70cf3-7d8b-4613-8360-f8053c5a1be1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:36.053468 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a70cf3-7d8b-4613-8360-f8053c5a1be1 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:36.064701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1113/2213] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:36.770485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263253bf-013b-42f8-9548-038e3545220a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:36.835026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263253bf-013b-42f8-9548-038e3545220a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:36.839908 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:36.840589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:36.840918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:36.841173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] PATH_INFO: `/v3/users/f2d6addad2724ce4aabb85fd1edba160` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:36.842376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d6addad2724ce4aabb85fd1edba160)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:36.844299 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:36.901402 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d6addad2724ce4aabb85fd1edba160'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:36.909951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d6addad2724ce4aabb85fd1edba160'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:36.918197 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d6addad2724ce4aabb85fd1edba160'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:36.918894 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d6addad2724ce4aabb85fd1edba160'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:36.921253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:36.941166 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d6addad2724ce4aabb85fd1edba160'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:36.950665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1101/2214] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:36 2022] DELETE /identity/v3/users/f2d6addad2724ce4aabb85fd1edba160 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:36.955743 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82bf42-7770-4057-97a7-bdaab95fc4d7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:36.956300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82bf42-7770-4057-97a7-bdaab95fc4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:36.956300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82bf42-7770-4057-97a7-bdaab95fc4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:36.981294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0d82bf42-7770-4057-97a7-bdaab95fc4d7 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:36.983069 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0d82bf42-7770-4057-97a7-bdaab95fc4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:36.993057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:37.049024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1114/2215] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:37.059239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:37.060878 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:37.134044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e67dc-df62-4bd1-b9f6-a775dfd9f929 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:37.138034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b859c-2876-4639-914a-364782e3172b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:37.138644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b859c-2876-4639-914a-364782e3172b service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:37.138920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b859c-2876-4639-914a-364782e3172b service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:37.139192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b859c-2876-4639-914a-364782e3172b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:37.148464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b859c-2876-4639-914a-364782e3172b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:37.149965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b859c-2876-4639-914a-364782e3172b service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:37.160221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1102/2216] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:37.468943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82bf42-7770-4057-97a7-bdaab95fc4d7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:37.469524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0d82bf42-7770-4057-97a7-bdaab95fc4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:37.498186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82bf42-7770-4057-97a7-bdaab95fc4d7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:37.504404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:37.505095 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:37.505376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:37.505828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] PATH_INFO: `/v3/projects/c7177c8fc8ea47c7803490e2581c5b0a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:37.506951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7177c8fc8ea47c7803490e2581c5b0a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:37.509056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:37.568784 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7177c8fc8ea47c7803490e2581c5b0a', 'request_id': 'req-02a87e03-02ed-4121-bc69-699aa7298d04'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:37.575567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7177c8fc8ea47c7803490e2581c5b0a', 'request_id': 'req-02a87e03-02ed-4121-bc69-699aa7298d04'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:37.582077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7177c8fc8ea47c7803490e2581c5b0a', 'request_id': 'req-02a87e03-02ed-4121-bc69-699aa7298d04'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:37.594657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] The token cache is being invalidate because project c7177c8fc8ea47c7803490e2581c5b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:37.595088 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:37.596050 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:37.598649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1115/2217] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:37 2022] DELETE /identity/v3/projects/c7177c8fc8ea47c7803490e2581c5b0a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:37.603606 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b859c-2876-4639-914a-364782e3172b service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:37.616370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b859c-2876-4639-914a-364782e3172b service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:37.681918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f05da-fbad-4cc8-9d03-28690223ad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:37.682604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f05da-fbad-4cc8-9d03-28690223ad66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:37.683021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f05da-fbad-4cc8-9d03-28690223ad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:37.683297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f05da-fbad-4cc8-9d03-28690223ad66 admin admin] PATH_INFO: `/v3/users/1f7e28a984d14b59bc1a843ca880ed76` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:37.684761 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f05da-fbad-4cc8-9d03-28690223ad66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7e28a984d14b59bc1a843ca880ed76)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:37.686786 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f05da-fbad-4cc8-9d03-28690223ad66 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:37.737904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-541f05da-fbad-4cc8-9d03-28690223ad66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7e28a984d14b59bc1a843ca880ed76'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:37.745503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-541f05da-fbad-4cc8-9d03-28690223ad66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7e28a984d14b59bc1a843ca880ed76'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:37.754855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-541f05da-fbad-4cc8-9d03-28690223ad66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7e28a984d14b59bc1a843ca880ed76'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:37.755659 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-541f05da-fbad-4cc8-9d03-28690223ad66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7e28a984d14b59bc1a843ca880ed76'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:37.769423 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-541f05da-fbad-4cc8-9d03-28690223ad66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7e28a984d14b59bc1a843ca880ed76'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:37.775476 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1103/2218] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:37 2022] DELETE /identity/v3/users/1f7e28a984d14b59bc1a843ca880ed76 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:38.224444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:38.225986 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:38.239891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a87e03-02ed-4121-bc69-699aa7298d04 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:38.300602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e1b5f-69ff-436e-9b75-07239db264af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:38.301366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e1b5f-69ff-436e-9b75-07239db264af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:38.301645 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e1b5f-69ff-436e-9b75-07239db264af admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:38.301918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e1b5f-69ff-436e-9b75-07239db264af admin admin] PATH_INFO: `/v3/projects/e62a5b53af694b33b1dd05109acdd560` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:38.303182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e1b5f-69ff-436e-9b75-07239db264af admin admin] RBAC: Authorizing `identity:delete_project(project_id=e62a5b53af694b33b1dd05109acdd560)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:38.305300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e1b5f-69ff-436e-9b75-07239db264af admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:38.356153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:38.371035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7e1e1b5f-69ff-436e-9b75-07239db264af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e62a5b53af694b33b1dd05109acdd560', 'request_id': 'req-7e1e1b5f-69ff-436e-9b75-07239db264af'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:38.380596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7e1e1b5f-69ff-436e-9b75-07239db264af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e62a5b53af694b33b1dd05109acdd560', 'request_id': 'req-7e1e1b5f-69ff-436e-9b75-07239db264af'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:38.387505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7e1e1b5f-69ff-436e-9b75-07239db264af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e62a5b53af694b33b1dd05109acdd560', 'request_id': 'req-7e1e1b5f-69ff-436e-9b75-07239db264af'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:38.399859 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7e1e1b5f-69ff-436e-9b75-07239db264af admin admin] The token cache is being invalidate because project e62a5b53af694b33b1dd05109acdd560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:38.400070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7e1e1b5f-69ff-436e-9b75-07239db264af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:38.400733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7e1e1b5f-69ff-436e-9b75-07239db264af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:38.403023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1116/2219] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:38 2022] DELETE /identity/v3/projects/e62a5b53af694b33b1dd05109acdd560 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:38.408192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39582cd-7da2-4132-8907-b479cb942d43 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:38.408586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39582cd-7da2-4132-8907-b479cb942d43 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:38.408955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39582cd-7da2-4132-8907-b479cb942d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:38.418764 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:38.435365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b39582cd-7da2-4132-8907-b479cb942d43 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:38.436583 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b39582cd-7da2-4132-8907-b479cb942d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:38.504061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1104/2220] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:38.512245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dca04-a556-4603-a89f-90d68ca3d877 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:38.512540 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dca04-a556-4603-a89f-90d68ca3d877 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:38.512814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dca04-a556-4603-a89f-90d68ca3d877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:38.535631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-609dca04-a556-4603-a89f-90d68ca3d877 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:38.536870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-609dca04-a556-4603-a89f-90d68ca3d877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:38.545712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1117/2221] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:38.550388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39582cd-7da2-4132-8907-b479cb942d43 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:38.561067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39582cd-7da2-4132-8907-b479cb942d43 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:38.566122 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c39c8b-a2f4-4812-b0cc-022a492e15a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:38.566776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c39c8b-a2f4-4812-b0cc-022a492e15a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:38.567052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c39c8b-a2f4-4812-b0cc-022a492e15a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:38.567403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c39c8b-a2f4-4812-b0cc-022a492e15a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:38.568160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c39c8b-a2f4-4812-b0cc-022a492e15a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:38.568482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c39c8b-a2f4-4812-b0cc-022a492e15a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:38.570296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c39c8b-a2f4-4812-b0cc-022a492e15a4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:38.583416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1105/2222] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:15:38.588175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dca04-a556-4603-a89f-90d68ca3d877 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:38.597725 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dca04-a556-4603-a89f-90d68ca3d877 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:38.602921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c122a04-5f8e-4c30-a0ee-bc2db1f9f78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:38.603531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c122a04-5f8e-4c30-a0ee-bc2db1f9f78f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:38.603804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c122a04-5f8e-4c30-a0ee-bc2db1f9f78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:38.604174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c122a04-5f8e-4c30-a0ee-bc2db1f9f78f admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:38.604941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c122a04-5f8e-4c30-a0ee-bc2db1f9f78f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:38.606884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c122a04-5f8e-4c30-a0ee-bc2db1f9f78f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:38.636741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1118/2223] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:38 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:38.641360 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c39c8b-a2f4-4812-b0cc-022a492e15a4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:38.652727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c39c8b-a2f4-4812-b0cc-022a492e15a4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:38.713791 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4072e0-5ffa-45d6-9761-8fca2040a49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:38.714427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4072e0-5ffa-45d6-9761-8fca2040a49b admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:38.714703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4072e0-5ffa-45d6-9761-8fca2040a49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:38.714990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4072e0-5ffa-45d6-9761-8fca2040a49b admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:38.715787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4072e0-5ffa-45d6-9761-8fca2040a49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:38.717956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4072e0-5ffa-45d6-9761-8fca2040a49b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:38.752823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1106/2224] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:38 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:38.754005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c122a04-5f8e-4c30-a0ee-bc2db1f9f78f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:38.764720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c122a04-5f8e-4c30-a0ee-bc2db1f9f78f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:38.771084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a61cf-b426-4dac-9c89-581367a3bf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:38.771823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a61cf-b426-4dac-9c89-581367a3bf5d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:38.772128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a61cf-b426-4dac-9c89-581367a3bf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:38.772408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a61cf-b426-4dac-9c89-581367a3bf5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:38.773192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a61cf-b426-4dac-9c89-581367a3bf5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:38.774806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a61cf-b426-4dac-9c89-581367a3bf5d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:38.794635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1119/2225] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:38.796025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4072e0-5ffa-45d6-9761-8fca2040a49b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:38.806763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4072e0-5ffa-45d6-9761-8fca2040a49b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:38.811899 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10580555-96e2-4c87-9906-ae267f8719dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:38.812526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580555-96e2-4c87-9906-ae267f8719dd admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:38.812811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580555-96e2-4c87-9906-ae267f8719dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:38.813124 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580555-96e2-4c87-9906-ae267f8719dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:38.813997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10580555-96e2-4c87-9906-ae267f8719dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:38.815607 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10580555-96e2-4c87-9906-ae267f8719dd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:38.827162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1107/2226] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:38.831436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a61cf-b426-4dac-9c89-581367a3bf5d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:38.841616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a61cf-b426-4dac-9c89-581367a3bf5d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:38.846420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f396f-57d3-49c6-b013-9cb598353224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:38.847136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f396f-57d3-49c6-b013-9cb598353224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:38.847460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f396f-57d3-49c6-b013-9cb598353224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:38.847745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f396f-57d3-49c6-b013-9cb598353224 admin admin] PATH_INFO: `/v3/projects/8a7aff881caf45649041ae9a4cb3f1bf/users/029762412fcc49b4813ebc436fb1a817/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:38.863815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f396f-57d3-49c6-b013-9cb598353224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7aff881caf45649041ae9a4cb3f1bf, user_id=029762412fcc49b4813ebc436fb1a817, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:38.866576 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f396f-57d3-49c6-b013-9cb598353224 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:38.880944 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1120/2227] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:38 2022] PUT /identity/v3/projects/8a7aff881caf45649041ae9a4cb3f1bf/users/029762412fcc49b4813ebc436fb1a817/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:38.891611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f0d4e-424b-4a12-a8dd-e30bdcd0c79e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:38.891887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f0d4e-424b-4a12-a8dd-e30bdcd0c79e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:38.892294 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f0d4e-424b-4a12-a8dd-e30bdcd0c79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:38.924825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-192f0d4e-424b-4a12-a8dd-e30bdcd0c79e None None] MFA Rules not processed for user `029762412fcc49b4813ebc436fb1a817`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:38.926395 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-192f0d4e-424b-4a12-a8dd-e30bdcd0c79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:38.990862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:38.995176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1108/2228] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:38.999778 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f396f-57d3-49c6-b013-9cb598353224 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:39.062563 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f396f-57d3-49c6-b013-9cb598353224 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:39.068198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5768e-b3f2-42ad-af65-672afcbf0bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:39.068835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5768e-b3f2-42ad-af65-672afcbf0bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:39.069150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5768e-b3f2-42ad-af65-672afcbf0bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:39.069427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5768e-b3f2-42ad-af65-672afcbf0bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:39.070103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5768e-b3f2-42ad-af65-672afcbf0bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:39.072139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5768e-b3f2-42ad-af65-672afcbf0bbe admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:39.104666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1121/2229] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:38 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:39.105957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f0d4e-424b-4a12-a8dd-e30bdcd0c79e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:39.118642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f0d4e-424b-4a12-a8dd-e30bdcd0c79e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:39.190924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebac63-21b3-4c5a-bc7d-2590e60d55de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:39.191623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebac63-21b3-4c5a-bc7d-2590e60d55de admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:39.191976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebac63-21b3-4c5a-bc7d-2590e60d55de admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:39.192323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebac63-21b3-4c5a-bc7d-2590e60d55de admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:39.193390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebac63-21b3-4c5a-bc7d-2590e60d55de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:39.197044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebac63-21b3-4c5a-bc7d-2590e60d55de admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:39.223620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1109/2230] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:39 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:39.227611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5768e-b3f2-42ad-af65-672afcbf0bbe admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:39.239627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5768e-b3f2-42ad-af65-672afcbf0bbe admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:39.244744 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37693bcf-3053-4dd4-8078-8e197f94c881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:39.245486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37693bcf-3053-4dd4-8078-8e197f94c881 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:39.245774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37693bcf-3053-4dd4-8078-8e197f94c881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:39.246044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37693bcf-3053-4dd4-8078-8e197f94c881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:39.246819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37693bcf-3053-4dd4-8078-8e197f94c881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:39.248750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37693bcf-3053-4dd4-8078-8e197f94c881 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:39.268116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1122/2231] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:39.269108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebac63-21b3-4c5a-bc7d-2590e60d55de admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:39.282288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebac63-21b3-4c5a-bc7d-2590e60d55de admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:39.298263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a86d0f-e336-4f8f-98b4-dd094432c6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:39.299283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a86d0f-e336-4f8f-98b4-dd094432c6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:39.299585 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a86d0f-e336-4f8f-98b4-dd094432c6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:39.299845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a86d0f-e336-4f8f-98b4-dd094432c6ba admin admin] PATH_INFO: `/v3/projects/ddcf259a46c44f418a0a52fc677881a6/users/47a4437b99c24129b397259f66ac34be/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:39.324447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a86d0f-e336-4f8f-98b4-dd094432c6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddcf259a46c44f418a0a52fc677881a6, user_id=47a4437b99c24129b397259f66ac34be, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:39.327663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a86d0f-e336-4f8f-98b4-dd094432c6ba admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:39.343998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1110/2232] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:39 2022] PUT /identity/v3/projects/ddcf259a46c44f418a0a52fc677881a6/users/47a4437b99c24129b397259f66ac34be/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:15:39.349596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37693bcf-3053-4dd4-8078-8e197f94c881 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:39.365316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37693bcf-3053-4dd4-8078-8e197f94c881 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:39.435068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:39.469444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ce89a-22f5-4bf4-8df0-2574beef7bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:39.469444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ce89a-22f5-4bf4-8df0-2574beef7bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:39.469444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ce89a-22f5-4bf4-8df0-2574beef7bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:39.469444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ce89a-22f5-4bf4-8df0-2574beef7bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:39.469947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ce89a-22f5-4bf4-8df0-2574beef7bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:39.471512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ce89a-22f5-4bf4-8df0-2574beef7bc6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:39.487825 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1123/2233] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:39.488813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a86d0f-e336-4f8f-98b4-dd094432c6ba admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:39.500157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a86d0f-e336-4f8f-98b4-dd094432c6ba admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:39.505195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7bcd-cb57-45d7-9e9c-9d74a435c594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:39.505880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7bcd-cb57-45d7-9e9c-9d74a435c594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:39.506290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7bcd-cb57-45d7-9e9c-9d74a435c594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:39.506575 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7bcd-cb57-45d7-9e9c-9d74a435c594 admin admin] PATH_INFO: `/v3/projects/ddcf259a46c44f418a0a52fc677881a6/users/47a4437b99c24129b397259f66ac34be/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:39.509064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d7bcd-cb57-45d7-9e9c-9d74a435c594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddcf259a46c44f418a0a52fc677881a6, user_id=47a4437b99c24129b397259f66ac34be, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:39.512287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d7bcd-cb57-45d7-9e9c-9d74a435c594 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:39.535673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1111/2234] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:39 2022] PUT /identity/v3/projects/ddcf259a46c44f418a0a52fc677881a6/users/47a4437b99c24129b397259f66ac34be/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:39.551198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6737af-b285-4d21-93b1-74bc8725da8f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:39.552294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6737af-b285-4d21-93b1-74bc8725da8f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:39.552587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6737af-b285-4d21-93b1-74bc8725da8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:39.590225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ef6737af-b285-4d21-93b1-74bc8725da8f None None] MFA Rules not processed for user `47a4437b99c24129b397259f66ac34be`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:39.597851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ef6737af-b285-4d21-93b1-74bc8725da8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:39.687379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1124/2235] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:15:39.699892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7bcd-cb57-45d7-9e9c-9d74a435c594 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:39.701623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-295d7bcd-cb57-45d7-9e9c-9d74a435c594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:39.764445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7bcd-cb57-45d7-9e9c-9d74a435c594 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:39.769181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769c240-9e55-4576-83a2-d2be75db73e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:39.769874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769c240-9e55-4576-83a2-d2be75db73e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:39.770346 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769c240-9e55-4576-83a2-d2be75db73e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:39.770648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769c240-9e55-4576-83a2-d2be75db73e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:39.829876 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769c240-9e55-4576-83a2-d2be75db73e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:39.831543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769c240-9e55-4576-83a2-d2be75db73e2 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:39.841171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1112/2236] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:42.521322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6737af-b285-4d21-93b1-74bc8725da8f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:42.522838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ef6737af-b285-4d21-93b1-74bc8725da8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:42.590912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6737af-b285-4d21-93b1-74bc8725da8f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:42.595482 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c11713-50ce-42da-90e8-beea60558560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:42.596127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c11713-50ce-42da-90e8-beea60558560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:42.596408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c11713-50ce-42da-90e8-beea60558560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:42.596674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c11713-50ce-42da-90e8-beea60558560 admin admin] PATH_INFO: `/v3/users/9cedcecb65ea45aa8b37797907d69009` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:42.597872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c11713-50ce-42da-90e8-beea60558560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cedcecb65ea45aa8b37797907d69009)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:42.599797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c11713-50ce-42da-90e8-beea60558560 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:42.648434 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e7c11713-50ce-42da-90e8-beea60558560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cedcecb65ea45aa8b37797907d69009'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:42.649150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e7c11713-50ce-42da-90e8-beea60558560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cedcecb65ea45aa8b37797907d69009'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:42.657938 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e7c11713-50ce-42da-90e8-beea60558560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cedcecb65ea45aa8b37797907d69009'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:42.658569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e7c11713-50ce-42da-90e8-beea60558560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cedcecb65ea45aa8b37797907d69009'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:42.663978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:42.672151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e7c11713-50ce-42da-90e8-beea60558560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cedcecb65ea45aa8b37797907d69009'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:42.685449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1125/2237] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:42 2022] DELETE /identity/v3/users/9cedcecb65ea45aa8b37797907d69009 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:42.876178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769c240-9e55-4576-83a2-d2be75db73e2 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:42.889691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769c240-9e55-4576-83a2-d2be75db73e2 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:42.893995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:42.960060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7395a3c-f914-421c-a68e-3978819e82ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:42.960713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7395a3c-f914-421c-a68e-3978819e82ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:42.961028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7395a3c-f914-421c-a68e-3978819e82ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:42.961298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7395a3c-f914-421c-a68e-3978819e82ba admin admin] PATH_INFO: `/v3/projects/ab8827c8710749d387f23d4ce8b35fd4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:42.962482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7395a3c-f914-421c-a68e-3978819e82ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8827c8710749d387f23d4ce8b35fd4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:42.964403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7395a3c-f914-421c-a68e-3978819e82ba admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:43.013342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d7395a3c-f914-421c-a68e-3978819e82ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8827c8710749d387f23d4ce8b35fd4', 'request_id': 'req-d7395a3c-f914-421c-a68e-3978819e82ba'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:43.021864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d7395a3c-f914-421c-a68e-3978819e82ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8827c8710749d387f23d4ce8b35fd4', 'request_id': 'req-d7395a3c-f914-421c-a68e-3978819e82ba'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:43.028504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d7395a3c-f914-421c-a68e-3978819e82ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8827c8710749d387f23d4ce8b35fd4', 'request_id': 'req-d7395a3c-f914-421c-a68e-3978819e82ba'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:43.040344 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d7395a3c-f914-421c-a68e-3978819e82ba admin admin] The token cache is being invalidate because project ab8827c8710749d387f23d4ce8b35fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:43.040591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d7395a3c-f914-421c-a68e-3978819e82ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:43.041364 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d7395a3c-f914-421c-a68e-3978819e82ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:43.043013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1113/2238] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:42 2022] DELETE /identity/v3/projects/ab8827c8710749d387f23d4ce8b35fd4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:43.048197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c0c9f-774e-4bf7-bb64-bb2552df1c7a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:43.048476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c0c9f-774e-4bf7-bb64-bb2552df1c7a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:43.048753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c0c9f-774e-4bf7-bb64-bb2552df1c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:43.075376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8d0c0c9f-774e-4bf7-bb64-bb2552df1c7a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:43.077270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8d0c0c9f-774e-4bf7-bb64-bb2552df1c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:43.144063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1126/2239] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:43.152933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a690c-eeaf-4004-94d3-a82205a2b69c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:43.153297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a690c-eeaf-4004-94d3-a82205a2b69c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:43.153685 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a690c-eeaf-4004-94d3-a82205a2b69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:43.174853 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6d4a690c-eeaf-4004-94d3-a82205a2b69c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:43.176069 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6d4a690c-eeaf-4004-94d3-a82205a2b69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:43.185307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1114/2240] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:43.190535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c0c9f-774e-4bf7-bb64-bb2552df1c7a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:43.205796 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c0c9f-774e-4bf7-bb64-bb2552df1c7a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:43.213296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e013e0-68b6-4ca9-aa5b-f8ca605fa0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:43.213901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e013e0-68b6-4ca9-aa5b-f8ca605fa0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:43.214189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e013e0-68b6-4ca9-aa5b-f8ca605fa0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:43.214462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e013e0-68b6-4ca9-aa5b-f8ca605fa0a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:43.215244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e013e0-68b6-4ca9-aa5b-f8ca605fa0a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:43.215534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e013e0-68b6-4ca9-aa5b-f8ca605fa0a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:43.217198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e013e0-68b6-4ca9-aa5b-f8ca605fa0a5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:43.229275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1127/2241] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:15:43.235090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a690c-eeaf-4004-94d3-a82205a2b69c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:43.245632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a690c-eeaf-4004-94d3-a82205a2b69c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:43.251883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5130cf3-6100-4572-bac4-2b68f021028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:43.252499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130cf3-6100-4572-bac4-2b68f021028a admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:43.252780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130cf3-6100-4572-bac4-2b68f021028a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:43.253089 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130cf3-6100-4572-bac4-2b68f021028a admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:43.253772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5130cf3-6100-4572-bac4-2b68f021028a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:43.255697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5130cf3-6100-4572-bac4-2b68f021028a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:43.292087 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1115/2242] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:43 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:43.293463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e013e0-68b6-4ca9-aa5b-f8ca605fa0a5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:43.303936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e013e0-68b6-4ca9-aa5b-f8ca605fa0a5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:43.363192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f416c0-3e27-4c77-af72-5c16c2553175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:43.363820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f416c0-3e27-4c77-af72-5c16c2553175 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:43.364102 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f416c0-3e27-4c77-af72-5c16c2553175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:43.364374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f416c0-3e27-4c77-af72-5c16c2553175 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:43.365074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f416c0-3e27-4c77-af72-5c16c2553175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:43.367001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f416c0-3e27-4c77-af72-5c16c2553175 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:43.392248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1128/2243] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:43 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:43.396812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5130cf3-6100-4572-bac4-2b68f021028a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:43.408239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5130cf3-6100-4572-bac4-2b68f021028a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:43.414101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c47b3-5e6b-4376-b73a-87f5dd5e12a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:43.414822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c47b3-5e6b-4376-b73a-87f5dd5e12a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:43.415103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c47b3-5e6b-4376-b73a-87f5dd5e12a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:43.416000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c47b3-5e6b-4376-b73a-87f5dd5e12a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:43.416713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c47b3-5e6b-4376-b73a-87f5dd5e12a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:43.418510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c47b3-5e6b-4376-b73a-87f5dd5e12a9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:43.428940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1116/2244] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:43.433183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f416c0-3e27-4c77-af72-5c16c2553175 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:43.443746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f416c0-3e27-4c77-af72-5c16c2553175 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:43.449023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99813b-88c8-45df-a1eb-7e69729ca52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:43.449704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99813b-88c8-45df-a1eb-7e69729ca52a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:43.449979 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99813b-88c8-45df-a1eb-7e69729ca52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:43.450237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99813b-88c8-45df-a1eb-7e69729ca52a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:43.450935 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99813b-88c8-45df-a1eb-7e69729ca52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:43.452512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99813b-88c8-45df-a1eb-7e69729ca52a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:43.464005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1129/2245] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:43.468291 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c47b3-5e6b-4376-b73a-87f5dd5e12a9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:43.478576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c47b3-5e6b-4376-b73a-87f5dd5e12a9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:43.483740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c837f9-5515-4d78-bd45-c507d546927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:43.484383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c837f9-5515-4d78-bd45-c507d546927c admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:43.484662 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c837f9-5515-4d78-bd45-c507d546927c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:43.484964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c837f9-5515-4d78-bd45-c507d546927c admin admin] PATH_INFO: `/v3/projects/f3385eb4afc441ba834ec0ddc1c3fd9a/users/723cdd3baceb4f51a57df4863af99c3e/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:43.500927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c837f9-5515-4d78-bd45-c507d546927c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3385eb4afc441ba834ec0ddc1c3fd9a, user_id=723cdd3baceb4f51a57df4863af99c3e, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:43.503684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c837f9-5515-4d78-bd45-c507d546927c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:43.518695 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1117/2246] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:43 2022] PUT /identity/v3/projects/f3385eb4afc441ba834ec0ddc1c3fd9a/users/723cdd3baceb4f51a57df4863af99c3e/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:43.524195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03156316-9336-4378-9091-1093aa909bbe None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:43.524688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03156316-9336-4378-9091-1093aa909bbe None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:43.524787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03156316-9336-4378-9091-1093aa909bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:43.547479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-03156316-9336-4378-9091-1093aa909bbe None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:43.549430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-03156316-9336-4378-9091-1093aa909bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:43.605164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:43.627375 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1130/2247] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:43.637364 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c837f9-5515-4d78-bd45-c507d546927c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:43.639245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f3c837f9-5515-4d78-bd45-c507d546927c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:43.675806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:43.701136 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c837f9-5515-4d78-bd45-c507d546927c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:43.704916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725352f1-fd48-456b-9e15-9bf167552cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:43.705785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725352f1-fd48-456b-9e15-9bf167552cbc service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:43.706063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725352f1-fd48-456b-9e15-9bf167552cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:43.706333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725352f1-fd48-456b-9e15-9bf167552cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:43.716628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725352f1-fd48-456b-9e15-9bf167552cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:43.718115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725352f1-fd48-456b-9e15-9bf167552cbc service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:43.728055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1118/2248] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:48.682435 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e116c0a-beb1-4a97-bc6f-14160c4d7cbc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:48.683109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e116c0a-beb1-4a97-bc6f-14160c4d7cbc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:48.683109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e116c0a-beb1-4a97-bc6f-14160c4d7cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:48.715062 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2e116c0a-beb1-4a97-bc6f-14160c4d7cbc None None] MFA Rules not processed for user `723cdd3baceb4f51a57df4863af99c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:48.716439 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2e116c0a-beb1-4a97-bc6f-14160c4d7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:48.798443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1131/2249] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:48.812945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725352f1-fd48-456b-9e15-9bf167552cbc service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:48.814529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-725352f1-fd48-456b-9e15-9bf167552cbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:48.899102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725352f1-fd48-456b-9e15-9bf167552cbc service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:48.905780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d83f4-4d0a-49c1-8553-61c8008d2837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:48.906415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d83f4-4d0a-49c1-8553-61c8008d2837 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:48.906731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d83f4-4d0a-49c1-8553-61c8008d2837 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:48.907008 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d83f4-4d0a-49c1-8553-61c8008d2837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:48.921466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d83f4-4d0a-49c1-8553-61c8008d2837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:48.923881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d83f4-4d0a-49c1-8553-61c8008d2837 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:48.935860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1119/2250] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:49.853357 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e116c0a-beb1-4a97-bc6f-14160c4d7cbc None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:49.855812 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2e116c0a-beb1-4a97-bc6f-14160c4d7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:49.932170 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e116c0a-beb1-4a97-bc6f-14160c4d7cbc None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:49.938905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96466284-735a-4f24-b145-e2e6a37bd510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:49.952843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96466284-735a-4f24-b145-e2e6a37bd510 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:49.954352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96466284-735a-4f24-b145-e2e6a37bd510 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:49.955083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96466284-735a-4f24-b145-e2e6a37bd510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:49.959369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-96466284-735a-4f24-b145-e2e6a37bd510 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:50.057021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96466284-735a-4f24-b145-e2e6a37bd510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:50.058963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96466284-735a-4f24-b145-e2e6a37bd510 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:50.071896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1132/2251] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:50.408635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607657ca-23b0-400d-a40f-8f1385d9c82e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:50.409708 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607657ca-23b0-400d-a40f-8f1385d9c82e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:50.410308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607657ca-23b0-400d-a40f-8f1385d9c82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:50.437325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-607657ca-23b0-400d-a40f-8f1385d9c82e None None] MFA Rules not processed for user `723cdd3baceb4f51a57df4863af99c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:50.438714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-607657ca-23b0-400d-a40f-8f1385d9c82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:50.447236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1120/2252] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:55.399854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96466284-735a-4f24-b145-e2e6a37bd510 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:55.402160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-96466284-735a-4f24-b145-e2e6a37bd510 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:55.417166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96466284-735a-4f24-b145-e2e6a37bd510 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:55.422454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:55.423107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:55.423384 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:55.423659 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] PATH_INFO: `/v3/users/029762412fcc49b4813ebc436fb1a817` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:55.424856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029762412fcc49b4813ebc436fb1a817)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:55.426841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:55.450748 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:55.479292 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029762412fcc49b4813ebc436fb1a817'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:55.480335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029762412fcc49b4813ebc436fb1a817'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:55.492619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029762412fcc49b4813ebc436fb1a817'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:55.493412 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029762412fcc49b4813ebc436fb1a817'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:55.505835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029762412fcc49b4813ebc436fb1a817'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:55.518078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1133/2253] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:55 2022] DELETE /identity/v3/users/029762412fcc49b4813ebc436fb1a817 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:55.522893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c23502-a801-4a6b-b028-507abb1ba13d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:55.523402 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c23502-a801-4a6b-b028-507abb1ba13d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:55.523402 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c23502-a801-4a6b-b028-507abb1ba13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:55.542775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f6c23502-a801-4a6b-b028-507abb1ba13d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:55.543964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f6c23502-a801-4a6b-b028-507abb1ba13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:55.616573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1121/2254] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:55.627733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:55.629440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:55.699265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da1f97-5c35-49c8-8024-0b7c0ee3bb20 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:55.703611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab81be-08d1-4238-8f14-67c521bc38d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:55.704237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab81be-08d1-4238-8f14-67c521bc38d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:55.704518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab81be-08d1-4238-8f14-67c521bc38d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:55.704790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab81be-08d1-4238-8f14-67c521bc38d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:55.714098 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab81be-08d1-4238-8f14-67c521bc38d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:55.715523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab81be-08d1-4238-8f14-67c521bc38d9 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:55.725039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1134/2255] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:15:56.062682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c23502-a801-4a6b-b028-507abb1ba13d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:56.064139 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f6c23502-a801-4a6b-b028-507abb1ba13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:56.078137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c23502-a801-4a6b-b028-507abb1ba13d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:56.089074 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:56.089775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:56.090055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:56.090304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] PATH_INFO: `/v3/projects/8a7aff881caf45649041ae9a4cb3f1bf` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:56.091515 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a7aff881caf45649041ae9a4cb3f1bf)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:56.093744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:56.147316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a7aff881caf45649041ae9a4cb3f1bf', 'request_id': 'req-36fa55d1-db43-4d13-910b-6a407506aea1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.149667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:56.157772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a7aff881caf45649041ae9a4cb3f1bf', 'request_id': 'req-36fa55d1-db43-4d13-910b-6a407506aea1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.164482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a7aff881caf45649041ae9a4cb3f1bf', 'request_id': 'req-36fa55d1-db43-4d13-910b-6a407506aea1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.176834 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] The token cache is being invalidate because project 8a7aff881caf45649041ae9a4cb3f1bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:56.177079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.177717 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.179298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1122/2256] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:56 2022] DELETE /identity/v3/projects/8a7aff881caf45649041ae9a4cb3f1bf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:56.183459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab81be-08d1-4238-8f14-67c521bc38d9 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:56.193165 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab81be-08d1-4238-8f14-67c521bc38d9 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:56.251083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1a086-f79d-460a-9a5b-aca57fcafd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:56.251911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1a086-f79d-460a-9a5b-aca57fcafd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:56.252222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1a086-f79d-460a-9a5b-aca57fcafd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:56.252504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1a086-f79d-460a-9a5b-aca57fcafd3d admin admin] PATH_INFO: `/v3/users/47a4437b99c24129b397259f66ac34be` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:56.253737 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1a086-f79d-460a-9a5b-aca57fcafd3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a4437b99c24129b397259f66ac34be)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:56.255669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1a086-f79d-460a-9a5b-aca57fcafd3d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:56.309063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:56.314565 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-14c1a086-f79d-460a-9a5b-aca57fcafd3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a4437b99c24129b397259f66ac34be'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.315470 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-14c1a086-f79d-460a-9a5b-aca57fcafd3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a4437b99c24129b397259f66ac34be'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.324206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-14c1a086-f79d-460a-9a5b-aca57fcafd3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a4437b99c24129b397259f66ac34be'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.324856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-14c1a086-f79d-460a-9a5b-aca57fcafd3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a4437b99c24129b397259f66ac34be'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.337522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-14c1a086-f79d-460a-9a5b-aca57fcafd3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a4437b99c24129b397259f66ac34be'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.351136 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1135/2257] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:15:56 2022] DELETE /identity/v3/users/47a4437b99c24129b397259f66ac34be => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:56.656497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:56.658521 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:56.675653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa55d1-db43-4d13-910b-6a407506aea1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:56.742640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:56.743371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:56.743656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:56.743926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3 admin admin] PATH_INFO: `/v3/projects/ddcf259a46c44f418a0a52fc677881a6` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:56.745175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddcf259a46c44f418a0a52fc677881a6)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:56.747205 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:56.803215 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddcf259a46c44f418a0a52fc677881a6', 'request_id': 'req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.811206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddcf259a46c44f418a0a52fc677881a6', 'request_id': 'req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.818066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddcf259a46c44f418a0a52fc677881a6', 'request_id': 'req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.831019 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3 admin admin] The token cache is being invalidate because project ddcf259a46c44f418a0a52fc677881a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:15:56.831223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.831992 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8a5c7073-013a-4fb3-bda5-5a1cb21373d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:15:56.835117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1123/2258] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:15:56 2022] DELETE /identity/v3/projects/ddcf259a46c44f418a0a52fc677881a6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:56.843104 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb512d3-a26e-498b-8547-81daf2d54bc4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:56.843605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb512d3-a26e-498b-8547-81daf2d54bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:56.843715 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb512d3-a26e-498b-8547-81daf2d54bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:56.867106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-acb512d3-a26e-498b-8547-81daf2d54bc4 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:56.868365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-acb512d3-a26e-498b-8547-81daf2d54bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:56.934332 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1136/2259] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:56.944101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c1c29-f28f-4709-a1b6-bea8b63fe831 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:56.944463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c1c29-f28f-4709-a1b6-bea8b63fe831 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:56.944816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c1c29-f28f-4709-a1b6-bea8b63fe831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:56.968113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a64c1c29-f28f-4709-a1b6-bea8b63fe831 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:56.969381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a64c1c29-f28f-4709-a1b6-bea8b63fe831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:56.979773 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1124/2260] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:56.985408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb512d3-a26e-498b-8547-81daf2d54bc4 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:56.998636 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb512d3-a26e-498b-8547-81daf2d54bc4 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:57.007015 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37499faf-31c2-45f7-a6e4-78b04d23dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:57.007814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37499faf-31c2-45f7-a6e4-78b04d23dcee admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:57.008127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37499faf-31c2-45f7-a6e4-78b04d23dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:57.008489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37499faf-31c2-45f7-a6e4-78b04d23dcee admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:57.009311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37499faf-31c2-45f7-a6e4-78b04d23dcee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:15:57.009677 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37499faf-31c2-45f7-a6e4-78b04d23dcee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:57.011478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37499faf-31c2-45f7-a6e4-78b04d23dcee admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:57.024795 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1137/2261] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:15:57.030164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c1c29-f28f-4709-a1b6-bea8b63fe831 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:57.040502 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c1c29-f28f-4709-a1b6-bea8b63fe831 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:57.046615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4844105-8da1-4672-8048-40ee660a3c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:57.047571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4844105-8da1-4672-8048-40ee660a3c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:57.048055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4844105-8da1-4672-8048-40ee660a3c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:57.048740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4844105-8da1-4672-8048-40ee660a3c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:57.050229 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4844105-8da1-4672-8048-40ee660a3c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:57.052995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4844105-8da1-4672-8048-40ee660a3c05 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:57.087479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1125/2262] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:15:57 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:15:57.088604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37499faf-31c2-45f7-a6e4-78b04d23dcee admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:57.099637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37499faf-31c2-45f7-a6e4-78b04d23dcee admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:57.162635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe0949-c6aa-47ce-9741-bf10f474ff0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:57.163310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe0949-c6aa-47ce-9741-bf10f474ff0b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:57.163592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe0949-c6aa-47ce-9741-bf10f474ff0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:57.163867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe0949-c6aa-47ce-9741-bf10f474ff0b admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:57.164544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe0949-c6aa-47ce-9741-bf10f474ff0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:57.166643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe0949-c6aa-47ce-9741-bf10f474ff0b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:57.193363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1138/2263] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:15:57 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:15:57.198339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4844105-8da1-4672-8048-40ee660a3c05 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:57.209733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4844105-8da1-4672-8048-40ee660a3c05 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:57.214662 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc4426-8a41-43a6-a3d3-b7325b21f32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:57.215290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc4426-8a41-43a6-a3d3-b7325b21f32b admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:57.215567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc4426-8a41-43a6-a3d3-b7325b21f32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:57.216056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc4426-8a41-43a6-a3d3-b7325b21f32b admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:57.216763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc4426-8a41-43a6-a3d3-b7325b21f32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:57.218511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc4426-8a41-43a6-a3d3-b7325b21f32b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:57.228919 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1126/2264] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:15:57.232818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe0949-c6aa-47ce-9741-bf10f474ff0b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:57.243758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe0949-c6aa-47ce-9741-bf10f474ff0b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:57.249488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b729f97-4d35-49e7-804c-8d789ab9501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:57.250198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b729f97-4d35-49e7-804c-8d789ab9501a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:57.250490 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b729f97-4d35-49e7-804c-8d789ab9501a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:57.250765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b729f97-4d35-49e7-804c-8d789ab9501a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:57.251549 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b729f97-4d35-49e7-804c-8d789ab9501a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:57.253358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b729f97-4d35-49e7-804c-8d789ab9501a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:57.272936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1139/2265] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:15:57.275840 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc4426-8a41-43a6-a3d3-b7325b21f32b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:57.294665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc4426-8a41-43a6-a3d3-b7325b21f32b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:57.299751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b138c-5c3f-4781-a407-309fbf2255ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:57.300435 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b138c-5c3f-4781-a407-309fbf2255ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:57.300716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b138c-5c3f-4781-a407-309fbf2255ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:57.301034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b138c-5c3f-4781-a407-309fbf2255ac admin admin] PATH_INFO: `/v3/projects/239515704b194781808a13acdf1b38f6/users/f78ee81d6fea40d0992d4aa18c230ed2/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:57.320889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b138c-5c3f-4781-a407-309fbf2255ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=239515704b194781808a13acdf1b38f6, user_id=f78ee81d6fea40d0992d4aa18c230ed2, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:57.323712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b138c-5c3f-4781-a407-309fbf2255ac admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:57.338962 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1127/2266] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:15:57 2022] PUT /identity/v3/projects/239515704b194781808a13acdf1b38f6/users/f78ee81d6fea40d0992d4aa18c230ed2/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:15:57.351695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eac6e2-16b2-4aca-a333-29a34bd9c06e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:57.351978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eac6e2-16b2-4aca-a333-29a34bd9c06e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:57.352223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eac6e2-16b2-4aca-a333-29a34bd9c06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:57.381230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b2eac6e2-16b2-4aca-a333-29a34bd9c06e None None] MFA Rules not processed for user `f78ee81d6fea40d0992d4aa18c230ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:15:57.382437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b2eac6e2-16b2-4aca-a333-29a34bd9c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:57.394541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:57.451690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1140/2267] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:15:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:15:57.463169 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b138c-5c3f-4781-a407-309fbf2255ac admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:15:57.464925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-441b138c-5c3f-4781-a407-309fbf2255ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:15:57.471642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:15:57.528931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b138c-5c3f-4781-a407-309fbf2255ac admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:15:57.541100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e772c2-9cbf-433a-844b-4e3da669b74c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:15:57.541100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e772c2-9cbf-433a-844b-4e3da669b74c service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:15:57.541100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e772c2-9cbf-433a-844b-4e3da669b74c service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:15:57.541100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e772c2-9cbf-433a-844b-4e3da669b74c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:15:57.543447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e772c2-9cbf-433a-844b-4e3da669b74c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:15:57.545213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e772c2-9cbf-433a-844b-4e3da669b74c service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:15:57.554453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1128/2268] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:15:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:16:07.448355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=21 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:07.550274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=24 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:12.397426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eac6e2-16b2-4aca-a333-29a34bd9c06e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:12.472172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eac6e2-16b2-4aca-a333-29a34bd9c06e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:12.480106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:12.481058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:12.481462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:12.481861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] PATH_INFO: `/v3/users/f78ee81d6fea40d0992d4aa18c230ed2` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:12.483303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f78ee81d6fea40d0992d4aa18c230ed2)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:12.485320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:12.537243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f78ee81d6fea40d0992d4aa18c230ed2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:12.537927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f78ee81d6fea40d0992d4aa18c230ed2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:12.548078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f78ee81d6fea40d0992d4aa18c230ed2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:12.548800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f78ee81d6fea40d0992d4aa18c230ed2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:12.560740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f78ee81d6fea40d0992d4aa18c230ed2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:12.574489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1141/2269] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:16:12 2022] DELETE /identity/v3/users/f78ee81d6fea40d0992d4aa18c230ed2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:12.579269 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566f76-b2e0-4f99-b077-e6483390d683 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:12.579784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566f76-b2e0-4f99-b077-e6483390d683 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:12.579784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566f76-b2e0-4f99-b077-e6483390d683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:12.601977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9d566f76-b2e0-4f99-b077-e6483390d683 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:12.603207 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9d566f76-b2e0-4f99-b077-e6483390d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:12.672127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1129/2270] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:12.682122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:12.683592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:12.763427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d1b66-36e1-4993-8681-7f0dc5fdd4c2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:12.767644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642b1a3-26e0-4b39-92e1-57f3a9082ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:12.768280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642b1a3-26e0-4b39-92e1-57f3a9082ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:12.768562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642b1a3-26e0-4b39-92e1-57f3a9082ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:12.768937 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642b1a3-26e0-4b39-92e1-57f3a9082ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:12.781712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642b1a3-26e0-4b39-92e1-57f3a9082ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:12.783173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642b1a3-26e0-4b39-92e1-57f3a9082ab8 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:12.793995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1142/2271] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:16:13.117687 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d566f76-b2e0-4f99-b077-e6483390d683 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:13.119138 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9d566f76-b2e0-4f99-b077-e6483390d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:13.131643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d566f76-b2e0-4f99-b077-e6483390d683 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:13.138153 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4aebc-49a8-4c3b-bc38-4515728e6950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:13.138883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4aebc-49a8-4c3b-bc38-4515728e6950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:13.139157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4aebc-49a8-4c3b-bc38-4515728e6950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:13.139429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4aebc-49a8-4c3b-bc38-4515728e6950 admin admin] PATH_INFO: `/v3/projects/239515704b194781808a13acdf1b38f6` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:13.140590 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4aebc-49a8-4c3b-bc38-4515728e6950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=239515704b194781808a13acdf1b38f6)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:13.142552 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4aebc-49a8-4c3b-bc38-4515728e6950 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:13.199180 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7cd4aebc-49a8-4c3b-bc38-4515728e6950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239515704b194781808a13acdf1b38f6', 'request_id': 'req-7cd4aebc-49a8-4c3b-bc38-4515728e6950'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:13.209138 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7cd4aebc-49a8-4c3b-bc38-4515728e6950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239515704b194781808a13acdf1b38f6', 'request_id': 'req-7cd4aebc-49a8-4c3b-bc38-4515728e6950'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:13.215465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7cd4aebc-49a8-4c3b-bc38-4515728e6950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239515704b194781808a13acdf1b38f6', 'request_id': 'req-7cd4aebc-49a8-4c3b-bc38-4515728e6950'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:13.226660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7cd4aebc-49a8-4c3b-bc38-4515728e6950 admin admin] The token cache is being invalidate because project 239515704b194781808a13acdf1b38f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:16:13.226940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7cd4aebc-49a8-4c3b-bc38-4515728e6950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:13.227635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7cd4aebc-49a8-4c3b-bc38-4515728e6950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:13.229251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1130/2272] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:16:13 2022] DELETE /identity/v3/projects/239515704b194781808a13acdf1b38f6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:13.234301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19256e61-f96d-487b-9222-50de7d0e1eb3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:13.234581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19256e61-f96d-487b-9222-50de7d0e1eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:13.234856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19256e61-f96d-487b-9222-50de7d0e1eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:13.254474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-19256e61-f96d-487b-9222-50de7d0e1eb3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:13.255652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-19256e61-f96d-487b-9222-50de7d0e1eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:13.277629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:13.324741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1143/2273] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:13.332774 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb777b2-ebdd-4ed5-9ddf-27897fa5eda5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:13.333097 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb777b2-ebdd-4ed5-9ddf-27897fa5eda5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:13.339111 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb777b2-ebdd-4ed5-9ddf-27897fa5eda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:13.359706 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ffb777b2-ebdd-4ed5-9ddf-27897fa5eda5 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:13.360997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ffb777b2-ebdd-4ed5-9ddf-27897fa5eda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:13.371340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1131/2274] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:13.375977 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19256e61-f96d-487b-9222-50de7d0e1eb3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:13.386923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19256e61-f96d-487b-9222-50de7d0e1eb3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:13.391958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cc09d-9f4b-492c-87f1-d92e960fb21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:13.392580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc09d-9f4b-492c-87f1-d92e960fb21f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:13.392849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc09d-9f4b-492c-87f1-d92e960fb21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:13.393161 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cc09d-9f4b-492c-87f1-d92e960fb21f admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:13.393855 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cc09d-9f4b-492c-87f1-d92e960fb21f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:16:13.394160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cc09d-9f4b-492c-87f1-d92e960fb21f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:13.395720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cc09d-9f4b-492c-87f1-d92e960fb21f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:13.412162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1144/2275] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:16:13.413868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb777b2-ebdd-4ed5-9ddf-27897fa5eda5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:13.423893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb777b2-ebdd-4ed5-9ddf-27897fa5eda5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:13.429398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6521036-3054-42df-9705-2380b7600290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:13.430021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6521036-3054-42df-9705-2380b7600290 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:13.430417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6521036-3054-42df-9705-2380b7600290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:13.430569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6521036-3054-42df-9705-2380b7600290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:13.431225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6521036-3054-42df-9705-2380b7600290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:13.433240 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6521036-3054-42df-9705-2380b7600290 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:13.466915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1132/2276] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:16:13 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:13.473010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cc09d-9f4b-492c-87f1-d92e960fb21f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:13.483883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cc09d-9f4b-492c-87f1-d92e960fb21f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:13.555665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2ff66-9f62-491e-b1b9-cd7004d8d2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:13.556208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2ff66-9f62-491e-b1b9-cd7004d8d2ca admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:13.556489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2ff66-9f62-491e-b1b9-cd7004d8d2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:13.556771 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2ff66-9f62-491e-b1b9-cd7004d8d2ca admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:13.557497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2ff66-9f62-491e-b1b9-cd7004d8d2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:13.559477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2ff66-9f62-491e-b1b9-cd7004d8d2ca admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:13.587033 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1145/2277] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:16:13 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:13.591197 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6521036-3054-42df-9705-2380b7600290 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:13.604226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6521036-3054-42df-9705-2380b7600290 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:13.610176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f247f-a754-4207-b30a-c38ff32096da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:13.610799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f247f-a754-4207-b30a-c38ff32096da admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:13.611079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f247f-a754-4207-b30a-c38ff32096da admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:13.611348 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f247f-a754-4207-b30a-c38ff32096da admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:13.612086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f247f-a754-4207-b30a-c38ff32096da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:13.613743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f247f-a754-4207-b30a-c38ff32096da admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:13.625335 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1133/2278] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:13.629673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2ff66-9f62-491e-b1b9-cd7004d8d2ca admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:13.640450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2ff66-9f62-491e-b1b9-cd7004d8d2ca admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:13.645580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5bafe-8585-42e4-bdcc-4cdde967c7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:13.646192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5bafe-8585-42e4-bdcc-4cdde967c7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:13.646466 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5bafe-8585-42e4-bdcc-4cdde967c7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:13.646763 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5bafe-8585-42e4-bdcc-4cdde967c7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:13.647467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5bafe-8585-42e4-bdcc-4cdde967c7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:13.649115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5bafe-8585-42e4-bdcc-4cdde967c7ec admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:13.661029 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1146/2279] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:13.665419 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f247f-a754-4207-b30a-c38ff32096da admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:13.675926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f247f-a754-4207-b30a-c38ff32096da admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:13.681205 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01147d-843b-4356-b935-74bd41fe797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:13.681866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01147d-843b-4356-b935-74bd41fe797b admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:13.682168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01147d-843b-4356-b935-74bd41fe797b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:13.682470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01147d-843b-4356-b935-74bd41fe797b admin admin] PATH_INFO: `/v3/projects/3e9ac108cd7141f99fcd818051b1315a/users/882a2703c41a437a8d48faf4143ce028/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:13.697560 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01147d-843b-4356-b935-74bd41fe797b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9ac108cd7141f99fcd818051b1315a, user_id=882a2703c41a437a8d48faf4143ce028, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:13.700636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01147d-843b-4356-b935-74bd41fe797b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:13.717186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1134/2280] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:16:13 2022] PUT /identity/v3/projects/3e9ac108cd7141f99fcd818051b1315a/users/882a2703c41a437a8d48faf4143ce028/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:13.728048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc7cda-bc01-49b1-9908-90c1946683f1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:13.728348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc7cda-bc01-49b1-9908-90c1946683f1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:13.728622 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc7cda-bc01-49b1-9908-90c1946683f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:13.760273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-24fc7cda-bc01-49b1-9908-90c1946683f1 None None] MFA Rules not processed for user `882a2703c41a437a8d48faf4143ce028`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:13.761562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-24fc7cda-bc01-49b1-9908-90c1946683f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:13.827242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1147/2281] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:13.832185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01147d-843b-4356-b935-74bd41fe797b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:13.856206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:13.903318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01147d-843b-4356-b935-74bd41fe797b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:13.908608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b4bee-69a7-4030-b4b0-175609fafa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:13.909261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4bee-69a7-4030-b4b0-175609fafa2d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:13.909544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4bee-69a7-4030-b4b0-175609fafa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:13.909819 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4bee-69a7-4030-b4b0-175609fafa2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:13.910479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b4bee-69a7-4030-b4b0-175609fafa2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:13.912400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b4bee-69a7-4030-b4b0-175609fafa2d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:13.944705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1135/2282] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:16:13 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:13.946751 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc7cda-bc01-49b1-9908-90c1946683f1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:13.958349 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc7cda-bc01-49b1-9908-90c1946683f1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:13.972169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:14.019954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938678-e0ee-42b6-9764-a83c371ca496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:14.020597 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938678-e0ee-42b6-9764-a83c371ca496 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:14.020926 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938678-e0ee-42b6-9764-a83c371ca496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:14.021238 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938678-e0ee-42b6-9764-a83c371ca496 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:14.021940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05938678-e0ee-42b6-9764-a83c371ca496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:14.023885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05938678-e0ee-42b6-9764-a83c371ca496 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:14.048088 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1148/2283] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:16:13 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:14.052290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b4bee-69a7-4030-b4b0-175609fafa2d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:14.064069 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b4bee-69a7-4030-b4b0-175609fafa2d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:14.070203 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ed0cb-bdec-47e0-a9c9-57372715fa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:14.070969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ed0cb-bdec-47e0-a9c9-57372715fa9d admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:14.071327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ed0cb-bdec-47e0-a9c9-57372715fa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:14.071511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ed0cb-bdec-47e0-a9c9-57372715fa9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:14.072207 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ed0cb-bdec-47e0-a9c9-57372715fa9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:14.073869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ed0cb-bdec-47e0-a9c9-57372715fa9d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:14.087117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1136/2284] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:14.091923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938678-e0ee-42b6-9764-a83c371ca496 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:14.102868 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938678-e0ee-42b6-9764-a83c371ca496 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:14.108779 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a604b-481c-4f20-a63b-61941c35a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:14.109460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a604b-481c-4f20-a63b-61941c35a246 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:14.109747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a604b-481c-4f20-a63b-61941c35a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:14.110023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a604b-481c-4f20-a63b-61941c35a246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:14.110744 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a604b-481c-4f20-a63b-61941c35a246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:14.113907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a604b-481c-4f20-a63b-61941c35a246 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:14.126584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1149/2285] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:14.131030 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ed0cb-bdec-47e0-a9c9-57372715fa9d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:14.145104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ed0cb-bdec-47e0-a9c9-57372715fa9d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:14.154359 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d65617-257c-447e-8392-51133b26f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:14.155308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d65617-257c-447e-8392-51133b26f106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:14.155942 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d65617-257c-447e-8392-51133b26f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:14.156400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d65617-257c-447e-8392-51133b26f106 admin admin] PATH_INFO: `/v3/projects/4d7be431ae45401cb7d6d3297d5909ab/users/ad2e61bc1a1d4d0f9e2816478e49ed7f/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:14.176847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d65617-257c-447e-8392-51133b26f106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7be431ae45401cb7d6d3297d5909ab, user_id=ad2e61bc1a1d4d0f9e2816478e49ed7f, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:14.179805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d65617-257c-447e-8392-51133b26f106 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:14.198595 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1137/2286] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:16:14 2022] PUT /identity/v3/projects/4d7be431ae45401cb7d6d3297d5909ab/users/ad2e61bc1a1d4d0f9e2816478e49ed7f/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:14.274998 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048a672-c169-45db-9dab-902fc6860d7e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:14.275291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048a672-c169-45db-9dab-902fc6860d7e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:14.275948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048a672-c169-45db-9dab-902fc6860d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:14.309911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a048a672-c169-45db-9dab-902fc6860d7e None None] MFA Rules not processed for user `ad2e61bc1a1d4d0f9e2816478e49ed7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:14.311164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a048a672-c169-45db-9dab-902fc6860d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:14.381821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1150/2287] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:14.386666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d65617-257c-447e-8392-51133b26f106 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:14.452019 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d65617-257c-447e-8392-51133b26f106 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:14.458847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397117c5-a45b-41e2-a283-28a36dc8dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:14.459763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397117c5-a45b-41e2-a283-28a36dc8dc27 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:14.460165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397117c5-a45b-41e2-a283-28a36dc8dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:14.460455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397117c5-a45b-41e2-a283-28a36dc8dc27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:14.461159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397117c5-a45b-41e2-a283-28a36dc8dc27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:14.463093 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397117c5-a45b-41e2-a283-28a36dc8dc27 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:14.493604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1138/2288] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:16:14 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:14.497628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048a672-c169-45db-9dab-902fc6860d7e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:14.508839 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048a672-c169-45db-9dab-902fc6860d7e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:14.576599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f1fbe-38b7-41ef-90c5-77066fc6f224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:14.577403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f1fbe-38b7-41ef-90c5-77066fc6f224 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:14.577710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f1fbe-38b7-41ef-90c5-77066fc6f224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:14.577978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f1fbe-38b7-41ef-90c5-77066fc6f224 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:14.578668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f1fbe-38b7-41ef-90c5-77066fc6f224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:14.580868 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f1fbe-38b7-41ef-90c5-77066fc6f224 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:14.605495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1151/2289] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:16:14 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:14.609252 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397117c5-a45b-41e2-a283-28a36dc8dc27 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:14.629604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397117c5-a45b-41e2-a283-28a36dc8dc27 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:14.635223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf73bbf-7e98-466d-99ef-eb33846543f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:14.644230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf73bbf-7e98-466d-99ef-eb33846543f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:14.644800 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf73bbf-7e98-466d-99ef-eb33846543f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:14.645282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf73bbf-7e98-466d-99ef-eb33846543f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:14.646363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf73bbf-7e98-466d-99ef-eb33846543f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:14.648208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf73bbf-7e98-466d-99ef-eb33846543f4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:14.663726 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1139/2290] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:14.668289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f1fbe-38b7-41ef-90c5-77066fc6f224 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:14.681517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f1fbe-38b7-41ef-90c5-77066fc6f224 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:14.686757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b74ab-9183-4ee2-9076-434f2be8c715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:14.687452 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b74ab-9183-4ee2-9076-434f2be8c715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:14.687947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b74ab-9183-4ee2-9076-434f2be8c715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:14.688312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b74ab-9183-4ee2-9076-434f2be8c715 admin admin] PATH_INFO: `/v3/projects/224b5fc531d14de8bee0cd67046530e5/users/3fceb5751c8e40d990dacd179f964ebf/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:14.713185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:14.717172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b74ab-9183-4ee2-9076-434f2be8c715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224b5fc531d14de8bee0cd67046530e5, user_id=3fceb5751c8e40d990dacd179f964ebf, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:14.720797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b74ab-9183-4ee2-9076-434f2be8c715 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:14.737936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1152/2291] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:16:14 2022] PUT /identity/v3/projects/224b5fc531d14de8bee0cd67046530e5/users/3fceb5751c8e40d990dacd179f964ebf/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:14.742490 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf73bbf-7e98-466d-99ef-eb33846543f4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:14.761158 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf73bbf-7e98-466d-99ef-eb33846543f4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:14.816483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:14.839078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac41993-c766-44b6-8f49-18ee581387f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:14.839517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac41993-c766-44b6-8f49-18ee581387f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:14.839780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac41993-c766-44b6-8f49-18ee581387f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:14.840066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac41993-c766-44b6-8f49-18ee581387f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:14.840993 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac41993-c766-44b6-8f49-18ee581387f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:14.842572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac41993-c766-44b6-8f49-18ee581387f9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:14.857878 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1140/2292] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:14.859668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b74ab-9183-4ee2-9076-434f2be8c715 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:14.873243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b74ab-9183-4ee2-9076-434f2be8c715 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:14.878968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d143f4-839a-4eae-8e27-6a052c4753d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:14.879666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d143f4-839a-4eae-8e27-6a052c4753d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:14.879955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d143f4-839a-4eae-8e27-6a052c4753d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:14.880404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d143f4-839a-4eae-8e27-6a052c4753d1 admin admin] PATH_INFO: `/v3/projects/224b5fc531d14de8bee0cd67046530e5/users/3fceb5751c8e40d990dacd179f964ebf/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:14.882476 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d143f4-839a-4eae-8e27-6a052c4753d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224b5fc531d14de8bee0cd67046530e5, user_id=3fceb5751c8e40d990dacd179f964ebf, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:14.886101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d143f4-839a-4eae-8e27-6a052c4753d1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:14.908650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1153/2293] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:16:14 2022] PUT /identity/v3/projects/224b5fc531d14de8bee0cd67046530e5/users/3fceb5751c8e40d990dacd179f964ebf/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:14.911365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b067-cd80-4c0c-9310-80f9584d03dd None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:14.911670 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b067-cd80-4c0c-9310-80f9584d03dd None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:14.912155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b067-cd80-4c0c-9310-80f9584d03dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:14.944322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-a4a5b067-cd80-4c0c-9310-80f9584d03dd None None] MFA Rules not processed for user `3fceb5751c8e40d990dacd179f964ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:14.945378 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a4a5b067-cd80-4c0c-9310-80f9584d03dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:15.020069 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1141/2294] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:15.032365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d143f4-839a-4eae-8e27-6a052c4753d1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:15.034328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-74d143f4-839a-4eae-8e27-6a052c4753d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:15.098674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d143f4-839a-4eae-8e27-6a052c4753d1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:15.102759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea040d-8f50-4c4d-8b72-26aeb9c6b1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:15.103402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea040d-8f50-4c4d-8b72-26aeb9c6b1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:15.103675 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea040d-8f50-4c4d-8b72-26aeb9c6b1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:15.103946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea040d-8f50-4c4d-8b72-26aeb9c6b1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:15.164925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea040d-8f50-4c4d-8b72-26aeb9c6b1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:15.166430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea040d-8f50-4c4d-8b72-26aeb9c6b1b9 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:15.176019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1154/2295] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:16:15.968564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5b067-cd80-4c0c-9310-80f9584d03dd None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:15.970293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a4a5b067-cd80-4c0c-9310-80f9584d03dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:16.048475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5b067-cd80-4c0c-9310-80f9584d03dd None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:16.057281 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:16.057948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:16.058231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:16.058509 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] PATH_INFO: `/v3/users/15108c3b40ca481bad6d5c9638db93d3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:16.059750 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] RBAC: Authorizing `identity:delete_user(user_id=15108c3b40ca481bad6d5c9638db93d3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:16.061929 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:16.116199 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15108c3b40ca481bad6d5c9638db93d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:16.124586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15108c3b40ca481bad6d5c9638db93d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:16.134038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15108c3b40ca481bad6d5c9638db93d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:16.134723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15108c3b40ca481bad6d5c9638db93d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:16.139595 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:16.150390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15108c3b40ca481bad6d5c9638db93d3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:16.158955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1142/2296] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:16:15 2022] DELETE /identity/v3/users/15108c3b40ca481bad6d5c9638db93d3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:16.163951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d30f-521c-4127-9296-605d12602f7a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:16.164570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d30f-521c-4127-9296-605d12602f7a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:16.164570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556d30f-521c-4127-9296-605d12602f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:16.192264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a556d30f-521c-4127-9296-605d12602f7a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:16.193850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a556d30f-521c-4127-9296-605d12602f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:16.295216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1155/2297] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:16.305786 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:16.307574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:16.376526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af6af0-2abc-4ec1-8582-4bdbb1b7690b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:16.380406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15086ed9-9365-48e0-a513-faf5e4c1a8ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:16.381087 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086ed9-9365-48e0-a513-faf5e4c1a8ed service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:16.381366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086ed9-9365-48e0-a513-faf5e4c1a8ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:16.381636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086ed9-9365-48e0-a513-faf5e4c1a8ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:16.391096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15086ed9-9365-48e0-a513-faf5e4c1a8ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:16.392572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15086ed9-9365-48e0-a513-faf5e4c1a8ed service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:16.403122 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1143/2298] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:16:16.861219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d30f-521c-4127-9296-605d12602f7a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:16.863004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a556d30f-521c-4127-9296-605d12602f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:16.876160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556d30f-521c-4127-9296-605d12602f7a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:16.881577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40aec0-2c40-4184-bf03-a95947094052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:16.882337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40aec0-2c40-4184-bf03-a95947094052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:16.882613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40aec0-2c40-4184-bf03-a95947094052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:16.882887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40aec0-2c40-4184-bf03-a95947094052 admin admin] PATH_INFO: `/v3/projects/9fbebeaa080f4d7fac7c5cdd8127bc63` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:16.884142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40aec0-2c40-4184-bf03-a95947094052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fbebeaa080f4d7fac7c5cdd8127bc63)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:16.886735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40aec0-2c40-4184-bf03-a95947094052 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:16.926878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:16.956767 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8e40aec0-2c40-4184-bf03-a95947094052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fbebeaa080f4d7fac7c5cdd8127bc63', 'request_id': 'req-8e40aec0-2c40-4184-bf03-a95947094052'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:16.968170 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8e40aec0-2c40-4184-bf03-a95947094052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fbebeaa080f4d7fac7c5cdd8127bc63', 'request_id': 'req-8e40aec0-2c40-4184-bf03-a95947094052'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:16.976142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8e40aec0-2c40-4184-bf03-a95947094052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fbebeaa080f4d7fac7c5cdd8127bc63', 'request_id': 'req-8e40aec0-2c40-4184-bf03-a95947094052'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:16.991243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8e40aec0-2c40-4184-bf03-a95947094052 admin admin] The token cache is being invalidate because project 9fbebeaa080f4d7fac7c5cdd8127bc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:16:16.991639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8e40aec0-2c40-4184-bf03-a95947094052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:16.992809 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8e40aec0-2c40-4184-bf03-a95947094052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:16.994654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1156/2299] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:16:16 2022] DELETE /identity/v3/projects/9fbebeaa080f4d7fac7c5cdd8127bc63 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:16.999830 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180da73-c96b-4e95-96d7-7e7879cdec47 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:17.000317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180da73-c96b-4e95-96d7-7e7879cdec47 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:17.000651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180da73-c96b-4e95-96d7-7e7879cdec47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:17.022405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d180da73-c96b-4e95-96d7-7e7879cdec47 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:17.023743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d180da73-c96b-4e95-96d7-7e7879cdec47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:17.095746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1144/2300] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:17.103891 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00752f2b-ab38-42cb-a621-cf22aa2c68fb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:17.104108 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00752f2b-ab38-42cb-a621-cf22aa2c68fb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:17.104386 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00752f2b-ab38-42cb-a621-cf22aa2c68fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:17.125257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-00752f2b-ab38-42cb-a621-cf22aa2c68fb None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:17.126499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-00752f2b-ab38-42cb-a621-cf22aa2c68fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:17.134808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1157/2301] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:17.139422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180da73-c96b-4e95-96d7-7e7879cdec47 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:17.149849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180da73-c96b-4e95-96d7-7e7879cdec47 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:17.155569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea1979-bd0a-47a9-a5ae-95545a4dc2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:17.156319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea1979-bd0a-47a9-a5ae-95545a4dc2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:17.156650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea1979-bd0a-47a9-a5ae-95545a4dc2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:17.157022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea1979-bd0a-47a9-a5ae-95545a4dc2d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:17.157808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea1979-bd0a-47a9-a5ae-95545a4dc2d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:16:17.158128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea1979-bd0a-47a9-a5ae-95545a4dc2d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:17.159751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea1979-bd0a-47a9-a5ae-95545a4dc2d5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:17.171974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1145/2302] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:16:17.176572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00752f2b-ab38-42cb-a621-cf22aa2c68fb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:17.186883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00752f2b-ab38-42cb-a621-cf22aa2c68fb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:17.191766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f54d4-0db0-42bc-928c-8f1acbf9fadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:17.192397 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f54d4-0db0-42bc-928c-8f1acbf9fadd admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:17.192678 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f54d4-0db0-42bc-928c-8f1acbf9fadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:17.192984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f54d4-0db0-42bc-928c-8f1acbf9fadd admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:17.193666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f54d4-0db0-42bc-928c-8f1acbf9fadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:17.195607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f54d4-0db0-42bc-928c-8f1acbf9fadd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:17.228138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1158/2303] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:16:17 2022] POST /identity/v3/projects => generated 359 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:17.232756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea1979-bd0a-47a9-a5ae-95545a4dc2d5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:17.243101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea1979-bd0a-47a9-a5ae-95545a4dc2d5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:17.310842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3abfc4-a264-47a4-aa86-ca1fad26dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:17.311586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3abfc4-a264-47a4-aa86-ca1fad26dbbb admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:17.311944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3abfc4-a264-47a4-aa86-ca1fad26dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:17.312225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3abfc4-a264-47a4-aa86-ca1fad26dbbb admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:17.312935 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3abfc4-a264-47a4-aa86-ca1fad26dbbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:17.315350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3abfc4-a264-47a4-aa86-ca1fad26dbbb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:17.341323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1146/2304] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:16:17 2022] POST /identity/v3/users => generated 280 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:17.343577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f54d4-0db0-42bc-928c-8f1acbf9fadd admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:17.356097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f54d4-0db0-42bc-928c-8f1acbf9fadd admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:17.361727 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047689b-363a-4d8c-b4f4-1b62ed4d25d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:17.362457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047689b-363a-4d8c-b4f4-1b62ed4d25d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:17.362707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047689b-363a-4d8c-b4f4-1b62ed4d25d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:17.363141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047689b-363a-4d8c-b4f4-1b62ed4d25d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:17.363870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047689b-363a-4d8c-b4f4-1b62ed4d25d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:17.365502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047689b-363a-4d8c-b4f4-1b62ed4d25d7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:17.380950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1159/2305] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:17.382714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3abfc4-a264-47a4-aa86-ca1fad26dbbb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:17.391062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:17.407825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3abfc4-a264-47a4-aa86-ca1fad26dbbb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:17.417620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fd648-01e5-4f39-8e5d-409d26cff2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:17.418617 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fd648-01e5-4f39-8e5d-409d26cff2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:17.419267 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fd648-01e5-4f39-8e5d-409d26cff2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:17.419549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fd648-01e5-4f39-8e5d-409d26cff2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:17.420367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fd648-01e5-4f39-8e5d-409d26cff2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:17.422141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fd648-01e5-4f39-8e5d-409d26cff2f9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:17.435368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1147/2306] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:17.439781 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047689b-363a-4d8c-b4f4-1b62ed4d25d7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:17.450588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047689b-363a-4d8c-b4f4-1b62ed4d25d7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:17.455582 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019ab0e-621e-42e5-936f-d3a09fa83cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:17.456288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019ab0e-621e-42e5-936f-d3a09fa83cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:17.456568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019ab0e-621e-42e5-936f-d3a09fa83cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:17.456849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019ab0e-621e-42e5-936f-d3a09fa83cd7 admin admin] PATH_INFO: `/v3/projects/d992cc13fd8c49e1a6419d9c357fa8d9/users/fec71fb62b194b889ed0ce180c1bda7e/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:17.473889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019ab0e-621e-42e5-936f-d3a09fa83cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d992cc13fd8c49e1a6419d9c357fa8d9, user_id=fec71fb62b194b889ed0ce180c1bda7e, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:17.476681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019ab0e-621e-42e5-936f-d3a09fa83cd7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:17.493326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1160/2307] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:16:17 2022] PUT /identity/v3/projects/d992cc13fd8c49e1a6419d9c357fa8d9/users/fec71fb62b194b889ed0ce180c1bda7e/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:17.504129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54ac7-bad3-4d6a-bda8-fd81e495c7af None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:17.504129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54ac7-bad3-4d6a-bda8-fd81e495c7af None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:17.504405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c54ac7-bad3-4d6a-bda8-fd81e495c7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:17.540508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c4c54ac7-bad3-4d6a-bda8-fd81e495c7af None None] MFA Rules not processed for user `fec71fb62b194b889ed0ce180c1bda7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:17.541786 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c4c54ac7-bad3-4d6a-bda8-fd81e495c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:17.638005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1148/2308] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:17.673575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019ab0e-621e-42e5-936f-d3a09fa83cd7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:17.675515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a019ab0e-621e-42e5-936f-d3a09fa83cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:17.753056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019ab0e-621e-42e5-936f-d3a09fa83cd7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:17.758704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb958f-0410-4357-bb99-b66c378c7e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:17.759707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb958f-0410-4357-bb99-b66c378c7e1a service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:17.760193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb958f-0410-4357-bb99-b66c378c7e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:17.760662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb958f-0410-4357-bb99-b66c378c7e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:17.771957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb958f-0410-4357-bb99-b66c378c7e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:17.773741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb958f-0410-4357-bb99-b66c378c7e1a service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:17.785612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1161/2309] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:16:17.803972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54ac7-bad3-4d6a-bda8-fd81e495c7af None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:17.880355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb958f-0410-4357-bb99-b66c378c7e1a service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:17.891848 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb958f-0410-4357-bb99-b66c378c7e1a service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:17.896110 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f3959-2410-4508-9394-b4cc2102a2ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:17.897105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f3959-2410-4508-9394-b4cc2102a2ea service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:17.897389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f3959-2410-4508-9394-b4cc2102a2ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:17.897662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f3959-2410-4508-9394-b4cc2102a2ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:17.899797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-685f3959-2410-4508-9394-b4cc2102a2ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:17.917442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c54ac7-bad3-4d6a-bda8-fd81e495c7af None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:17.923986 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:17.924659 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:17.924972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:17.925253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] PATH_INFO: `/v3/users/fec71fb62b194b889ed0ce180c1bda7e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:17.926572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec71fb62b194b889ed0ce180c1bda7e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:17.928549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:17.992799 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:17.997368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f3959-2410-4508-9394-b4cc2102a2ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:17.999999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f3959-2410-4508-9394-b4cc2102a2ea service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:18.001185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec71fb62b194b889ed0ce180c1bda7e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:18.009165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec71fb62b194b889ed0ce180c1bda7e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:18.010225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1162/2310] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:16:18.018426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec71fb62b194b889ed0ce180c1bda7e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:18.019420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec71fb62b194b889ed0ce180c1bda7e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:18.033157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec71fb62b194b889ed0ce180c1bda7e'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:18.039855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1149/2311] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:16:17 2022] DELETE /identity/v3/users/fec71fb62b194b889ed0ce180c1bda7e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:18.044644 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6f47-f6e0-4e01-827b-2a3a4a86c80a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:18.045017 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6f47-f6e0-4e01-827b-2a3a4a86c80a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:18.045297 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c6f47-f6e0-4e01-827b-2a3a4a86c80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:18.065787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-736c6f47-f6e0-4e01-827b-2a3a4a86c80a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:18.067008 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-736c6f47-f6e0-4e01-827b-2a3a4a86c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:18.147906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1163/2312] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:16:18.159833 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:18.161273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:18.167621 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:18.300406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823e177-5780-447d-b4ad-fa2b03420e23 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:18.306267 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1300c-8535-4374-8f21-e7738b274e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:18.307007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1300c-8535-4374-8f21-e7738b274e21 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:18.307343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1300c-8535-4374-8f21-e7738b274e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:18.307682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1300c-8535-4374-8f21-e7738b274e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:18.321603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1300c-8535-4374-8f21-e7738b274e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:18.323322 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1300c-8535-4374-8f21-e7738b274e21 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:18.339436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1150/2313] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:16:18.692021 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c6f47-f6e0-4e01-827b-2a3a4a86c80a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:18.693600 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-736c6f47-f6e0-4e01-827b-2a3a4a86c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:18.753471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c6f47-f6e0-4e01-827b-2a3a4a86c80a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:18.757360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc0a5b-15de-4706-9123-54613c872e89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:18.757990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc0a5b-15de-4706-9123-54613c872e89 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:18.758269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc0a5b-15de-4706-9123-54613c872e89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:18.758542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc0a5b-15de-4706-9123-54613c872e89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:18.760349 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c9dc0a5b-15de-4706-9123-54613c872e89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:18.795160 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1300c-8535-4374-8f21-e7738b274e21 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:18.796688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-69b1300c-8535-4374-8f21-e7738b274e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:18.817039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1300c-8535-4374-8f21-e7738b274e21 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:18.821842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:18.822650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:18.823833 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:18.823833 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] PATH_INFO: `/v3/projects/d992cc13fd8c49e1a6419d9c357fa8d9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:18.825133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d992cc13fd8c49e1a6419d9c357fa8d9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:18.827605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:18.841666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc0a5b-15de-4706-9123-54613c872e89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:18.843202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc0a5b-15de-4706-9123-54613c872e89 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:18.853193 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1164/2314] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:16:18.878923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd992cc13fd8c49e1a6419d9c357fa8d9', 'request_id': 'req-ad1745ff-327e-41dd-8488-1dbd411b2730'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:18.888034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd992cc13fd8c49e1a6419d9c357fa8d9', 'request_id': 'req-ad1745ff-327e-41dd-8488-1dbd411b2730'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:18.894768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd992cc13fd8c49e1a6419d9c357fa8d9', 'request_id': 'req-ad1745ff-327e-41dd-8488-1dbd411b2730'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:18.912370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] The token cache is being invalidate because project d992cc13fd8c49e1a6419d9c357fa8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:16:18.912641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:18.916457 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:18.918117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1151/2315] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:16:18 2022] DELETE /identity/v3/projects/d992cc13fd8c49e1a6419d9c357fa8d9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:16:21.857024 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134fd76-5066-416b-8e13-165084c39fa4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:21.857596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134fd76-5066-416b-8e13-165084c39fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:21.857596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134fd76-5066-416b-8e13-165084c39fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:21.876860 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5134fd76-5066-416b-8e13-165084c39fa4 None None] MFA Rules not processed for user `2ce8bf4f0ab64010b3855193f55971d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:21.878120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5134fd76-5066-416b-8e13-165084c39fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:21.923104 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:21.943505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1165/2316] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:23.852976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:23.854661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:23.931272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1745ff-327e-41dd-8488-1dbd411b2730 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:23.937093 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:23.937885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:23.938258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:23.938626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] PATH_INFO: `/v3/users/882a2703c41a437a8d48faf4143ce028` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:23.940448 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=882a2703c41a437a8d48faf4143ce028)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:23.942683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:23.999556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:24.017625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '882a2703c41a437a8d48faf4143ce028'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.025049 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '882a2703c41a437a8d48faf4143ce028'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.033383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '882a2703c41a437a8d48faf4143ce028'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.034018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '882a2703c41a437a8d48faf4143ce028'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.046051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '882a2703c41a437a8d48faf4143ce028'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.052071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1152/2317] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:16:23 2022] DELETE /identity/v3/users/882a2703c41a437a8d48faf4143ce028 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:24.056655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788aa601-a76c-488d-862a-14f6bb8ef798 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:24.057237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788aa601-a76c-488d-862a-14f6bb8ef798 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:24.057237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788aa601-a76c-488d-862a-14f6bb8ef798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:24.076508 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-788aa601-a76c-488d-862a-14f6bb8ef798 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:24.077765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-788aa601-a76c-488d-862a-14f6bb8ef798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:24.139506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1166/2318] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:16:24.149679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:24.151591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:24.213832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338e34b-ecd1-4b57-9e3a-8a336bd5ea2e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:24.217847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ba94e-30bf-4288-88fd-90697669ad09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:24.218499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ba94e-30bf-4288-88fd-90697669ad09 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:24.218775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ba94e-30bf-4288-88fd-90697669ad09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:24.219047 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ba94e-30bf-4288-88fd-90697669ad09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:24.228598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ba94e-30bf-4288-88fd-90697669ad09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:24.230087 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ba94e-30bf-4288-88fd-90697669ad09 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:24.239888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1153/2319] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:16:24.529763 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788aa601-a76c-488d-862a-14f6bb8ef798 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:24.531629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-788aa601-a76c-488d-862a-14f6bb8ef798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:24.563010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788aa601-a76c-488d-862a-14f6bb8ef798 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:24.567919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:24.568673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:24.569063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:24.569367 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] PATH_INFO: `/v3/projects/3e9ac108cd7141f99fcd818051b1315a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:24.570873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9ac108cd7141f99fcd818051b1315a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:24.572866 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:24.624803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9ac108cd7141f99fcd818051b1315a', 'request_id': 'req-3ae13550-fa32-42fc-af77-883991b6264a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.633824 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9ac108cd7141f99fcd818051b1315a', 'request_id': 'req-3ae13550-fa32-42fc-af77-883991b6264a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.639777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9ac108cd7141f99fcd818051b1315a', 'request_id': 'req-3ae13550-fa32-42fc-af77-883991b6264a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.655921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] The token cache is being invalidate because project 3e9ac108cd7141f99fcd818051b1315a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:16:24.656331 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.657155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.659379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1167/2320] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:16:24 2022] DELETE /identity/v3/projects/3e9ac108cd7141f99fcd818051b1315a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:24.663520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ba94e-30bf-4288-88fd-90697669ad09 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:24.674923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ba94e-30bf-4288-88fd-90697669ad09 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:24.742391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:24.743307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:24.743588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:24.743865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] PATH_INFO: `/v3/users/ad2e61bc1a1d4d0f9e2816478e49ed7f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:24.745280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2e61bc1a1d4d0f9e2816478e49ed7f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:24.747251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:24.811924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2e61bc1a1d4d0f9e2816478e49ed7f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.820714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:24.826453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2e61bc1a1d4d0f9e2816478e49ed7f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.848925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2e61bc1a1d4d0f9e2816478e49ed7f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.849687 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2e61bc1a1d4d0f9e2816478e49ed7f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.863323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2e61bc1a1d4d0f9e2816478e49ed7f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:24.870406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1154/2321] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:16:24 2022] DELETE /identity/v3/users/ad2e61bc1a1d4d0f9e2816478e49ed7f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:25.313980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:25.316066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:25.331292 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae13550-fa32-42fc-af77-883991b6264a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:25.399067 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:25.400565 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:25.401321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:25.401984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] PATH_INFO: `/v3/projects/4d7be431ae45401cb7d6d3297d5909ab` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:25.404539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7be431ae45401cb7d6d3297d5909ab)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:25.407122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:25.425568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:25.464381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7be431ae45401cb7d6d3297d5909ab', 'request_id': 'req-206006a2-ce2e-48f4-a731-9ff62b4ef717'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:25.473494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7be431ae45401cb7d6d3297d5909ab', 'request_id': 'req-206006a2-ce2e-48f4-a731-9ff62b4ef717'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:25.479233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7be431ae45401cb7d6d3297d5909ab', 'request_id': 'req-206006a2-ce2e-48f4-a731-9ff62b4ef717'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:25.491458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] The token cache is being invalidate because project 4d7be431ae45401cb7d6d3297d5909ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:16:25.491757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:25.492442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:25.494099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1168/2322] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:16:25 2022] DELETE /identity/v3/projects/4d7be431ae45401cb7d6d3297d5909ab => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:25.498153 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:25.499602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:25.513702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2152904-77bc-4669-be5d-5f8fa14da905 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:25.572116 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:25.572773 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:25.573093 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:25.573371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] PATH_INFO: `/v3/users/3fceb5751c8e40d990dacd179f964ebf` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:25.574560 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fceb5751c8e40d990dacd179f964ebf)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:25.576589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:25.628803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fceb5751c8e40d990dacd179f964ebf'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:25.636568 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fceb5751c8e40d990dacd179f964ebf'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:25.647398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fceb5751c8e40d990dacd179f964ebf'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:25.648599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fceb5751c8e40d990dacd179f964ebf'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:25.664153 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fceb5751c8e40d990dacd179f964ebf'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:25.670702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1155/2323] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:16:25 2022] DELETE /identity/v3/users/3fceb5751c8e40d990dacd179f964ebf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:25.970555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:25.972247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:25.987770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206006a2-ce2e-48f4-a731-9ff62b4ef717 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:26.075695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:26.076402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:26.076681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:26.076976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1 admin admin] PATH_INFO: `/v3/projects/224b5fc531d14de8bee0cd67046530e5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:26.078156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=224b5fc531d14de8bee0cd67046530e5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:26.080355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:26.141583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224b5fc531d14de8bee0cd67046530e5', 'request_id': 'req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:26.155858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224b5fc531d14de8bee0cd67046530e5', 'request_id': 'req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:26.166186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224b5fc531d14de8bee0cd67046530e5', 'request_id': 'req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:26.181880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1 admin admin] The token cache is being invalidate because project 224b5fc531d14de8bee0cd67046530e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:16:26.182246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:26.182842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-43a6ae0e-f0e7-4d86-ae3c-d227b6a600e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:26.184672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1169/2324] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:16:25 2022] DELETE /identity/v3/projects/224b5fc531d14de8bee0cd67046530e5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:34.382981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:34.384669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:34.398647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94232b-3ff4-4f89-bf2d-9ee2abe93931 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:34.448457 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:34.462381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:34.463127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:34.463491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:34.463766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] PATH_INFO: `/v3/users/7d6f9f8613ef4f32ade3d948b2033e9d` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:34.464988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6f9f8613ef4f32ade3d948b2033e9d)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:34.466969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:34.517094 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6f9f8613ef4f32ade3d948b2033e9d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:34.525453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6f9f8613ef4f32ade3d948b2033e9d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:34.535827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6f9f8613ef4f32ade3d948b2033e9d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:34.536509 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6f9f8613ef4f32ade3d948b2033e9d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:34.549767 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6f9f8613ef4f32ade3d948b2033e9d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:34.555925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1156/2325] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:16:34 2022] DELETE /identity/v3/users/7d6f9f8613ef4f32ade3d948b2033e9d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:34.560920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d67ae-365a-4d65-932c-6060959c49cb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:34.561415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d67ae-365a-4d65-932c-6060959c49cb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:34.561714 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d67ae-365a-4d65-932c-6060959c49cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:34.581814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3c5d67ae-365a-4d65-932c-6060959c49cb None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:34.583037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3c5d67ae-365a-4d65-932c-6060959c49cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:34.611289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:34.646090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1170/2326] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:34.656918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:34.659439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:34.738355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa425ffb-11f2-4071-a9b1-f6a8efbffbee admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:34.744606 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf6ceb-28a0-4791-83d2-6db9fe9456bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:34.745583 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6ceb-28a0-4791-83d2-6db9fe9456bc service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:34.745873 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6ceb-28a0-4791-83d2-6db9fe9456bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:34.746190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6ceb-28a0-4791-83d2-6db9fe9456bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:34.758216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf6ceb-28a0-4791-83d2-6db9fe9456bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:34.759657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf6ceb-28a0-4791-83d2-6db9fe9456bc service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:34.769573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1157/2327] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:16:35.065372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d67ae-365a-4d65-932c-6060959c49cb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:35.066989 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3c5d67ae-365a-4d65-932c-6060959c49cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:35.079764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d67ae-365a-4d65-932c-6060959c49cb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:35.089944 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c2bff-8733-483d-82e9-01c7c6bdf9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:35.090781 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c2bff-8733-483d-82e9-01c7c6bdf9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:35.090872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c2bff-8733-483d-82e9-01c7c6bdf9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:35.091259 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c2bff-8733-483d-82e9-01c7c6bdf9b7 admin admin] PATH_INFO: `/v3/projects/a4b5fec00db343499dff928535b61829` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:35.092498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c2bff-8733-483d-82e9-01c7c6bdf9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b5fec00db343499dff928535b61829)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:35.094461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c2bff-8733-483d-82e9-01c7c6bdf9b7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:35.142263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-991c2bff-8733-483d-82e9-01c7c6bdf9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b5fec00db343499dff928535b61829', 'request_id': 'req-991c2bff-8733-483d-82e9-01c7c6bdf9b7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:35.151422 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-991c2bff-8733-483d-82e9-01c7c6bdf9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b5fec00db343499dff928535b61829', 'request_id': 'req-991c2bff-8733-483d-82e9-01c7c6bdf9b7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:35.157140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-991c2bff-8733-483d-82e9-01c7c6bdf9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b5fec00db343499dff928535b61829', 'request_id': 'req-991c2bff-8733-483d-82e9-01c7c6bdf9b7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:35.169022 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-991c2bff-8733-483d-82e9-01c7c6bdf9b7 admin admin] The token cache is being invalidate because project a4b5fec00db343499dff928535b61829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:16:35.169308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-991c2bff-8733-483d-82e9-01c7c6bdf9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:35.170106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-991c2bff-8733-483d-82e9-01c7c6bdf9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:35.171753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1171/2328] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:16:35 2022] DELETE /identity/v3/projects/a4b5fec00db343499dff928535b61829 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:35.176886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da62b97-3b54-4222-8d2e-c92aba0aa17f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:35.177211 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da62b97-3b54-4222-8d2e-c92aba0aa17f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:35.177490 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da62b97-3b54-4222-8d2e-c92aba0aa17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:35.200652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6da62b97-3b54-4222-8d2e-c92aba0aa17f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:35.201918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6da62b97-3b54-4222-8d2e-c92aba0aa17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:35.264135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1158/2329] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:35.273441 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b816e-715f-4ffe-b1c7-c04896ea1d5a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:35.273740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b816e-715f-4ffe-b1c7-c04896ea1d5a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:35.274015 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b816e-715f-4ffe-b1c7-c04896ea1d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:35.295813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1b0b816e-715f-4ffe-b1c7-c04896ea1d5a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:35.297070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1b0b816e-715f-4ffe-b1c7-c04896ea1d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:35.306486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1172/2330] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:35.311098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da62b97-3b54-4222-8d2e-c92aba0aa17f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:35.321823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da62b97-3b54-4222-8d2e-c92aba0aa17f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:35.327190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d94d4-a566-45cc-a3a0-5395d9e1ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:35.327808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d94d4-a566-45cc-a3a0-5395d9e1ea6e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:35.328089 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d94d4-a566-45cc-a3a0-5395d9e1ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:35.328390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d94d4-a566-45cc-a3a0-5395d9e1ea6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:35.329101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d94d4-a566-45cc-a3a0-5395d9e1ea6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:16:35.329407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d94d4-a566-45cc-a3a0-5395d9e1ea6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:35.331030 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d94d4-a566-45cc-a3a0-5395d9e1ea6e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:35.338106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:35.344432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1159/2331] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:16:35.348813 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b816e-715f-4ffe-b1c7-c04896ea1d5a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:35.358667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b816e-715f-4ffe-b1c7-c04896ea1d5a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:35.364844 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3205c-7531-4ffe-ac89-76a48fcccdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:35.365496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3205c-7531-4ffe-ac89-76a48fcccdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:35.365793 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3205c-7531-4ffe-ac89-76a48fcccdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:35.366063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3205c-7531-4ffe-ac89-76a48fcccdd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:35.366734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3205c-7531-4ffe-ac89-76a48fcccdd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:35.368649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3205c-7531-4ffe-ac89-76a48fcccdd7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:35.401761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1173/2332] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:16:35 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:35.406219 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d94d4-a566-45cc-a3a0-5395d9e1ea6e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:35.416734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d94d4-a566-45cc-a3a0-5395d9e1ea6e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:35.474951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d4a2a-ac7d-4d93-b57a-fdd96b4262a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:35.475598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d4a2a-ac7d-4d93-b57a-fdd96b4262a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:35.475876 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d4a2a-ac7d-4d93-b57a-fdd96b4262a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:35.476149 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d4a2a-ac7d-4d93-b57a-fdd96b4262a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:35.476835 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d4a2a-ac7d-4d93-b57a-fdd96b4262a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:35.478809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d4a2a-ac7d-4d93-b57a-fdd96b4262a3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:35.507034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1160/2333] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:16:35 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:35.511445 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3205c-7531-4ffe-ac89-76a48fcccdd7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:35.527124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3205c-7531-4ffe-ac89-76a48fcccdd7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:35.534426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1946b8-9e03-4b03-bf38-c5489016c2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:35.535069 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1946b8-9e03-4b03-bf38-c5489016c2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:35.535349 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1946b8-9e03-4b03-bf38-c5489016c2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:35.535629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1946b8-9e03-4b03-bf38-c5489016c2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:35.536356 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1946b8-9e03-4b03-bf38-c5489016c2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:35.537976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1946b8-9e03-4b03-bf38-c5489016c2c3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:35.549344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1174/2334] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:35.555006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d4a2a-ac7d-4d93-b57a-fdd96b4262a3 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:35.571424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d4a2a-ac7d-4d93-b57a-fdd96b4262a3 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:35.580488 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea7af2-2207-4d34-abc3-70d86134f633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:35.581376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea7af2-2207-4d34-abc3-70d86134f633 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:35.581746 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea7af2-2207-4d34-abc3-70d86134f633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:35.582016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea7af2-2207-4d34-abc3-70d86134f633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:35.582719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea7af2-2207-4d34-abc3-70d86134f633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:35.584440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea7af2-2207-4d34-abc3-70d86134f633 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:35.598610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1161/2335] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:35.603099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1946b8-9e03-4b03-bf38-c5489016c2c3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:35.616806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1946b8-9e03-4b03-bf38-c5489016c2c3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:35.623061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3b1a3-714e-42af-b4be-36be4fa040fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:35.623870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3b1a3-714e-42af-b4be-36be4fa040fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:35.624283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3b1a3-714e-42af-b4be-36be4fa040fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:35.624654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3b1a3-714e-42af-b4be-36be4fa040fc admin admin] PATH_INFO: `/v3/projects/83c0856cc60546a781ba851dbbf27eac/users/f3c3d80180b2461cb2269305422c1666/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:35.642665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3b1a3-714e-42af-b4be-36be4fa040fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c0856cc60546a781ba851dbbf27eac, user_id=f3c3d80180b2461cb2269305422c1666, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:35.645469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3b1a3-714e-42af-b4be-36be4fa040fc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:35.662315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1175/2336] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:16:35 2022] PUT /identity/v3/projects/83c0856cc60546a781ba851dbbf27eac/users/f3c3d80180b2461cb2269305422c1666/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:35.672461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006083c-fe04-4a87-8ede-345f69741e7a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:35.672748 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006083c-fe04-4a87-8ede-345f69741e7a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:35.673062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006083c-fe04-4a87-8ede-345f69741e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:35.701977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-4006083c-fe04-4a87-8ede-345f69741e7a None None] MFA Rules not processed for user `f3c3d80180b2461cb2269305422c1666`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:35.703202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4006083c-fe04-4a87-8ede-345f69741e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:35.780036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1162/2337] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:35.790834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3b1a3-714e-42af-b4be-36be4fa040fc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:35.792664 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-49e3b1a3-714e-42af-b4be-36be4fa040fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:35.858433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3b1a3-714e-42af-b4be-36be4fa040fc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:35.862544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ddec2-8f61-48fd-86b2-d550e41fe62e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:35.863199 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ddec2-8f61-48fd-86b2-d550e41fe62e service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:35.863478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ddec2-8f61-48fd-86b2-d550e41fe62e service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:35.863743 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ddec2-8f61-48fd-86b2-d550e41fe62e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:35.870382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:35.872971 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ddec2-8f61-48fd-86b2-d550e41fe62e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:35.875202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ddec2-8f61-48fd-86b2-d550e41fe62e service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:35.885878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1176/2338] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:16:45.777200 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:45.882692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:45.978856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006083c-fe04-4a87-8ede-345f69741e7a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:46.049117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006083c-fe04-4a87-8ede-345f69741e7a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:46.054796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:46.055455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:46.055730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:46.056004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] PATH_INFO: `/v3/users/f3c3d80180b2461cb2269305422c1666` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:46.057226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c3d80180b2461cb2269305422c1666)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:46.059175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:46.112555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c3d80180b2461cb2269305422c1666'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:46.120112 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c3d80180b2461cb2269305422c1666'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:46.128179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c3d80180b2461cb2269305422c1666'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:46.128994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c3d80180b2461cb2269305422c1666'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:46.141372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c3d80180b2461cb2269305422c1666'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:46.147576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1163/2339] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:16:45 2022] DELETE /identity/v3/users/f3c3d80180b2461cb2269305422c1666 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:46.152845 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6a133-c6b3-4bd2-94b0-53d7405d01a8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:46.153157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6a133-c6b3-4bd2-94b0-53d7405d01a8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:46.153432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6a133-c6b3-4bd2-94b0-53d7405d01a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:46.173457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-07e6a133-c6b3-4bd2-94b0-53d7405d01a8 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:46.174694 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-07e6a133-c6b3-4bd2-94b0-53d7405d01a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:46.237064 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1177/2340] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:46.247333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:46.248990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:46.314334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43161e76-8116-47b3-a56d-267683bec22d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:46.318557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3df75d-14b7-4ac1-a92e-643fc71667fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:46.319190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3df75d-14b7-4ac1-a92e-643fc71667fd service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:46.319470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3df75d-14b7-4ac1-a92e-643fc71667fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:46.319744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3df75d-14b7-4ac1-a92e-643fc71667fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:46.329914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3df75d-14b7-4ac1-a92e-643fc71667fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:46.331383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3df75d-14b7-4ac1-a92e-643fc71667fd service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:46.341715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1164/2341] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:16:46.637828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6a133-c6b3-4bd2-94b0-53d7405d01a8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:46.639206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-07e6a133-c6b3-4bd2-94b0-53d7405d01a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:46.654587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6a133-c6b3-4bd2-94b0-53d7405d01a8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:46.659480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c089a-3d22-4300-aa47-1660c980939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:46.660200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c089a-3d22-4300-aa47-1660c980939d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:46.660475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c089a-3d22-4300-aa47-1660c980939d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:46.660746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c089a-3d22-4300-aa47-1660c980939d admin admin] PATH_INFO: `/v3/projects/83c0856cc60546a781ba851dbbf27eac` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:46.661980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c089a-3d22-4300-aa47-1660c980939d admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c0856cc60546a781ba851dbbf27eac)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:46.663901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c089a-3d22-4300-aa47-1660c980939d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:46.713319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-858c089a-3d22-4300-aa47-1660c980939d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c0856cc60546a781ba851dbbf27eac', 'request_id': 'req-858c089a-3d22-4300-aa47-1660c980939d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:46.722735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-858c089a-3d22-4300-aa47-1660c980939d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c0856cc60546a781ba851dbbf27eac', 'request_id': 'req-858c089a-3d22-4300-aa47-1660c980939d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:46.729146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-858c089a-3d22-4300-aa47-1660c980939d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c0856cc60546a781ba851dbbf27eac', 'request_id': 'req-858c089a-3d22-4300-aa47-1660c980939d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:46.741321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-858c089a-3d22-4300-aa47-1660c980939d admin admin] The token cache is being invalidate because project 83c0856cc60546a781ba851dbbf27eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:16:46.741561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-858c089a-3d22-4300-aa47-1660c980939d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:46.742277 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-858c089a-3d22-4300-aa47-1660c980939d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:16:46.743858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1178/2342] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:16:46 2022] DELETE /identity/v3/projects/83c0856cc60546a781ba851dbbf27eac => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:46.749297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430f081-13c1-486e-b11a-ae633589ee16 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:46.749601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430f081-13c1-486e-b11a-ae633589ee16 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:46.749873 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430f081-13c1-486e-b11a-ae633589ee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:46.770849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9430f081-13c1-486e-b11a-ae633589ee16 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:46.772058 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9430f081-13c1-486e-b11a-ae633589ee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:46.791831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:46.838085 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1165/2343] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:16:46.908789 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eb53b-0f26-4bbc-b2d3-1a377b54d5f0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:46.909933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eb53b-0f26-4bbc-b2d3-1a377b54d5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:46.909933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eb53b-0f26-4bbc-b2d3-1a377b54d5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:46.936530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-878eb53b-0f26-4bbc-b2d3-1a377b54d5f0 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:46.937795 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-878eb53b-0f26-4bbc-b2d3-1a377b54d5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:46.947469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1179/2344] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:46.951865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430f081-13c1-486e-b11a-ae633589ee16 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:46.962403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430f081-13c1-486e-b11a-ae633589ee16 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:46.967423 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78b29e-a7dc-4fab-bf0b-cae6b3cc30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:46.968025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78b29e-a7dc-4fab-bf0b-cae6b3cc30e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:46.968304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78b29e-a7dc-4fab-bf0b-cae6b3cc30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:46.968568 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78b29e-a7dc-4fab-bf0b-cae6b3cc30e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:46.969301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78b29e-a7dc-4fab-bf0b-cae6b3cc30e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:16:46.969600 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78b29e-a7dc-4fab-bf0b-cae6b3cc30e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:46.971198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78b29e-a7dc-4fab-bf0b-cae6b3cc30e4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:46.983321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1166/2345] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:16:46.988347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878eb53b-0f26-4bbc-b2d3-1a377b54d5f0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:46.998148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878eb53b-0f26-4bbc-b2d3-1a377b54d5f0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:47.003433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d582f63-fd9e-4150-90bc-28aa917c93f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:47.004050 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d582f63-fd9e-4150-90bc-28aa917c93f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:47.004332 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d582f63-fd9e-4150-90bc-28aa917c93f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:47.004607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d582f63-fd9e-4150-90bc-28aa917c93f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:47.005342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d582f63-fd9e-4150-90bc-28aa917c93f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:47.007261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d582f63-fd9e-4150-90bc-28aa917c93f1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:47.037912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1180/2346] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:16:46 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:47.042519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78b29e-a7dc-4fab-bf0b-cae6b3cc30e4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:47.053655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78b29e-a7dc-4fab-bf0b-cae6b3cc30e4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:47.117886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbc978-719e-44c2-8c53-f5ded3ecc601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:47.118516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbc978-719e-44c2-8c53-f5ded3ecc601 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:47.118799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbc978-719e-44c2-8c53-f5ded3ecc601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:47.119055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbc978-719e-44c2-8c53-f5ded3ecc601 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:47.119729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbc978-719e-44c2-8c53-f5ded3ecc601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:47.121718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbc978-719e-44c2-8c53-f5ded3ecc601 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:47.144227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1167/2347] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:16:47 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:47.149001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d582f63-fd9e-4150-90bc-28aa917c93f1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:47.160617 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d582f63-fd9e-4150-90bc-28aa917c93f1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:47.166503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2277242-0e9a-4218-a1e3-8b5aa95fbe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:47.167115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2277242-0e9a-4218-a1e3-8b5aa95fbe72 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:47.167384 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2277242-0e9a-4218-a1e3-8b5aa95fbe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:47.167649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2277242-0e9a-4218-a1e3-8b5aa95fbe72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:47.168344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2277242-0e9a-4218-a1e3-8b5aa95fbe72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:47.170020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2277242-0e9a-4218-a1e3-8b5aa95fbe72 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:47.180837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1181/2348] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:47.185164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbc978-719e-44c2-8c53-f5ded3ecc601 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:47.196292 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbc978-719e-44c2-8c53-f5ded3ecc601 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:47.202540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0917dc5-638f-4f9d-bdd0-87c9c9ff78c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:47.203161 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0917dc5-638f-4f9d-bdd0-87c9c9ff78c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:47.203437 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0917dc5-638f-4f9d-bdd0-87c9c9ff78c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:47.203711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0917dc5-638f-4f9d-bdd0-87c9c9ff78c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:47.204408 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0917dc5-638f-4f9d-bdd0-87c9c9ff78c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:47.206066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0917dc5-638f-4f9d-bdd0-87c9c9ff78c3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:47.217093 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1168/2349] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:47.221559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2277242-0e9a-4218-a1e3-8b5aa95fbe72 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:47.231983 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2277242-0e9a-4218-a1e3-8b5aa95fbe72 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:47.236727 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a886-932b-45e3-853c-7cff7867ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:47.237440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a886-932b-45e3-853c-7cff7867ad12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:47.237732 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a886-932b-45e3-853c-7cff7867ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:47.237981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a886-932b-45e3-853c-7cff7867ad12 admin admin] PATH_INFO: `/v3/projects/2720b0660de14a19a05ef57efaa01cd8/users/43ef613541cb4fd49faa3a3cec1a58c8/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:47.252773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245a886-932b-45e3-853c-7cff7867ad12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2720b0660de14a19a05ef57efaa01cd8, user_id=43ef613541cb4fd49faa3a3cec1a58c8, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:47.255465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245a886-932b-45e3-853c-7cff7867ad12 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:47.270012 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1182/2350] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:16:47 2022] PUT /identity/v3/projects/2720b0660de14a19a05ef57efaa01cd8/users/43ef613541cb4fd49faa3a3cec1a58c8/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:47.275712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d433c-3cd5-4e36-8658-b87312454063 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:47.276004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d433c-3cd5-4e36-8658-b87312454063 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:47.276295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d433c-3cd5-4e36-8658-b87312454063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:47.297889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d05d433c-3cd5-4e36-8658-b87312454063 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:47.299130 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d05d433c-3cd5-4e36-8658-b87312454063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:47.367990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1169/2351] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:47.378688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a886-932b-45e3-853c-7cff7867ad12 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:47.380643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d245a886-932b-45e3-853c-7cff7867ad12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:47.403576 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:47.440923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a886-932b-45e3-853c-7cff7867ad12 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:47.445010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bbd80-5e33-43e1-b9d3-07b1d553b90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:47.445631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bbd80-5e33-43e1-b9d3-07b1d553b90a service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:47.445909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bbd80-5e33-43e1-b9d3-07b1d553b90a service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:47.446179 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bbd80-5e33-43e1-b9d3-07b1d553b90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:47.455880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bbd80-5e33-43e1-b9d3-07b1d553b90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:47.457380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bbd80-5e33-43e1-b9d3-07b1d553b90a service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:47.466906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1183/2352] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:16:51.631458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc39c29-91eb-44a0-95c1-4da86e73f91c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:51.631907 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc39c29-91eb-44a0-95c1-4da86e73f91c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:51.632006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc39c29-91eb-44a0-95c1-4da86e73f91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:51.662689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-bbc39c29-91eb-44a0-95c1-4da86e73f91c None None] MFA Rules not processed for user `43ef613541cb4fd49faa3a3cec1a58c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:51.663825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bbc39c29-91eb-44a0-95c1-4da86e73f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:51.681916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:51.734399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1170/2353] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:16:51.743065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bbd80-5e33-43e1-b9d3-07b1d553b90a service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:51.765993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bbd80-5e33-43e1-b9d3-07b1d553b90a service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:51.773186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18ca2b-d28e-42c3-8a9f-7faa2aa58636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:51.774417 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ca2b-d28e-42c3-8a9f-7faa2aa58636 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:51.775348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ca2b-d28e-42c3-8a9f-7faa2aa58636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:51.775723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18ca2b-d28e-42c3-8a9f-7faa2aa58636 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:51.776559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18ca2b-d28e-42c3-8a9f-7faa2aa58636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:51.778951 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18ca2b-d28e-42c3-8a9f-7faa2aa58636 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:51.809972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1184/2354] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:16:51 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:51.814043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc39c29-91eb-44a0-95c1-4da86e73f91c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:51.831140 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc39c29-91eb-44a0-95c1-4da86e73f91c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:51.891113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62c4e-5a10-4793-b9fb-3589720cf0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:51.891700 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62c4e-5a10-4793-b9fb-3589720cf0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:51.891934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62c4e-5a10-4793-b9fb-3589720cf0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:51.892202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b62c4e-5a10-4793-b9fb-3589720cf0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:51.892850 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b62c4e-5a10-4793-b9fb-3589720cf0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:51.894889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b62c4e-5a10-4793-b9fb-3589720cf0c5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:51.923060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1171/2355] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:16:51 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:16:51.924706 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18ca2b-d28e-42c3-8a9f-7faa2aa58636 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:51.935464 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18ca2b-d28e-42c3-8a9f-7faa2aa58636 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:51.940239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afeda68-5752-4596-b78c-54a3f0861c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:51.940875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeda68-5752-4596-b78c-54a3f0861c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:51.941308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeda68-5752-4596-b78c-54a3f0861c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:51.941724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeda68-5752-4596-b78c-54a3f0861c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:51.942425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afeda68-5752-4596-b78c-54a3f0861c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:51.944035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afeda68-5752-4596-b78c-54a3f0861c1f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:51.955208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1185/2356] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:51.959639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62c4e-5a10-4793-b9fb-3589720cf0c5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:51.970634 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b62c4e-5a10-4793-b9fb-3589720cf0c5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:51.977044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cae5fc-6622-4d63-8a93-288200d29764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:51.977731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae5fc-6622-4d63-8a93-288200d29764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:51.978009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae5fc-6622-4d63-8a93-288200d29764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:51.978278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cae5fc-6622-4d63-8a93-288200d29764 admin admin] PATH_INFO: `/v3/projects/68876c6b41f342d88572f44e1ebd6efd/users/28bbe33fea2247088a9d439d27c53fd3/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:51.995903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cae5fc-6622-4d63-8a93-288200d29764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68876c6b41f342d88572f44e1ebd6efd, user_id=28bbe33fea2247088a9d439d27c53fd3, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:51.998806 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cae5fc-6622-4d63-8a93-288200d29764 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:52.014035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1172/2357] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:16:51 2022] PUT /identity/v3/projects/68876c6b41f342d88572f44e1ebd6efd/users/28bbe33fea2247088a9d439d27c53fd3/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:52.017851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afeda68-5752-4596-b78c-54a3f0861c1f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:52.028724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afeda68-5752-4596-b78c-54a3f0861c1f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:52.091801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a4ce0-4b2a-4888-9b9b-bc07beb78498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:52.092537 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a4ce0-4b2a-4888-9b9b-bc07beb78498 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:52.093011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a4ce0-4b2a-4888-9b9b-bc07beb78498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:52.093155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a4ce0-4b2a-4888-9b9b-bc07beb78498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:52.093792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a4ce0-4b2a-4888-9b9b-bc07beb78498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:52.095403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a4ce0-4b2a-4888-9b9b-bc07beb78498 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:52.106689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1186/2358] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:16:52.111097 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cae5fc-6622-4d63-8a93-288200d29764 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:52.122204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cae5fc-6622-4d63-8a93-288200d29764 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:52.127331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f660c3-793e-4434-82f4-4443de90dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:52.128023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f660c3-793e-4434-82f4-4443de90dcc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:52.128324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f660c3-793e-4434-82f4-4443de90dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:52.128571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f660c3-793e-4434-82f4-4443de90dcc8 admin admin] PATH_INFO: `/v3/projects/68876c6b41f342d88572f44e1ebd6efd/users/28bbe33fea2247088a9d439d27c53fd3/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:52.130636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f660c3-793e-4434-82f4-4443de90dcc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68876c6b41f342d88572f44e1ebd6efd, user_id=28bbe33fea2247088a9d439d27c53fd3, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:52.133326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f660c3-793e-4434-82f4-4443de90dcc8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:52.144828 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1173/2359] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:16:52 2022] PUT /identity/v3/projects/68876c6b41f342d88572f44e1ebd6efd/users/28bbe33fea2247088a9d439d27c53fd3/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:16:56.328929 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142a135-fc63-47ef-93a0-b79abffc2754 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:56.329505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142a135-fc63-47ef-93a0-b79abffc2754 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:56.329505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142a135-fc63-47ef-93a0-b79abffc2754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:56.363011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6142a135-fc63-47ef-93a0-b79abffc2754 None None] MFA Rules not processed for user `28bbe33fea2247088a9d439d27c53fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:16:56.364658 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6142a135-fc63-47ef-93a0-b79abffc2754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:56.473801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1187/2360] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:16:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:16:56.498275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f660c3-793e-4434-82f4-4443de90dcc8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:16:56.501703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-28f660c3-793e-4434-82f4-4443de90dcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:16:56.637379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f660c3-793e-4434-82f4-4443de90dcc8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:16:56.652994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4ed68-1228-4d24-9d0d-21c007dcdd14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:16:56.653703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4ed68-1228-4d24-9d0d-21c007dcdd14 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:16:56.654083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4ed68-1228-4d24-9d0d-21c007dcdd14 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:16:56.654458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4ed68-1228-4d24-9d0d-21c007dcdd14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:16:56.663223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:16:56.742440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4ed68-1228-4d24-9d0d-21c007dcdd14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:16:56.744442 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4ed68-1228-4d24-9d0d-21c007dcdd14 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:16:56.760185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1174/2361] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:16:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:17:06.470097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:06.752055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=24 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:22.905580 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1597719-633b-4285-8d9c-fa4810e85eb3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:17:22.906084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1597719-633b-4285-8d9c-fa4810e85eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:17:22.906183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1597719-633b-4285-8d9c-fa4810e85eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:17:22.926421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e1597719-633b-4285-8d9c-fa4810e85eb3 None None] MFA Rules not processed for user `43ef613541cb4fd49faa3a3cec1a58c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:17:22.927645 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e1597719-633b-4285-8d9c-fa4810e85eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:17:22.935272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1188/2362] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:17:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:17:25.312690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4ed68-1228-4d24-9d0d-21c007dcdd14 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:17:25.315007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-aef4ed68-1228-4d24-9d0d-21c007dcdd14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:17:25.389045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4ed68-1228-4d24-9d0d-21c007dcdd14 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:17:25.394637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017593d-4112-494e-bed5-fa6317f52711 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:17:25.395289 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017593d-4112-494e-bed5-fa6317f52711 service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:17:25.395708 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017593d-4112-494e-bed5-fa6317f52711 service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:17:25.396115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017593d-4112-494e-bed5-fa6317f52711 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:17:25.398019 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b017593d-4112-494e-bed5-fa6317f52711 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:17:25.411024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017593d-4112-494e-bed5-fa6317f52711 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:17:25.412741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017593d-4112-494e-bed5-fa6317f52711 service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:17:25.423739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1175/2363] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:17:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:17:32.920722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:33.843927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68466f8c-f29a-417b-ba1d-e0fe790da274 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:17:33.844221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68466f8c-f29a-417b-ba1d-e0fe790da274 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:17:33.844499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68466f8c-f29a-417b-ba1d-e0fe790da274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:17:33.864249 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-68466f8c-f29a-417b-ba1d-e0fe790da274 None None] MFA Rules not processed for user `096d0da1a0bc401c95bfbb8fc150a27b`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:17:33.865489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-68466f8c-f29a-417b-ba1d-e0fe790da274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:17:33.924416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1189/2364] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:17:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:17:35.419558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=32 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:43.917358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=25 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:17:51.423035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017593d-4112-494e-bed5-fa6317f52711 service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:17:51.483367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017593d-4112-494e-bed5-fa6317f52711 service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:17:51.487375 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efc514-be28-456f-a1dd-afb249c652a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:17:51.488086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efc514-be28-456f-a1dd-afb249c652a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:17:51.488445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efc514-be28-456f-a1dd-afb249c652a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:17:51.488783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efc514-be28-456f-a1dd-afb249c652a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:17:51.499700 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efc514-be28-456f-a1dd-afb249c652a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:17:51.501409 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efc514-be28-456f-a1dd-afb249c652a1 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:17:51.513115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1176/2365] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:17:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:18:01.508349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=26 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:26.444669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afeb42c-d9ea-4c19-9056-ccd362ff9616 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:26.445321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afeb42c-d9ea-4c19-9056-ccd362ff9616 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:26.445321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afeb42c-d9ea-4c19-9056-ccd362ff9616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:26.465252 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2afeb42c-d9ea-4c19-9056-ccd362ff9616 None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:18:26.466462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2afeb42c-d9ea-4c19-9056-ccd362ff9616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:18:26.525909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1190/2366] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:18:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:18:26.568427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efc514-be28-456f-a1dd-afb249c652a1 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:18:26.570152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a2efc514-be28-456f-a1dd-afb249c652a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:18:26.645065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efc514-be28-456f-a1dd-afb249c652a1 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:18:26.650427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069e8b6-d450-403b-bd70-8923f236fc07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:18:26.651081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069e8b6-d450-403b-bd70-8923f236fc07 service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:26.651368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069e8b6-d450-403b-bd70-8923f236fc07 service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:26.651639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069e8b6-d450-403b-bd70-8923f236fc07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:26.660479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069e8b6-d450-403b-bd70-8923f236fc07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:18:26.662154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069e8b6-d450-403b-bd70-8923f236fc07 service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:18:26.670326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1177/2367] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:18:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:18:36.518223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=25 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:36.666965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=32 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:18:41.135076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d99e9-a6de-43a8-b7f4-64fee9e1482a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:41.135816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d99e9-a6de-43a8-b7f4-64fee9e1482a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:41.135816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d99e9-a6de-43a8-b7f4-64fee9e1482a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:41.137150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1191/2368] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:18:41.143573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb4e95-c967-43d8-917d-de38485b559e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:41.144123 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb4e95-c967-43d8-917d-de38485b559e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:41.144123 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb4e95-c967-43d8-917d-de38485b559e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:41.167093 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-badb4e95-c967-43d8-917d-de38485b559e None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:18:41.168323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-badb4e95-c967-43d8-917d-de38485b559e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:18:41.178642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1178/2369] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:18:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:18:41.194038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d99e9-a6de-43a8-b7f4-64fee9e1482a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:18:41.196144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e08d99e9-a6de-43a8-b7f4-64fee9e1482a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:18:41.269778 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d99e9-a6de-43a8-b7f4-64fee9e1482a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:18:41.274498 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fb125-09ab-48a6-819e-009c741f8532 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c3d7cdad7f44f0f8df944ec7f69de26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:18:41.275152 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fb125-09ab-48a6-819e-009c741f8532 service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:41.275419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fb125-09ab-48a6-819e-009c741f8532 service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:41.275693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fb125-09ab-48a6-819e-009c741f8532 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:41.287824 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fb125-09ab-48a6-819e-009c741f8532 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:18:41.289449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fb125-09ab-48a6-819e-009c741f8532 service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:18:41.301976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1192/2370] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:18:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:18:41.380866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c7396-7d1e-4814-8ccf-cf641c797353 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:41.381106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c7396-7d1e-4814-8ccf-cf641c797353 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:41.381305 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c7396-7d1e-4814-8ccf-cf641c797353 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:41.382699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1179/2371] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:18:41.387439 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d223d4-a4cc-43a7-a34e-d84b87af699d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:41.387722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d223d4-a4cc-43a7-a34e-d84b87af699d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:41.388059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d223d4-a4cc-43a7-a34e-d84b87af699d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:41.408907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-69d223d4-a4cc-43a7-a34e-d84b87af699d None None] MFA Rules not processed for user `9c4ce8a3f876467f93e7c9efd9e33390`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:18:41.410144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-69d223d4-a4cc-43a7-a34e-d84b87af699d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:18:41.417671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1193/2372] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:18:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:18:41.429598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c7396-7d1e-4814-8ccf-cf641c797353 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:18:41.441401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c7396-7d1e-4814-8ccf-cf641c797353 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:18:41.445803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09ef46-4959-440c-9d06-59a22aa2715a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:18:41.446438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ef46-4959-440c-9d06-59a22aa2715a service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:41.446722 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ef46-4959-440c-9d06-59a22aa2715a service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:41.447006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ef46-4959-440c-9d06-59a22aa2715a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:41.454963 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09ef46-4959-440c-9d06-59a22aa2715a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:18:41.456406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09ef46-4959-440c-9d06-59a22aa2715a service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:18:41.468910 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1180/2373] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:18:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:18:41.553300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d2a1c-3dc4-4624-8999-9095cdfa5558 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:41.553588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d2a1c-3dc4-4624-8999-9095cdfa5558 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:41.553866 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d2a1c-3dc4-4624-8999-9095cdfa5558 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:41.555245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1194/2374] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:18:41.560825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6238fe1-c1cc-4fe7-b7c4-10aa1685aea1 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:41.561140 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6238fe1-c1cc-4fe7-b7c4-10aa1685aea1 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:41.561417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6238fe1-c1cc-4fe7-b7c4-10aa1685aea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:41.581763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d6238fe1-c1cc-4fe7-b7c4-10aa1685aea1 None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:18:41.582969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d6238fe1-c1cc-4fe7-b7c4-10aa1685aea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:18:41.593143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1181/2375] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:18:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:18:41.604055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d2a1c-3dc4-4624-8999-9095cdfa5558 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:18:41.616154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d2a1c-3dc4-4624-8999-9095cdfa5558 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:18:41.620094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb20ce5-64e2-42b5-9006-a08d3349b352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:18:41.620713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb20ce5-64e2-42b5-9006-a08d3349b352 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:41.621030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb20ce5-64e2-42b5-9006-a08d3349b352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:41.621306 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb20ce5-64e2-42b5-9006-a08d3349b352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:41.632223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb20ce5-64e2-42b5-9006-a08d3349b352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:18:41.633629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb20ce5-64e2-42b5-9006-a08d3349b352 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:18:41.644525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1195/2376] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:18:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:18:44.821857 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f999b1a-bc29-4922-9183-9889481d9887 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:44.822755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f999b1a-bc29-4922-9183-9889481d9887 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:44.822755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f999b1a-bc29-4922-9183-9889481d9887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:44.844281 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8f999b1a-bc29-4922-9183-9889481d9887 None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:18:44.845546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8f999b1a-bc29-4922-9183-9889481d9887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:18:44.853351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1182/2377] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:18:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:18:44.870472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb20ce5-64e2-42b5-9006-a08d3349b352 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:18:44.884711 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb20ce5-64e2-42b5-9006-a08d3349b352 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:18:44.891289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646fd66-17ee-4c38-8391-6432702c8713 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:18:44.892359 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646fd66-17ee-4c38-8391-6432702c8713 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:44.892847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646fd66-17ee-4c38-8391-6432702c8713 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:44.893474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646fd66-17ee-4c38-8391-6432702c8713 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:44.909874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646fd66-17ee-4c38-8391-6432702c8713 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:18:44.912666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646fd66-17ee-4c38-8391-6432702c8713 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:18:44.926423 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1196/2378] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:18:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 07:18:49.726240 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f999b1a-bc29-4922-9183-9889481d9887 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:18:49.744030 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f999b1a-bc29-4922-9183-9889481d9887 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:18:49.752650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6225f4a-4b28-4b37-a5f1-dde0b6475243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:18:49.754555 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6225f4a-4b28-4b37-a5f1-dde0b6475243 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:49.755688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6225f4a-4b28-4b37-a5f1-dde0b6475243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:49.756595 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6225f4a-4b28-4b37-a5f1-dde0b6475243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:49.759960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-a6225f4a-4b28-4b37-a5f1-dde0b6475243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:18:49.781941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6225f4a-4b28-4b37-a5f1-dde0b6475243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:18:49.783432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6225f4a-4b28-4b37-a5f1-dde0b6475243 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:18:49.797716 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1183/2379] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:18:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:18:50.705258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646fd66-17ee-4c38-8391-6432702c8713 service swift] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:18:50.708729 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3646fd66-17ee-4c38-8391-6432702c8713 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:18:50.723181 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646fd66-17ee-4c38-8391-6432702c8713 service swift] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:18:50.727216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3d998-9676-4f49-b65e-11faba1bf137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:18:50.727862 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3d998-9676-4f49-b65e-11faba1bf137 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:18:50.728141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3d998-9676-4f49-b65e-11faba1bf137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:18:50.728415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3d998-9676-4f49-b65e-11faba1bf137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:18:50.730670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e6a3d998-9676-4f49-b65e-11faba1bf137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:18:50.749577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3d998-9676-4f49-b65e-11faba1bf137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:18:50.751127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3d998-9676-4f49-b65e-11faba1bf137 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:18:50.766455 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1197/2380] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:18:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:18:59.791733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=21 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:00.758343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=47 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:07.014109 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6225f4a-4b28-4b37-a5f1-dde0b6475243 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:19:07.025455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6225f4a-4b28-4b37-a5f1-dde0b6475243 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:19:07.030602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc4e9b-6aa0-454e-a0a8-b26167a05e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:19:07.031417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc4e9b-6aa0-454e-a0a8-b26167a05e0f service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:19:07.031801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc4e9b-6aa0-454e-a0a8-b26167a05e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:19:07.032173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc4e9b-6aa0-454e-a0a8-b26167a05e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:19:07.034733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1efc4e9b-6aa0-454e-a0a8-b26167a05e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:19:07.157171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc4e9b-6aa0-454e-a0a8-b26167a05e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:19:07.159840 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc4e9b-6aa0-454e-a0a8-b26167a05e0f service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:19:07.179127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1184/2381] 10.222.0.27 () {60 vars in 1396 bytes} [Fri Aug 5 07:19:07 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3268 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:19:07.297165 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e930b8-b9b4-497a-bd6f-6e96fca6000e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:19:07.298059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e930b8-b9b4-497a-bd6f-6e96fca6000e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:19:07.298059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e930b8-b9b4-497a-bd6f-6e96fca6000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:19:07.320444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-42e930b8-b9b4-497a-bd6f-6e96fca6000e None None] MFA Rules not processed for user `2ce8bf4f0ab64010b3855193f55971d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:19:07.321794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-42e930b8-b9b4-497a-bd6f-6e96fca6000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:19:07.332282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1198/2382] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:19:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:19:10.701374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc4e9b-6aa0-454e-a0a8-b26167a05e0f service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:19:10.715494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc4e9b-6aa0-454e-a0a8-b26167a05e0f service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:19:10.721958 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced1415-4bda-4dde-a5eb-f6a421447a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:19:10.722608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced1415-4bda-4dde-a5eb-f6a421447a16 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:19:10.722881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced1415-4bda-4dde-a5eb-f6a421447a16 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:19:10.723164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced1415-4bda-4dde-a5eb-f6a421447a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:19:10.725243 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-eced1415-4bda-4dde-a5eb-f6a421447a16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:19:10.798319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced1415-4bda-4dde-a5eb-f6a421447a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:19:10.799965 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced1415-4bda-4dde-a5eb-f6a421447a16 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:19:10.811333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1185/2383] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:19:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:19:17.314465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:19.673928 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937393e-45db-4e02-9ffe-773fbcce9a88 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:19:19.675063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937393e-45db-4e02-9ffe-773fbcce9a88 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:19:19.675063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937393e-45db-4e02-9ffe-773fbcce9a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:19:19.700011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1937393e-45db-4e02-9ffe-773fbcce9a88 None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:19:19.701340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1937393e-45db-4e02-9ffe-773fbcce9a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:19:19.709508 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1199/2384] 10.222.0.27 () {58 vars in 967 bytes} [Fri Aug 5 07:19:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:19:19.727948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced1415-4bda-4dde-a5eb-f6a421447a16 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:19:19.740760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced1415-4bda-4dde-a5eb-f6a421447a16 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:19:19.747031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc02bdd-8c1f-43d1-944a-54f42570537e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:19:19.747686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc02bdd-8c1f-43d1-944a-54f42570537e service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:19:19.747973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc02bdd-8c1f-43d1-944a-54f42570537e service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:19:19.748272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc02bdd-8c1f-43d1-944a-54f42570537e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:19:19.757971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc02bdd-8c1f-43d1-944a-54f42570537e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:19:19.759766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc02bdd-8c1f-43d1-944a-54f42570537e service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:19:19.769920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1186/2385] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:19:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:19:22.473076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937393e-45db-4e02-9ffe-773fbcce9a88 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:19:22.488253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937393e-45db-4e02-9ffe-773fbcce9a88 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:19:22.492864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b43c0-bc23-4c73-bc30-45fb643f2a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:19:22.493632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b43c0-bc23-4c73-bc30-45fb643f2a06 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:19:22.494143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b43c0-bc23-4c73-bc30-45fb643f2a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:19:22.494653 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b43c0-bc23-4c73-bc30-45fb643f2a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:19:22.496578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-404b43c0-bc23-4c73-bc30-45fb643f2a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:19:22.508114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b43c0-bc23-4c73-bc30-45fb643f2a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:19:22.509667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b43c0-bc23-4c73-bc30-45fb643f2a06 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:19:22.520780 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1200/2386] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:19:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:19:29.765751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=62 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:32.515346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=9 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:32.891816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc02bdd-8c1f-43d1-944a-54f42570537e service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:19:32.893634 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ffc02bdd-8c1f-43d1-944a-54f42570537e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:19:32.911807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc02bdd-8c1f-43d1-944a-54f42570537e service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:19:32.918100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85f84c-0554-471e-a706-31196ad95200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:19:32.918741 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85f84c-0554-471e-a706-31196ad95200 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:19:32.919016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85f84c-0554-471e-a706-31196ad95200 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:19:32.919290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85f84c-0554-471e-a706-31196ad95200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:19:32.921487 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7e85f84c-0554-471e-a706-31196ad95200 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:19:32.934506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85f84c-0554-471e-a706-31196ad95200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:19:32.936156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85f84c-0554-471e-a706-31196ad95200 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:19:32.947141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1187/2387] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:19:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:19:37.273733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b43c0-bc23-4c73-bc30-45fb643f2a06 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:19:37.293190 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b43c0-bc23-4c73-bc30-45fb643f2a06 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:19:37.312099 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cdd50-88d1-44bb-999a-5c4ba2b296a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:19:37.313138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cdd50-88d1-44bb-999a-5c4ba2b296a0 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:19:37.313666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cdd50-88d1-44bb-999a-5c4ba2b296a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:19:37.314118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cdd50-88d1-44bb-999a-5c4ba2b296a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:19:37.316507 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bd2cdd50-88d1-44bb-999a-5c4ba2b296a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:19:37.333776 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cdd50-88d1-44bb-999a-5c4ba2b296a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:19:37.335539 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cdd50-88d1-44bb-999a-5c4ba2b296a0 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:19:37.349549 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1201/2388] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:19:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:19:42.941803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=6 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:47.343745 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:19:49.306578 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c8578-d7d0-4a1a-b2c8-6df24690433f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:19:49.307166 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c8578-d7d0-4a1a-b2c8-6df24690433f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:19:49.307592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c8578-d7d0-4a1a-b2c8-6df24690433f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:19:49.330976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-090c8578-d7d0-4a1a-b2c8-6df24690433f None None] MFA Rules not processed for user `096d0da1a0bc401c95bfbb8fc150a27b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:19:49.332275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-090c8578-d7d0-4a1a-b2c8-6df24690433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:19:49.339992 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1188/2389] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:19:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:19:49.708536 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cdd50-88d1-44bb-999a-5c4ba2b296a0 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:19:49.718727 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cdd50-88d1-44bb-999a-5c4ba2b296a0 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:19:49.723612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b467db-cafe-49dc-91fe-35ab9d674ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:19:49.723612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b467db-cafe-49dc-91fe-35ab9d674ece service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:19:49.723933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b467db-cafe-49dc-91fe-35ab9d674ece service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:19:49.724054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b467db-cafe-49dc-91fe-35ab9d674ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:19:49.726232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-62b467db-cafe-49dc-91fe-35ab9d674ece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:19:49.737418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b467db-cafe-49dc-91fe-35ab9d674ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:19:49.738979 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b467db-cafe-49dc-91fe-35ab9d674ece service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:19:49.748999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1202/2390] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:19:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:19:50.185763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c8578-d7d0-4a1a-b2c8-6df24690433f None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:19:50.201097 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c8578-d7d0-4a1a-b2c8-6df24690433f None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:19:50.207366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642421e-6152-42ef-a7f2-b9a4790bed2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:19:50.208182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642421e-6152-42ef-a7f2-b9a4790bed2c service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:19:50.208697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642421e-6152-42ef-a7f2-b9a4790bed2c service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:19:50.209194 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642421e-6152-42ef-a7f2-b9a4790bed2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:19:50.212733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5642421e-6152-42ef-a7f2-b9a4790bed2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:19:50.231190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642421e-6152-42ef-a7f2-b9a4790bed2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:19:50.232921 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642421e-6152-42ef-a7f2-b9a4790bed2c service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:19:50.248155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1189/2391] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:19:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:19:59.749360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:00.242754 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=9 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:01.074881 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b467db-cafe-49dc-91fe-35ab9d674ece service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:01.099196 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b467db-cafe-49dc-91fe-35ab9d674ece service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:01.109697 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a4b1f-cc15-4167-8a81-61456293f328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:01.110785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a4b1f-cc15-4167-8a81-61456293f328 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:01.111328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a4b1f-cc15-4167-8a81-61456293f328 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:01.111770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a4b1f-cc15-4167-8a81-61456293f328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:01.114918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ec2a4b1f-cc15-4167-8a81-61456293f328 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:01.139827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a4b1f-cc15-4167-8a81-61456293f328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:01.143710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a4b1f-cc15-4167-8a81-61456293f328 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:01.163742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1203/2392] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:20:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:20:11.158406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:39.389520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642421e-6152-42ef-a7f2-b9a4790bed2c service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:39.417768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642421e-6152-42ef-a7f2-b9a4790bed2c service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:39.426117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c375c2-043c-490e-8f52-45ea53b6b831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:39.426981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c375c2-043c-490e-8f52-45ea53b6b831 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:39.427363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c375c2-043c-490e-8f52-45ea53b6b831 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:39.427797 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c375c2-043c-490e-8f52-45ea53b6b831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:39.431421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-91c375c2-043c-490e-8f52-45ea53b6b831 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:39.450216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c375c2-043c-490e-8f52-45ea53b6b831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:39.453132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c375c2-043c-490e-8f52-45ea53b6b831 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:39.470939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1190/2393] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:20:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:20:42.696458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c47ed-bf97-4176-9e20-a0fcfbedb2fe None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:42.697545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c47ed-bf97-4176-9e20-a0fcfbedb2fe None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:42.698980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c47ed-bf97-4176-9e20-a0fcfbedb2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:42.727058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-693c47ed-bf97-4176-9e20-a0fcfbedb2fe None None] MFA Rules not processed for user `43ef613541cb4fd49faa3a3cec1a58c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:20:42.729386 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-693c47ed-bf97-4176-9e20-a0fcfbedb2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:42.745536 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1204/2394] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:20:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:20:43.740851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c375c2-043c-490e-8f52-45ea53b6b831 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:43.770512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c375c2-043c-490e-8f52-45ea53b6b831 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:43.783027 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b85c5-f26d-4762-a40f-6dc4118ccd27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:43.784836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b85c5-f26d-4762-a40f-6dc4118ccd27 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:43.786033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b85c5-f26d-4762-a40f-6dc4118ccd27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:43.786920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b85c5-f26d-4762-a40f-6dc4118ccd27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:43.794017 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-960b85c5-f26d-4762-a40f-6dc4118ccd27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:43.944353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b85c5-f26d-4762-a40f-6dc4118ccd27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:43.946037 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b85c5-f26d-4762-a40f-6dc4118ccd27 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:43.960393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1191/2395] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:20:46.187326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5256a6-edd7-43ad-9941-c78c384bdc9f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:46.188655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5256a6-edd7-43ad-9941-c78c384bdc9f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:46.189472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5256a6-edd7-43ad-9941-c78c384bdc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:46.234339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ae5256a6-edd7-43ad-9941-c78c384bdc9f None None] MFA Rules not processed for user `723cdd3baceb4f51a57df4863af99c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:20:46.236940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ae5256a6-edd7-43ad-9941-c78c384bdc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:46.349837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1205/2396] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:20:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:20:46.594520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416717-2a7a-47a2-8b13-70dbc9078a16 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:46.595980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416717-2a7a-47a2-8b13-70dbc9078a16 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:46.596465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416717-2a7a-47a2-8b13-70dbc9078a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:46.638736 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f9416717-2a7a-47a2-8b13-70dbc9078a16 None None] MFA Rules not processed for user `02c685b300874351ab2dbd62bea1a669`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:20:46.641222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f9416717-2a7a-47a2-8b13-70dbc9078a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:46.650914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1192/2397] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:20:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:20:47.190176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5256a6-edd7-43ad-9941-c78c384bdc9f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:47.211289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5256a6-edd7-43ad-9941-c78c384bdc9f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:47.217336 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b1c0e-d9b8-4d86-91be-b1f44258f3bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:47.218826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b1c0e-d9b8-4d86-91be-b1f44258f3bd service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:47.219597 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b1c0e-d9b8-4d86-91be-b1f44258f3bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:47.221562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b1c0e-d9b8-4d86-91be-b1f44258f3bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:47.224544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c15b1c0e-d9b8-4d86-91be-b1f44258f3bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:47.249413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b1c0e-d9b8-4d86-91be-b1f44258f3bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:47.253499 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b1c0e-d9b8-4d86-91be-b1f44258f3bd service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:47.273884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1206/2398] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:20:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:20:48.180477 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9416717-2a7a-47a2-8b13-70dbc9078a16 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:48.210162 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9416717-2a7a-47a2-8b13-70dbc9078a16 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:48.225496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08c04d-f28a-4b6e-be62-5b8fb315072d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:48.227079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08c04d-f28a-4b6e-be62-5b8fb315072d service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:48.229275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08c04d-f28a-4b6e-be62-5b8fb315072d service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:48.231475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08c04d-f28a-4b6e-be62-5b8fb315072d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:48.235603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1e08c04d-f28a-4b6e-be62-5b8fb315072d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:48.262186 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08c04d-f28a-4b6e-be62-5b8fb315072d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:48.264836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08c04d-f28a-4b6e-be62-5b8fb315072d service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:48.292072 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1193/2399] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:20:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:20:51.906006 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b1c0e-d9b8-4d86-91be-b1f44258f3bd service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:51.907407 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c15b1c0e-d9b8-4d86-91be-b1f44258f3bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:51.950574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b1c0e-d9b8-4d86-91be-b1f44258f3bd service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:51.967942 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ea89a-d242-4b01-8e47-f86972166bdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:51.969722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ea89a-d242-4b01-8e47-f86972166bdd service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:51.970236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ea89a-d242-4b01-8e47-f86972166bdd service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:51.974395 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ea89a-d242-4b01-8e47-f86972166bdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:51.983155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-823ea89a-d242-4b01-8e47-f86972166bdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:52.029422 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ea89a-d242-4b01-8e47-f86972166bdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:52.031929 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ea89a-d242-4b01-8e47-f86972166bdd service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:52.073936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1207/2400] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:20:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:20:52.429289 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08c04d-f28a-4b6e-be62-5b8fb315072d service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:52.431544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1e08c04d-f28a-4b6e-be62-5b8fb315072d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:52.454194 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08c04d-f28a-4b6e-be62-5b8fb315072d service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:52.461679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2c04-9eb0-40db-aec7-8972fcf1e70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:52.462453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2c04-9eb0-40db-aec7-8972fcf1e70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:52.462816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2c04-9eb0-40db-aec7-8972fcf1e70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:52.463095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2c04-9eb0-40db-aec7-8972fcf1e70e admin admin] PATH_INFO: `/v3/users/2ce8bf4f0ab64010b3855193f55971d2` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:52.464759 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2c04-9eb0-40db-aec7-8972fcf1e70e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce8bf4f0ab64010b3855193f55971d2)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:52.468141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2c04-9eb0-40db-aec7-8972fcf1e70e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:52.560678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-510b2c04-9eb0-40db-aec7-8972fcf1e70e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce8bf4f0ab64010b3855193f55971d2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:20:52.579079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-510b2c04-9eb0-40db-aec7-8972fcf1e70e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce8bf4f0ab64010b3855193f55971d2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:20:52.599973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-510b2c04-9eb0-40db-aec7-8972fcf1e70e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce8bf4f0ab64010b3855193f55971d2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:20:52.602283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-510b2c04-9eb0-40db-aec7-8972fcf1e70e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce8bf4f0ab64010b3855193f55971d2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:20:52.645960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-510b2c04-9eb0-40db-aec7-8972fcf1e70e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce8bf4f0ab64010b3855193f55971d2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:20:52.660794 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1194/2401] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:20:52 2022] DELETE /identity/v3/users/2ce8bf4f0ab64010b3855193f55971d2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:20:53.512399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ea89a-d242-4b01-8e47-f86972166bdd service placement] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:53.525192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ea89a-d242-4b01-8e47-f86972166bdd service placement] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:53.610922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb7d88-42b8-485b-9d2e-2bac72abac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:53.611218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb7d88-42b8-485b-9d2e-2bac72abac5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:53.611491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb7d88-42b8-485b-9d2e-2bac72abac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:53.611770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb7d88-42b8-485b-9d2e-2bac72abac5d admin admin] PATH_INFO: `/v3/projects/fe39edf907ff48518759474a800b949d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:53.613300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb7d88-42b8-485b-9d2e-2bac72abac5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe39edf907ff48518759474a800b949d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:53.615445 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb7d88-42b8-485b-9d2e-2bac72abac5d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:53.693612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-39cb7d88-42b8-485b-9d2e-2bac72abac5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe39edf907ff48518759474a800b949d', 'request_id': 'req-39cb7d88-42b8-485b-9d2e-2bac72abac5d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:20:53.705838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-39cb7d88-42b8-485b-9d2e-2bac72abac5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe39edf907ff48518759474a800b949d', 'request_id': 'req-39cb7d88-42b8-485b-9d2e-2bac72abac5d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:20:53.713955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-39cb7d88-42b8-485b-9d2e-2bac72abac5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe39edf907ff48518759474a800b949d', 'request_id': 'req-39cb7d88-42b8-485b-9d2e-2bac72abac5d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:20:53.729324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-39cb7d88-42b8-485b-9d2e-2bac72abac5d admin admin] The token cache is being invalidate because project fe39edf907ff48518759474a800b949d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:20:53.729621 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-39cb7d88-42b8-485b-9d2e-2bac72abac5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:20:53.730343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-39cb7d88-42b8-485b-9d2e-2bac72abac5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:20:53.731980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1208/2402] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:20:53 2022] DELETE /identity/v3/projects/fe39edf907ff48518759474a800b949d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:20:53.737734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e107c31-fed4-4ce9-b783-dd9e9e8191fc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:53.738501 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e107c31-fed4-4ce9-b783-dd9e9e8191fc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:53.738501 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e107c31-fed4-4ce9-b783-dd9e9e8191fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:53.763254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8e107c31-fed4-4ce9-b783-dd9e9e8191fc None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:20:53.764598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8e107c31-fed4-4ce9-b783-dd9e9e8191fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:53.803049 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:53.845820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1195/2403] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:20:53.854123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e46f2-dc06-4952-bb5f-b837558c9b48 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:53.854444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e46f2-dc06-4952-bb5f-b837558c9b48 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:53.854851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e46f2-dc06-4952-bb5f-b837558c9b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:53.864151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:53.881554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c83e46f2-dc06-4952-bb5f-b837558c9b48 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:20:53.883545 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c83e46f2-dc06-4952-bb5f-b837558c9b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:53.904958 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1209/2404] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:20:53.910347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e107c31-fed4-4ce9-b783-dd9e9e8191fc None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:53.921031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e107c31-fed4-4ce9-b783-dd9e9e8191fc None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:53.928831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d3626-53be-4fba-84f5-1ca31cd39984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:53.929983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d3626-53be-4fba-84f5-1ca31cd39984 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:53.930465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d3626-53be-4fba-84f5-1ca31cd39984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:53.931141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d3626-53be-4fba-84f5-1ca31cd39984 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:53.932496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d3626-53be-4fba-84f5-1ca31cd39984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:20:53.933059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d3626-53be-4fba-84f5-1ca31cd39984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:53.936275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d3626-53be-4fba-84f5-1ca31cd39984 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:53.963829 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1196/2405] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:20:53.965586 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e46f2-dc06-4952-bb5f-b837558c9b48 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:53.983671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e46f2-dc06-4952-bb5f-b837558c9b48 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:53.988812 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa280f38-4340-433c-b97f-bb2d012e8df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:53.989968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa280f38-4340-433c-b97f-bb2d012e8df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:53.989968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa280f38-4340-433c-b97f-bb2d012e8df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:53.990137 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa280f38-4340-433c-b97f-bb2d012e8df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:53.990849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa280f38-4340-433c-b97f-bb2d012e8df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:53.992930 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa280f38-4340-433c-b97f-bb2d012e8df3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:54.041406 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1210/2406] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:20:53 2022] POST /identity/v3/projects => generated 363 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:20:54.048203 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d3626-53be-4fba-84f5-1ca31cd39984 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:54.076887 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d3626-53be-4fba-84f5-1ca31cd39984 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:54.192938 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeffdc-d9b7-4755-bc85-1bdb01c6a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:54.193866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeffdc-d9b7-4755-bc85-1bdb01c6a8ed admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:54.194256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeffdc-d9b7-4755-bc85-1bdb01c6a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:54.194632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeffdc-d9b7-4755-bc85-1bdb01c6a8ed admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:54.195438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeffdc-d9b7-4755-bc85-1bdb01c6a8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:54.197633 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeffdc-d9b7-4755-bc85-1bdb01c6a8ed admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:54.242551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1197/2407] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:20:54 2022] POST /identity/v3/users => generated 282 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:20:54.243710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa280f38-4340-433c-b97f-bb2d012e8df3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:54.255814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa280f38-4340-433c-b97f-bb2d012e8df3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:54.263877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2ea5-a2de-4e04-bf28-7e4e53ea09c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:54.264733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2ea5-a2de-4e04-bf28-7e4e53ea09c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:54.265272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2ea5-a2de-4e04-bf28-7e4e53ea09c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:54.265652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2ea5-a2de-4e04-bf28-7e4e53ea09c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:54.266919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c2ea5-a2de-4e04-bf28-7e4e53ea09c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:54.268834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c2ea5-a2de-4e04-bf28-7e4e53ea09c7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:54.287315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1211/2408] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:20:54.291913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeffdc-d9b7-4755-bc85-1bdb01c6a8ed admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:54.311320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeffdc-d9b7-4755-bc85-1bdb01c6a8ed admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:54.321808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d332b-8b7b-4833-a2ff-065dbf0a075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:54.322966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d332b-8b7b-4833-a2ff-065dbf0a075d admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:54.323465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d332b-8b7b-4833-a2ff-065dbf0a075d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:54.324099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d332b-8b7b-4833-a2ff-065dbf0a075d admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:54.325338 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d332b-8b7b-4833-a2ff-065dbf0a075d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:54.328981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d332b-8b7b-4833-a2ff-065dbf0a075d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:54.511633 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1198/2409] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:20:54.518001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2ea5-a2de-4e04-bf28-7e4e53ea09c7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:54.533071 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2ea5-a2de-4e04-bf28-7e4e53ea09c7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:54.539052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c32617-d98e-478c-b32e-1ab35f01d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:54.540195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32617-d98e-478c-b32e-1ab35f01d75d admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:54.540692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32617-d98e-478c-b32e-1ab35f01d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:54.541160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c32617-d98e-478c-b32e-1ab35f01d75d admin admin] PATH_INFO: `/v3/projects/bf39b8c906284a7babef954d66ab7d98/users/2af8b6733bc144419cce9878a1ad2cb6/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:54.561433 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c32617-d98e-478c-b32e-1ab35f01d75d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf39b8c906284a7babef954d66ab7d98, user_id=2af8b6733bc144419cce9878a1ad2cb6, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:54.565140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c32617-d98e-478c-b32e-1ab35f01d75d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:54.587167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1212/2410] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:20:54 2022] PUT /identity/v3/projects/bf39b8c906284a7babef954d66ab7d98/users/2af8b6733bc144419cce9878a1ad2cb6/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:20:54.601016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9df520-d8cb-45e9-a853-b506d949daa6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:54.601404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9df520-d8cb-45e9-a853-b506d949daa6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:54.601777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9df520-d8cb-45e9-a853-b506d949daa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:54.633584 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-8f9df520-d8cb-45e9-a853-b506d949daa6 None None] MFA Rules not processed for user `2af8b6733bc144419cce9878a1ad2cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:20:54.634923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-8f9df520-d8cb-45e9-a853-b506d949daa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:54.714455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1199/2411] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:20:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:20:54.719777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c32617-d98e-478c-b32e-1ab35f01d75d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:54.797867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c32617-d98e-478c-b32e-1ab35f01d75d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:54.803315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615384d-b68b-45ab-80ea-32f59a9c374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:54.804000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615384d-b68b-45ab-80ea-32f59a9c374f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:54.804281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615384d-b68b-45ab-80ea-32f59a9c374f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:54.804555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615384d-b68b-45ab-80ea-32f59a9c374f admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:54.805291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615384d-b68b-45ab-80ea-32f59a9c374f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:54.807277 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615384d-b68b-45ab-80ea-32f59a9c374f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:54.841357 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1213/2412] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:20:54 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:20:54.846467 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9df520-d8cb-45e9-a853-b506d949daa6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:54.859895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9df520-d8cb-45e9-a853-b506d949daa6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:54.896775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:54.937126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402ccb3-e157-4a5c-af3c-198e7e9987b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:54.937779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402ccb3-e157-4a5c-af3c-198e7e9987b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:54.938275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402ccb3-e157-4a5c-af3c-198e7e9987b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:54.938541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402ccb3-e157-4a5c-af3c-198e7e9987b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:54.939261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402ccb3-e157-4a5c-af3c-198e7e9987b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:54.941465 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402ccb3-e157-4a5c-af3c-198e7e9987b8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:54.976953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1200/2413] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:20:54 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:20:54.982761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615384d-b68b-45ab-80ea-32f59a9c374f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:54.996261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615384d-b68b-45ab-80ea-32f59a9c374f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:55.002584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ad86-892b-4ff3-b8a5-b34572d445f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:55.003699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ad86-892b-4ff3-b8a5-b34572d445f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:55.004205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ad86-892b-4ff3-b8a5-b34572d445f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:55.004744 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ad86-892b-4ff3-b8a5-b34572d445f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:55.006230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7ad86-892b-4ff3-b8a5-b34572d445f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:55.009845 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7ad86-892b-4ff3-b8a5-b34572d445f0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:55.030789 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1214/2414] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:20:55.036463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402ccb3-e157-4a5c-af3c-198e7e9987b8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:55.054971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402ccb3-e157-4a5c-af3c-198e7e9987b8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:55.063497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9da42a-7f12-4da0-9ca0-30bd46bfd5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:55.064632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9da42a-7f12-4da0-9ca0-30bd46bfd5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:55.065231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9da42a-7f12-4da0-9ca0-30bd46bfd5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:55.065682 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9da42a-7f12-4da0-9ca0-30bd46bfd5ab admin admin] PATH_INFO: `/v3/projects/e19f4ce8fbc54c178a32a194a1621b3a/users/2cf6032485e2472f974c039777391a03/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:55.094210 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9da42a-7f12-4da0-9ca0-30bd46bfd5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19f4ce8fbc54c178a32a194a1621b3a, user_id=2cf6032485e2472f974c039777391a03, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:55.099489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9da42a-7f12-4da0-9ca0-30bd46bfd5ab admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:55.141603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1201/2415] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:20:55 2022] PUT /identity/v3/projects/e19f4ce8fbc54c178a32a194a1621b3a/users/2cf6032485e2472f974c039777391a03/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:20:55.141837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ad86-892b-4ff3-b8a5-b34572d445f0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:55.151045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ad86-892b-4ff3-b8a5-b34572d445f0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:55.256163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f4a52-7629-4f08-be25-32f074f05363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:55.257854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f4a52-7629-4f08-be25-32f074f05363 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:55.258392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f4a52-7629-4f08-be25-32f074f05363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:55.258858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f4a52-7629-4f08-be25-32f074f05363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:55.260226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f4a52-7629-4f08-be25-32f074f05363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:55.263509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f4a52-7629-4f08-be25-32f074f05363 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:55.287226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1215/2416] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:20:55.293544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9da42a-7f12-4da0-9ca0-30bd46bfd5ab admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:55.312641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9da42a-7f12-4da0-9ca0-30bd46bfd5ab admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:55.321226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca614b13-878c-49cc-b44b-e8a66b40e01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:55.322401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614b13-878c-49cc-b44b-e8a66b40e01b admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:55.323024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614b13-878c-49cc-b44b-e8a66b40e01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:55.323275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614b13-878c-49cc-b44b-e8a66b40e01b admin admin] PATH_INFO: `/v3/projects/e19f4ce8fbc54c178a32a194a1621b3a/users/2cf6032485e2472f974c039777391a03/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:55.325734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca614b13-878c-49cc-b44b-e8a66b40e01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19f4ce8fbc54c178a32a194a1621b3a, user_id=2cf6032485e2472f974c039777391a03, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:55.329108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca614b13-878c-49cc-b44b-e8a66b40e01b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:55.346912 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1202/2417] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:20:55 2022] PUT /identity/v3/projects/e19f4ce8fbc54c178a32a194a1621b3a/users/2cf6032485e2472f974c039777391a03/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:20:55.364792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc571415-cc7c-4ffa-9ac6-ba7d85269f2f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:55.365254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc571415-cc7c-4ffa-9ac6-ba7d85269f2f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:55.365609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc571415-cc7c-4ffa-9ac6-ba7d85269f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:55.389689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:20:55.407101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fc571415-cc7c-4ffa-9ac6-ba7d85269f2f None None] MFA Rules not processed for user `2cf6032485e2472f974c039777391a03`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:20:55.408360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fc571415-cc7c-4ffa-9ac6-ba7d85269f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:55.496388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1216/2418] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:20:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:20:55.510099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca614b13-878c-49cc-b44b-e8a66b40e01b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:55.512171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ca614b13-878c-49cc-b44b-e8a66b40e01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:20:55.602689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca614b13-878c-49cc-b44b-e8a66b40e01b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:55.607273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f7e73-21f8-4e30-85eb-a5ae12f962cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:55.607975 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f7e73-21f8-4e30-85eb-a5ae12f962cc service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:55.608323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f7e73-21f8-4e30-85eb-a5ae12f962cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:55.608691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f7e73-21f8-4e30-85eb-a5ae12f962cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:55.620327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f7e73-21f8-4e30-85eb-a5ae12f962cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:55.622084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f7e73-21f8-4e30-85eb-a5ae12f962cc service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:55.633729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1203/2419] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:20:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:20:55.721444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc571415-cc7c-4ffa-9ac6-ba7d85269f2f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:20:55.733029 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc571415-cc7c-4ffa-9ac6-ba7d85269f2f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:20:55.737377 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc50362-6425-4dd1-81ae-d4ab77411d23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:20:55.738130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc50362-6425-4dd1-81ae-d4ab77411d23 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:20:55.738491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc50362-6425-4dd1-81ae-d4ab77411d23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:20:55.738861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc50362-6425-4dd1-81ae-d4ab77411d23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:20:55.809061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc50362-6425-4dd1-81ae-d4ab77411d23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:20:55.810538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc50362-6425-4dd1-81ae-d4ab77411d23 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:20:55.821169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1217/2420] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:20:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:21:05.628440 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=57,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:05.816275 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=58 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:07.283512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f7e73-21f8-4e30-85eb-a5ae12f962cc service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:07.356345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f7e73-21f8-4e30-85eb-a5ae12f962cc service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:07.361154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:07.361823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:07.362098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:07.362372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] PATH_INFO: `/v3/users/2af8b6733bc144419cce9878a1ad2cb6` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:07.363585 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af8b6733bc144419cce9878a1ad2cb6)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:07.365640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:07.422577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af8b6733bc144419cce9878a1ad2cb6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:07.430709 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af8b6733bc144419cce9878a1ad2cb6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:07.440935 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af8b6733bc144419cce9878a1ad2cb6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:07.441800 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af8b6733bc144419cce9878a1ad2cb6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:07.456929 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af8b6733bc144419cce9878a1ad2cb6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:07.463898 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1204/2421] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:21:07 2022] DELETE /identity/v3/users/2af8b6733bc144419cce9878a1ad2cb6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:21:07.474557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733012-d9ac-4437-adf2-cdc82f73cd92 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:07.475456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733012-d9ac-4437-adf2-cdc82f73cd92 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:07.475456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733012-d9ac-4437-adf2-cdc82f73cd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:07.496876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3f733012-d9ac-4437-adf2-cdc82f73cd92 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:21:07.498173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3f733012-d9ac-4437-adf2-cdc82f73cd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:07.569314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1218/2422] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:21:07.580617 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:07.582167 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:07.658757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83627585-0421-4520-ad71-2262710b7b4e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:07.664853 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594201e2-caaf-4195-b44b-86c9a6e31207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:07.665936 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594201e2-caaf-4195-b44b-86c9a6e31207 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:07.666486 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594201e2-caaf-4195-b44b-86c9a6e31207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:07.666951 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594201e2-caaf-4195-b44b-86c9a6e31207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:07.684637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594201e2-caaf-4195-b44b-86c9a6e31207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:07.686985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594201e2-caaf-4195-b44b-86c9a6e31207 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:07.703955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1205/2423] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:21:08.651791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f733012-d9ac-4437-adf2-cdc82f73cd92 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:08.655517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3f733012-d9ac-4437-adf2-cdc82f73cd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:08.678293 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f733012-d9ac-4437-adf2-cdc82f73cd92 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:08.687358 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:08.688455 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:08.689189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:08.690112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] PATH_INFO: `/v3/projects/bf39b8c906284a7babef954d66ab7d98` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:08.694411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf39b8c906284a7babef954d66ab7d98)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:08.699037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:08.805747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf39b8c906284a7babef954d66ab7d98', 'request_id': 'req-242940b4-1d80-4cc8-bde0-410db6fdc779'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:08.821310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf39b8c906284a7babef954d66ab7d98', 'request_id': 'req-242940b4-1d80-4cc8-bde0-410db6fdc779'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:08.834898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf39b8c906284a7babef954d66ab7d98', 'request_id': 'req-242940b4-1d80-4cc8-bde0-410db6fdc779'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:08.852753 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] The token cache is being invalidate because project bf39b8c906284a7babef954d66ab7d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:21:08.853125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:08.853834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:08.855526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1219/2424] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:21:08 2022] DELETE /identity/v3/projects/bf39b8c906284a7babef954d66ab7d98 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:21:08.863042 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594201e2-caaf-4195-b44b-86c9a6e31207 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:08.881624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594201e2-caaf-4195-b44b-86c9a6e31207 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:08.920007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:08.982888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195c32d-cee3-4bc1-9c42-f74999e7780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:08.983752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195c32d-cee3-4bc1-9c42-f74999e7780e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:08.984142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195c32d-cee3-4bc1-9c42-f74999e7780e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:08.984511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195c32d-cee3-4bc1-9c42-f74999e7780e admin admin] PATH_INFO: `/v3/users/2cf6032485e2472f974c039777391a03` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:08.986085 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195c32d-cee3-4bc1-9c42-f74999e7780e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf6032485e2472f974c039777391a03)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:08.988421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195c32d-cee3-4bc1-9c42-f74999e7780e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:09.082846 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0195c32d-cee3-4bc1-9c42-f74999e7780e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf6032485e2472f974c039777391a03'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:09.091990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0195c32d-cee3-4bc1-9c42-f74999e7780e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf6032485e2472f974c039777391a03'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:09.102554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0195c32d-cee3-4bc1-9c42-f74999e7780e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf6032485e2472f974c039777391a03'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:09.103590 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0195c32d-cee3-4bc1-9c42-f74999e7780e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf6032485e2472f974c039777391a03'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:09.129473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-0195c32d-cee3-4bc1-9c42-f74999e7780e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf6032485e2472f974c039777391a03'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:09.141726 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1206/2425] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:21:08 2022] DELETE /identity/v3/users/2cf6032485e2472f974c039777391a03 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:21:09.908562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:09.910734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:09.931964 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242940b4-1d80-4cc8-bde0-410db6fdc779 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:10.057858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6575724-ff9c-458a-80f5-9cc2a46e359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:10.058639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575724-ff9c-458a-80f5-9cc2a46e359c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:10.059086 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575724-ff9c-458a-80f5-9cc2a46e359c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:10.059567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575724-ff9c-458a-80f5-9cc2a46e359c admin admin] PATH_INFO: `/v3/projects/e19f4ce8fbc54c178a32a194a1621b3a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:10.061514 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6575724-ff9c-458a-80f5-9cc2a46e359c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19f4ce8fbc54c178a32a194a1621b3a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:10.064483 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6575724-ff9c-458a-80f5-9cc2a46e359c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:10.133017 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:10.173785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6575724-ff9c-458a-80f5-9cc2a46e359c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19f4ce8fbc54c178a32a194a1621b3a', 'request_id': 'req-f6575724-ff9c-458a-80f5-9cc2a46e359c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:10.187262 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6575724-ff9c-458a-80f5-9cc2a46e359c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19f4ce8fbc54c178a32a194a1621b3a', 'request_id': 'req-f6575724-ff9c-458a-80f5-9cc2a46e359c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:10.196139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6575724-ff9c-458a-80f5-9cc2a46e359c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19f4ce8fbc54c178a32a194a1621b3a', 'request_id': 'req-f6575724-ff9c-458a-80f5-9cc2a46e359c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:10.215394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6575724-ff9c-458a-80f5-9cc2a46e359c admin admin] The token cache is being invalidate because project e19f4ce8fbc54c178a32a194a1621b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:21:10.216019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6575724-ff9c-458a-80f5-9cc2a46e359c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:10.217550 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6575724-ff9c-458a-80f5-9cc2a46e359c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:10.220969 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1220/2426] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:21:09 2022] DELETE /identity/v3/projects/e19f4ce8fbc54c178a32a194a1621b3a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:21:10.233891 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59cd6f-9ad4-4f14-850b-aa48660be395 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:10.234812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59cd6f-9ad4-4f14-850b-aa48660be395 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:10.234812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59cd6f-9ad4-4f14-850b-aa48660be395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:10.263984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-dd59cd6f-9ad4-4f14-850b-aa48660be395 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:21:10.265983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-dd59cd6f-9ad4-4f14-850b-aa48660be395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:10.391945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1207/2427] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:21:10.400437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a826a1-b373-4d62-80f8-2b3be80f4345 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:10.400875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a826a1-b373-4d62-80f8-2b3be80f4345 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:10.401315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a826a1-b373-4d62-80f8-2b3be80f4345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:10.436150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-29a826a1-b373-4d62-80f8-2b3be80f4345 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:21:10.437949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-29a826a1-b373-4d62-80f8-2b3be80f4345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:10.447381 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1221/2428] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:21:10.452045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59cd6f-9ad4-4f14-850b-aa48660be395 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:10.469561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59cd6f-9ad4-4f14-850b-aa48660be395 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:10.476566 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db9844-cb76-44ad-94b9-155c101eeaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:10.478641 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db9844-cb76-44ad-94b9-155c101eeaaa admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:10.479230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db9844-cb76-44ad-94b9-155c101eeaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:10.480933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db9844-cb76-44ad-94b9-155c101eeaaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:10.482257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db9844-cb76-44ad-94b9-155c101eeaaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:21:10.482836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db9844-cb76-44ad-94b9-155c101eeaaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:10.484813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db9844-cb76-44ad-94b9-155c101eeaaa admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:10.506612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1208/2429] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:21:10.512189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a826a1-b373-4d62-80f8-2b3be80f4345 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:10.533362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a826a1-b373-4d62-80f8-2b3be80f4345 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:10.539841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba190e7a-a02b-4ec2-b16d-9e690b11e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:10.541789 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba190e7a-a02b-4ec2-b16d-9e690b11e683 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:10.542354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba190e7a-a02b-4ec2-b16d-9e690b11e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:10.542734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba190e7a-a02b-4ec2-b16d-9e690b11e683 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:10.543621 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba190e7a-a02b-4ec2-b16d-9e690b11e683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:10.547048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba190e7a-a02b-4ec2-b16d-9e690b11e683 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:10.599713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1222/2430] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:21:10 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:21:10.601753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db9844-cb76-44ad-94b9-155c101eeaaa admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:10.614198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db9844-cb76-44ad-94b9-155c101eeaaa admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:10.656763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:10.705429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef7b98-0042-4e61-8442-e86f90ed7ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:10.706308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef7b98-0042-4e61-8442-e86f90ed7ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:10.706695 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef7b98-0042-4e61-8442-e86f90ed7ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:10.707195 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef7b98-0042-4e61-8442-e86f90ed7ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:10.708791 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef7b98-0042-4e61-8442-e86f90ed7ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:10.711127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef7b98-0042-4e61-8442-e86f90ed7ec1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:10.754050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1209/2431] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:21:10 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:21:10.754897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba190e7a-a02b-4ec2-b16d-9e690b11e683 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:10.779442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba190e7a-a02b-4ec2-b16d-9e690b11e683 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:10.797523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89affc-ca99-4181-a13d-87c788727d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:10.800564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89affc-ca99-4181-a13d-87c788727d9c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:10.801450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89affc-ca99-4181-a13d-87c788727d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:10.803194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89affc-ca99-4181-a13d-87c788727d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:10.806295 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89affc-ca99-4181-a13d-87c788727d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:10.811448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89affc-ca99-4181-a13d-87c788727d9c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:10.834526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1223/2432] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:21:10.836885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef7b98-0042-4e61-8442-e86f90ed7ec1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:10.853477 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef7b98-0042-4e61-8442-e86f90ed7ec1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:10.861385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5e675-2cb5-4ca0-9cfc-d51893ba391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:10.862444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5e675-2cb5-4ca0-9cfc-d51893ba391d admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:10.862917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5e675-2cb5-4ca0-9cfc-d51893ba391d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:10.863379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5e675-2cb5-4ca0-9cfc-d51893ba391d admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:10.864644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5e675-2cb5-4ca0-9cfc-d51893ba391d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:10.867884 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5e675-2cb5-4ca0-9cfc-d51893ba391d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:10.900827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89affc-ca99-4181-a13d-87c788727d9c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:10.910281 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1210/2433] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:21:10.920027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89affc-ca99-4181-a13d-87c788727d9c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:10.931109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca0237-ec09-47af-9aaf-a8b2179e1738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:10.933467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca0237-ec09-47af-9aaf-a8b2179e1738 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:10.933981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca0237-ec09-47af-9aaf-a8b2179e1738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:10.934427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca0237-ec09-47af-9aaf-a8b2179e1738 admin admin] PATH_INFO: `/v3/projects/b1a4f74e603c42b49d3a3502b4d629ff/users/57554a34394744d6b4e8ba61a6612fb0/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:10.964303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca0237-ec09-47af-9aaf-a8b2179e1738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a4f74e603c42b49d3a3502b4d629ff, user_id=57554a34394744d6b4e8ba61a6612fb0, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:10.970305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca0237-ec09-47af-9aaf-a8b2179e1738 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:11.002710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1224/2434] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:21:10 2022] PUT /identity/v3/projects/b1a4f74e603c42b49d3a3502b4d629ff/users/57554a34394744d6b4e8ba61a6612fb0/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:21:11.024254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aff4be-66eb-4aa0-88b1-4d22b9fef74d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:11.024777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aff4be-66eb-4aa0-88b1-4d22b9fef74d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:11.025222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aff4be-66eb-4aa0-88b1-4d22b9fef74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:11.076253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-19aff4be-66eb-4aa0-88b1-4d22b9fef74d None None] MFA Rules not processed for user `57554a34394744d6b4e8ba61a6612fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:21:11.078105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-19aff4be-66eb-4aa0-88b1-4d22b9fef74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:11.196614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1211/2435] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:21:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:21:11.216713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca0237-ec09-47af-9aaf-a8b2179e1738 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:11.219507 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-94ca0237-ec09-47af-9aaf-a8b2179e1738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:11.379687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca0237-ec09-47af-9aaf-a8b2179e1738 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:11.389764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7533e79-bb58-41fe-b345-503628cfa967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:11.392225 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7533e79-bb58-41fe-b345-503628cfa967 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:11.393032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7533e79-bb58-41fe-b345-503628cfa967 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:11.393805 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7533e79-bb58-41fe-b345-503628cfa967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:11.415547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7533e79-bb58-41fe-b345-503628cfa967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:11.419153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7533e79-bb58-41fe-b345-503628cfa967 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:11.441931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1225/2436] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:21:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:21:11.478953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aff4be-66eb-4aa0-88b1-4d22b9fef74d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:11.594625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aff4be-66eb-4aa0-88b1-4d22b9fef74d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:11.601903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:11.604329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:11.604972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:11.606119 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] PATH_INFO: `/v3/users/57554a34394744d6b4e8ba61a6612fb0` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:11.608780 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57554a34394744d6b4e8ba61a6612fb0)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:11.615280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:11.710400 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:11.724446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57554a34394744d6b4e8ba61a6612fb0'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:11.761723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57554a34394744d6b4e8ba61a6612fb0'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:11.788008 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57554a34394744d6b4e8ba61a6612fb0'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:11.790469 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57554a34394744d6b4e8ba61a6612fb0'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:11.838236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57554a34394744d6b4e8ba61a6612fb0'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:11.864847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1212/2437] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:21:11 2022] DELETE /identity/v3/users/57554a34394744d6b4e8ba61a6612fb0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:21:11.871165 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70781d-6f3b-4a24-ade2-5e907ec68d7b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:11.871437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70781d-6f3b-4a24-ade2-5e907ec68d7b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:11.871720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70781d-6f3b-4a24-ade2-5e907ec68d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:11.908720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9e70781d-6f3b-4a24-ade2-5e907ec68d7b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:21:11.910056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9e70781d-6f3b-4a24-ade2-5e907ec68d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:11.984052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:12.006075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1226/2438] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:21:12.022588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:12.024710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:12.115318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83696f80-e56c-48b4-b1b8-7f519bcad3b9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:12.121817 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e3b04-b456-402b-863b-72b247cce861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:12.121817 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e3b04-b456-402b-863b-72b247cce861 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:12.122464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e3b04-b456-402b-863b-72b247cce861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:12.122464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e3b04-b456-402b-863b-72b247cce861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:12.147734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e3b04-b456-402b-863b-72b247cce861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:12.149842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e3b04-b456-402b-863b-72b247cce861 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:12.168684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1213/2439] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:21:12.825319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70781d-6f3b-4a24-ade2-5e907ec68d7b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:12.827849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9e70781d-6f3b-4a24-ade2-5e907ec68d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:12.851880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70781d-6f3b-4a24-ade2-5e907ec68d7b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:12.860845 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185da2ac-132e-46dd-86e9-4f9902d8e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:12.862221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185da2ac-132e-46dd-86e9-4f9902d8e1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:12.863313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185da2ac-132e-46dd-86e9-4f9902d8e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:12.863603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185da2ac-132e-46dd-86e9-4f9902d8e1a0 admin admin] PATH_INFO: `/v3/projects/b1a4f74e603c42b49d3a3502b4d629ff` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:12.866750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185da2ac-132e-46dd-86e9-4f9902d8e1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a4f74e603c42b49d3a3502b4d629ff)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:12.870656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185da2ac-132e-46dd-86e9-4f9902d8e1a0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:12.959322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-185da2ac-132e-46dd-86e9-4f9902d8e1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a4f74e603c42b49d3a3502b4d629ff', 'request_id': 'req-185da2ac-132e-46dd-86e9-4f9902d8e1a0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:12.973460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-185da2ac-132e-46dd-86e9-4f9902d8e1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a4f74e603c42b49d3a3502b4d629ff', 'request_id': 'req-185da2ac-132e-46dd-86e9-4f9902d8e1a0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:12.982221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-185da2ac-132e-46dd-86e9-4f9902d8e1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a4f74e603c42b49d3a3502b4d629ff', 'request_id': 'req-185da2ac-132e-46dd-86e9-4f9902d8e1a0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:12.998050 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-185da2ac-132e-46dd-86e9-4f9902d8e1a0 admin admin] The token cache is being invalidate because project b1a4f74e603c42b49d3a3502b4d629ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:21:12.999172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-185da2ac-132e-46dd-86e9-4f9902d8e1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:12.999355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-185da2ac-132e-46dd-86e9-4f9902d8e1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:21:13.001642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1227/2440] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:21:12 2022] DELETE /identity/v3/projects/b1a4f74e603c42b49d3a3502b4d629ff => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:21:13.007083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb62f8-e582-425d-a8f8-652509885a33 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:13.007964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb62f8-e582-425d-a8f8-652509885a33 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:13.009451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb62f8-e582-425d-a8f8-652509885a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:13.047323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d0cb62f8-e582-425d-a8f8-652509885a33 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:21:13.049849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d0cb62f8-e582-425d-a8f8-652509885a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:13.169989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1214/2441] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:21:13.179770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7d359-8ce9-42e5-870a-3f3d4806d6b8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:13.180478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7d359-8ce9-42e5-870a-3f3d4806d6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:13.181133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7d359-8ce9-42e5-870a-3f3d4806d6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:13.213582 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a0b7d359-8ce9-42e5-870a-3f3d4806d6b8 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:21:13.214873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a0b7d359-8ce9-42e5-870a-3f3d4806d6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:13.225120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1228/2442] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:21:13.230295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb62f8-e582-425d-a8f8-652509885a33 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:13.241860 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb62f8-e582-425d-a8f8-652509885a33 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:13.246811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e9e27-5982-4134-b695-caa0b5251ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:13.247468 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e9e27-5982-4134-b695-caa0b5251ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:13.247747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e9e27-5982-4134-b695-caa0b5251ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:13.248019 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e9e27-5982-4134-b695-caa0b5251ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:13.248798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e9e27-5982-4134-b695-caa0b5251ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:21:13.249163 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e9e27-5982-4134-b695-caa0b5251ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:13.250868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e9e27-5982-4134-b695-caa0b5251ac3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:13.278323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1215/2443] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:21:13.279863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7d359-8ce9-42e5-870a-3f3d4806d6b8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:13.295922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7d359-8ce9-42e5-870a-3f3d4806d6b8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:13.306216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3664fc-0817-4b1c-87ab-dbbac2ff6507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:13.307390 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3664fc-0817-4b1c-87ab-dbbac2ff6507 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:13.307708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3664fc-0817-4b1c-87ab-dbbac2ff6507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:13.307999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3664fc-0817-4b1c-87ab-dbbac2ff6507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:13.309393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3664fc-0817-4b1c-87ab-dbbac2ff6507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:13.314836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3664fc-0817-4b1c-87ab-dbbac2ff6507 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:13.355450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1229/2444] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:21:13 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:21:13.359786 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e9e27-5982-4134-b695-caa0b5251ac3 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:13.373821 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e9e27-5982-4134-b695-caa0b5251ac3 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:13.454185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:13.481517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0c663-9447-4c23-bfc3-2111f08cd5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:13.482655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0c663-9447-4c23-bfc3-2111f08cd5be admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:13.483466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0c663-9447-4c23-bfc3-2111f08cd5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:13.484015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0c663-9447-4c23-bfc3-2111f08cd5be admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:13.485427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0c663-9447-4c23-bfc3-2111f08cd5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:13.488958 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0c663-9447-4c23-bfc3-2111f08cd5be admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:13.529034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1216/2445] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:21:13 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:21:13.531447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3664fc-0817-4b1c-87ab-dbbac2ff6507 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:13.546740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3664fc-0817-4b1c-87ab-dbbac2ff6507 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:13.554925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbba9b-ba56-4d95-a0af-8ab9d434ed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:13.555814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbba9b-ba56-4d95-a0af-8ab9d434ed6c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:13.556415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbba9b-ba56-4d95-a0af-8ab9d434ed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:13.557003 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbba9b-ba56-4d95-a0af-8ab9d434ed6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:13.558807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fbba9b-ba56-4d95-a0af-8ab9d434ed6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:13.563162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fbba9b-ba56-4d95-a0af-8ab9d434ed6c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:13.581552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1230/2446] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:21:13.588799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0c663-9447-4c23-bfc3-2111f08cd5be admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:13.610509 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0c663-9447-4c23-bfc3-2111f08cd5be admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:13.619105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63c7ce-30dc-49f4-8417-615bb1dd51cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:13.619789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63c7ce-30dc-49f4-8417-615bb1dd51cd admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:13.620067 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63c7ce-30dc-49f4-8417-615bb1dd51cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:13.621262 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63c7ce-30dc-49f4-8417-615bb1dd51cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:13.622026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63c7ce-30dc-49f4-8417-615bb1dd51cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:13.623793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63c7ce-30dc-49f4-8417-615bb1dd51cd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:13.637281 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1217/2447] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:21:13.644052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbba9b-ba56-4d95-a0af-8ab9d434ed6c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:13.656346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbba9b-ba56-4d95-a0af-8ab9d434ed6c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:13.661721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d722cb6-859c-4773-a853-d0b63d8929e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:13.662589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d722cb6-859c-4773-a853-d0b63d8929e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:13.662872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d722cb6-859c-4773-a853-d0b63d8929e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:13.663150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d722cb6-859c-4773-a853-d0b63d8929e0 admin admin] PATH_INFO: `/v3/projects/af97b401094c4317b62595ea76cdd6ec/users/e61cfea5a8c44105bbb2906fff46df7b/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:13.686296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d722cb6-859c-4773-a853-d0b63d8929e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af97b401094c4317b62595ea76cdd6ec, user_id=e61cfea5a8c44105bbb2906fff46df7b, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:13.689466 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d722cb6-859c-4773-a853-d0b63d8929e0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:13.715172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1231/2448] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:21:13 2022] PUT /identity/v3/projects/af97b401094c4317b62595ea76cdd6ec/users/e61cfea5a8c44105bbb2906fff46df7b/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:21:13.717582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960b9f-96e8-4054-a10b-c4df7e72532f None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:13.718041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960b9f-96e8-4054-a10b-c4df7e72532f None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:13.718452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960b9f-96e8-4054-a10b-c4df7e72532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:13.741531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f0960b9f-96e8-4054-a10b-c4df7e72532f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:21:13.742902 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f0960b9f-96e8-4054-a10b-c4df7e72532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:13.819241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1218/2449] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:21:13.832421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d722cb6-859c-4773-a853-d0b63d8929e0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:13.834516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0d722cb6-859c-4773-a853-d0b63d8929e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:13.912633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d722cb6-859c-4773-a853-d0b63d8929e0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:13.917380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0c51c-a3d4-4576-b3d9-706c9a867bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:13.918149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0c51c-a3d4-4576-b3d9-706c9a867bea service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:13.918415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0c51c-a3d4-4576-b3d9-706c9a867bea service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:13.918820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0c51c-a3d4-4576-b3d9-706c9a867bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:13.930546 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0c51c-a3d4-4576-b3d9-706c9a867bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:13.932056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0c51c-a3d4-4576-b3d9-706c9a867bea service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:13.943687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1232/2450] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:21:15.333387 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee9450-0958-4c8b-95a1-9a013b94c0b0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:15.335266 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee9450-0958-4c8b-95a1-9a013b94c0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:15.335646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee9450-0958-4c8b-95a1-9a013b94c0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:15.384765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-beee9450-0958-4c8b-95a1-9a013b94c0b0 None None] MFA Rules not processed for user `e61cfea5a8c44105bbb2906fff46df7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:21:15.386942 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-beee9450-0958-4c8b-95a1-9a013b94c0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:15.486370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1219/2451] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:21:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:21:15.508250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0c51c-a3d4-4576-b3d9-706c9a867bea service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:21:15.510171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-74c0c51c-a3d4-4576-b3d9-706c9a867bea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:15.539070 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:15.599393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0c51c-a3d4-4576-b3d9-706c9a867bea service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:21:15.604131 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc18e3-53da-4cbc-97ac-70e9eb073eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:21:15.604794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc18e3-53da-4cbc-97ac-70e9eb073eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:15.605139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc18e3-53da-4cbc-97ac-70e9eb073eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:15.605421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc18e3-53da-4cbc-97ac-70e9eb073eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:15.615512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc18e3-53da-4cbc-97ac-70e9eb073eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:21:15.617175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc18e3-53da-4cbc-97ac-70e9eb073eb4 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:21:15.628255 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1233/2452] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:21:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:21:17.203660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a82fa4-8a7f-4774-9219-3e4291133d08 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:17.204543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a82fa4-8a7f-4774-9219-3e4291133d08 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:17.204543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a82fa4-8a7f-4774-9219-3e4291133d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:17.230712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-64a82fa4-8a7f-4774-9219-3e4291133d08 None None] MFA Rules not processed for user `e61cfea5a8c44105bbb2906fff46df7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:21:17.232335 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-64a82fa4-8a7f-4774-9219-3e4291133d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:17.240128 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1220/2453] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:21:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:21:25.624144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=19 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:27.224512 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:36.671109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff018b7-fd51-4a70-87aa-ecf6ad9874e8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:36.671792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff018b7-fd51-4a70-87aa-ecf6ad9874e8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:36.671792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff018b7-fd51-4a70-87aa-ecf6ad9874e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:36.694584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-dff018b7-fd51-4a70-87aa-ecf6ad9874e8 None None] MFA Rules not processed for user `e61cfea5a8c44105bbb2906fff46df7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:21:36.695924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-dff018b7-fd51-4a70-87aa-ecf6ad9874e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:36.704183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1234/2454] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:21:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:21:46.686869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:21:57.268063 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d5080-b40b-4e2e-b3a3-12d4cfc094d4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:21:57.268673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d5080-b40b-4e2e-b3a3-12d4cfc094d4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:21:57.268673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d5080-b40b-4e2e-b3a3-12d4cfc094d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:21:57.312412 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2d7d5080-b40b-4e2e-b3a3-12d4cfc094d4 None None] MFA Rules not processed for user `096d0da1a0bc401c95bfbb8fc150a27b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:21:57.314417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2d7d5080-b40b-4e2e-b3a3-12d4cfc094d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:21:57.422072 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1221/2455] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:21:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:00.289236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28566813-73eb-4eee-9edf-a1a1f75cf0c3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:00.290155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28566813-73eb-4eee-9edf-a1a1f75cf0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:00.290155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28566813-73eb-4eee-9edf-a1a1f75cf0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:00.352325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-28566813-73eb-4eee-9edf-a1a1f75cf0c3 None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:00.353484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-28566813-73eb-4eee-9edf-a1a1f75cf0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:00.557902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1235/2456] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:22:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:00.659649 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d5080-b40b-4e2e-b3a3-12d4cfc094d4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:00.662686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2d7d5080-b40b-4e2e-b3a3-12d4cfc094d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:00.771246 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d5080-b40b-4e2e-b3a3-12d4cfc094d4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:00.776613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9042ae-29c8-40b1-871a-4b3a1712347a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:00.777382 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9042ae-29c8-40b1-871a-4b3a1712347a service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:00.777766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9042ae-29c8-40b1-871a-4b3a1712347a service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:00.778270 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9042ae-29c8-40b1-871a-4b3a1712347a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:00.788254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9042ae-29c8-40b1-871a-4b3a1712347a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:00.789960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9042ae-29c8-40b1-871a-4b3a1712347a service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:00.799588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1222/2457] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:22:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:22:10.544858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=39 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:10.796587 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=72 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:16.728497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d12786-11c1-43f4-b8b0-a15c491b38cd None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:16.729035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d12786-11c1-43f4-b8b0-a15c491b38cd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:16.729187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d12786-11c1-43f4-b8b0-a15c491b38cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:16.748882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-90d12786-11c1-43f4-b8b0-a15c491b38cd None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:16.750242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-90d12786-11c1-43f4-b8b0-a15c491b38cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:16.758141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1236/2458] 10.222.0.27 () {58 vars in 967 bytes} [Fri Aug 5 07:22:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:16.771333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9042ae-29c8-40b1-871a-4b3a1712347a service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:16.783156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9042ae-29c8-40b1-871a-4b3a1712347a service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:16.789500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae112d0-a6db-4ea0-b2ca-b0e875144c95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:16.790133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae112d0-a6db-4ea0-b2ca-b0e875144c95 service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:16.790430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae112d0-a6db-4ea0-b2ca-b0e875144c95 service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:16.790705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae112d0-a6db-4ea0-b2ca-b0e875144c95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:16.800208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae112d0-a6db-4ea0-b2ca-b0e875144c95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:16.801945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae112d0-a6db-4ea0-b2ca-b0e875144c95 service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:16.811336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1223/2459] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:22:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:22:18.989918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20355adc-2f53-4e1f-9a83-76b5e942697a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:18.990520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20355adc-2f53-4e1f-9a83-76b5e942697a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:18.990520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20355adc-2f53-4e1f-9a83-76b5e942697a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:18.992046 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1237/2460] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:22:19.030366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5c48f-3cd3-4a56-8ad5-93c7626cbcfa None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:19.030970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5c48f-3cd3-4a56-8ad5-93c7626cbcfa None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:19.031088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5c48f-3cd3-4a56-8ad5-93c7626cbcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:19.072741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20355adc-2f53-4e1f-9a83-76b5e942697a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:19.111769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20355adc-2f53-4e1f-9a83-76b5e942697a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:19.114394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e9b5c48f-3cd3-4a56-8ad5-93c7626cbcfa None None] MFA Rules not processed for user `33213d31b1394cdfb5b447f4f4952b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:19.115614 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e9b5c48f-3cd3-4a56-8ad5-93c7626cbcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:19.117109 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:19.117774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:19.118052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:19.118328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] PATH_INFO: `/v3/users/e61cfea5a8c44105bbb2906fff46df7b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:19.119529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61cfea5a8c44105bbb2906fff46df7b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:19.121526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:19.177427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61cfea5a8c44105bbb2906fff46df7b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:19.178327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61cfea5a8c44105bbb2906fff46df7b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:19.187059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61cfea5a8c44105bbb2906fff46df7b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:19.188096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61cfea5a8c44105bbb2906fff46df7b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:19.205176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61cfea5a8c44105bbb2906fff46df7b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:19.214849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1224/2461] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:22:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:19.220302 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1238/2462] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:22:19 2022] DELETE /identity/v3/users/e61cfea5a8c44105bbb2906fff46df7b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:22:19.227040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5c48f-3cd3-4a56-8ad5-93c7626cbcfa None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:19.228605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e9b5c48f-3cd3-4a56-8ad5-93c7626cbcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:19.243082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5c48f-3cd3-4a56-8ad5-93c7626cbcfa None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:19.319527 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee07ce4-8b9b-4749-8c0a-474c386e9c21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:19.320419 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee07ce4-8b9b-4749-8c0a-474c386e9c21 service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:19.320419 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee07ce4-8b9b-4749-8c0a-474c386e9c21 service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:19.320648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee07ce4-8b9b-4749-8c0a-474c386e9c21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:19.329931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee07ce4-8b9b-4749-8c0a-474c386e9c21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:19.331538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee07ce4-8b9b-4749-8c0a-474c386e9c21 service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:19.341572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1225/2463] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:22:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:22:19.421282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:19.422876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:19.509308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdcb1a-cf72-4062-94bb-bc02441b9f47 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:19.515616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9f465-9f09-4a83-8abe-96dbc40254ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:19.516282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9f465-9f09-4a83-8abe-96dbc40254ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:19.516533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9f465-9f09-4a83-8abe-96dbc40254ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:19.516804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9f465-9f09-4a83-8abe-96dbc40254ed admin admin] PATH_INFO: `/v3/projects/af97b401094c4317b62595ea76cdd6ec` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:19.518985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9f465-9f09-4a83-8abe-96dbc40254ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=af97b401094c4317b62595ea76cdd6ec)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:19.521138 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9f465-9f09-4a83-8abe-96dbc40254ed admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:19.571362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:19.579968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5cf9f465-9f09-4a83-8abe-96dbc40254ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af97b401094c4317b62595ea76cdd6ec', 'request_id': 'req-5cf9f465-9f09-4a83-8abe-96dbc40254ed'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:19.589198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5cf9f465-9f09-4a83-8abe-96dbc40254ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af97b401094c4317b62595ea76cdd6ec', 'request_id': 'req-5cf9f465-9f09-4a83-8abe-96dbc40254ed'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:19.595752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5cf9f465-9f09-4a83-8abe-96dbc40254ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af97b401094c4317b62595ea76cdd6ec', 'request_id': 'req-5cf9f465-9f09-4a83-8abe-96dbc40254ed'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:19.608240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5cf9f465-9f09-4a83-8abe-96dbc40254ed admin admin] The token cache is being invalidate because project af97b401094c4317b62595ea76cdd6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:22:19.608624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5cf9f465-9f09-4a83-8abe-96dbc40254ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:19.609362 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5cf9f465-9f09-4a83-8abe-96dbc40254ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:19.611004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1239/2464] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:22:19 2022] DELETE /identity/v3/projects/af97b401094c4317b62595ea76cdd6ec => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:22:19.616070 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867e127-d628-4bfd-aeb9-f02e2b8e30e4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:19.616355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867e127-d628-4bfd-aeb9-f02e2b8e30e4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:19.616629 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867e127-d628-4bfd-aeb9-f02e2b8e30e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:19.670488 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0867e127-d628-4bfd-aeb9-f02e2b8e30e4 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:19.672649 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0867e127-d628-4bfd-aeb9-f02e2b8e30e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:19.680215 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:19.758277 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1226/2465] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:19.769784 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f203d7-5cdc-4ad5-bc48-5aa0ae47a88e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:19.770066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f203d7-5cdc-4ad5-bc48-5aa0ae47a88e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:19.770324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f203d7-5cdc-4ad5-bc48-5aa0ae47a88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:19.791174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-07f203d7-5cdc-4ad5-bc48-5aa0ae47a88e None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:19.792398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-07f203d7-5cdc-4ad5-bc48-5aa0ae47a88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:19.801075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1240/2466] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:19.805576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867e127-d628-4bfd-aeb9-f02e2b8e30e4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:19.815798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867e127-d628-4bfd-aeb9-f02e2b8e30e4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:19.822937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5f912-c5af-4302-99b2-6f4e29f49635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:19.822937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5f912-c5af-4302-99b2-6f4e29f49635 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:19.822937 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5f912-c5af-4302-99b2-6f4e29f49635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:19.823497 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5f912-c5af-4302-99b2-6f4e29f49635 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:19.824189 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5f912-c5af-4302-99b2-6f4e29f49635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:22:19.824628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5f912-c5af-4302-99b2-6f4e29f49635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:19.826364 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5f912-c5af-4302-99b2-6f4e29f49635 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:19.838957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1227/2467] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:22:19.843585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f203d7-5cdc-4ad5-bc48-5aa0ae47a88e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:19.853226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f203d7-5cdc-4ad5-bc48-5aa0ae47a88e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:19.859192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf45c9-6d41-46ad-ad2b-03a1e11736ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:19.859850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf45c9-6d41-46ad-ad2b-03a1e11736ba admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:19.860134 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf45c9-6d41-46ad-ad2b-03a1e11736ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:19.860377 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf45c9-6d41-46ad-ad2b-03a1e11736ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:19.861100 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf45c9-6d41-46ad-ad2b-03a1e11736ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:19.863269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf45c9-6d41-46ad-ad2b-03a1e11736ba admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:19.896757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1241/2468] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:22:19 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:22:19.901576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5f912-c5af-4302-99b2-6f4e29f49635 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:19.912384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5f912-c5af-4302-99b2-6f4e29f49635 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:19.976374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61ff36-7cb8-4723-a3e0-8a8e40a3b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:19.977052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61ff36-7cb8-4723-a3e0-8a8e40a3b1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:19.977326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61ff36-7cb8-4723-a3e0-8a8e40a3b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:19.977602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61ff36-7cb8-4723-a3e0-8a8e40a3b1c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:19.978312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61ff36-7cb8-4723-a3e0-8a8e40a3b1c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:19.980255 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61ff36-7cb8-4723-a3e0-8a8e40a3b1c6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:20.004383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1228/2469] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:22:19 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:22:20.008830 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf45c9-6d41-46ad-ad2b-03a1e11736ba admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:20.021171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf45c9-6d41-46ad-ad2b-03a1e11736ba admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:20.026628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5c104-8342-4c95-8383-df31403e380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:20.027182 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5c104-8342-4c95-8383-df31403e380a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:20.027458 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5c104-8342-4c95-8383-df31403e380a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:20.027740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5c104-8342-4c95-8383-df31403e380a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:20.028454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5c104-8342-4c95-8383-df31403e380a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:20.030311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5c104-8342-4c95-8383-df31403e380a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:20.041569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1242/2470] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:22:20.045970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61ff36-7cb8-4723-a3e0-8a8e40a3b1c6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:20.057863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61ff36-7cb8-4723-a3e0-8a8e40a3b1c6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:20.062935 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0e472-62a9-415f-8130-a66ed2ed4465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:20.063547 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e472-62a9-415f-8130-a66ed2ed4465 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:20.063827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e472-62a9-415f-8130-a66ed2ed4465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:20.064130 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e472-62a9-415f-8130-a66ed2ed4465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:20.064828 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0e472-62a9-415f-8130-a66ed2ed4465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:20.066460 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0e472-62a9-415f-8130-a66ed2ed4465 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:20.078325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1229/2471] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:22:20.083346 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5c104-8342-4c95-8383-df31403e380a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:20.098183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5c104-8342-4c95-8383-df31403e380a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:20.107386 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10aeef-dde7-4be6-a8aa-f5d715291c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:20.108295 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10aeef-dde7-4be6-a8aa-f5d715291c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:20.108571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10aeef-dde7-4be6-a8aa-f5d715291c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:20.108838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10aeef-dde7-4be6-a8aa-f5d715291c77 admin admin] PATH_INFO: `/v3/projects/5e73a6ce6a9d4b05aefcece10738b719/users/48c2775bce374803a4c525a17cbdf858/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:20.124995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10aeef-dde7-4be6-a8aa-f5d715291c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e73a6ce6a9d4b05aefcece10738b719, user_id=48c2775bce374803a4c525a17cbdf858, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:20.127687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10aeef-dde7-4be6-a8aa-f5d715291c77 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:20.142595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1243/2472] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:22:20 2022] PUT /identity/v3/projects/5e73a6ce6a9d4b05aefcece10738b719/users/48c2775bce374803a4c525a17cbdf858/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:22:20.153272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acaee6-7834-44d7-a84e-e3cd293815a6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:20.153557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acaee6-7834-44d7-a84e-e3cd293815a6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:20.153830 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acaee6-7834-44d7-a84e-e3cd293815a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:20.186932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b6acaee6-7834-44d7-a84e-e3cd293815a6 None None] MFA Rules not processed for user `48c2775bce374803a4c525a17cbdf858`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:20.188182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b6acaee6-7834-44d7-a84e-e3cd293815a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:20.259881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1230/2473] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:20.272282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10aeef-dde7-4be6-a8aa-f5d715291c77 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:20.274399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ba10aeef-dde7-4be6-a8aa-f5d715291c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:20.364456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10aeef-dde7-4be6-a8aa-f5d715291c77 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:20.368429 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64c768-aff0-4a22-ab5b-a1cbb5d23f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:20.369105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64c768-aff0-4a22-ab5b-a1cbb5d23f5b service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:20.369388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64c768-aff0-4a22-ab5b-a1cbb5d23f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:20.369666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64c768-aff0-4a22-ab5b-a1cbb5d23f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:20.379901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64c768-aff0-4a22-ab5b-a1cbb5d23f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:20.381548 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64c768-aff0-4a22-ab5b-a1cbb5d23f5b service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:20.393015 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1244/2474] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:22:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:22:20.423681 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acaee6-7834-44d7-a84e-e3cd293815a6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:20.432052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:20.511895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acaee6-7834-44d7-a84e-e3cd293815a6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:20.517660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:20.518333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:20.518611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:20.518885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] PATH_INFO: `/v3/users/48c2775bce374803a4c525a17cbdf858` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:20.520125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c2775bce374803a4c525a17cbdf858)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:20.522178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:20.582366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c2775bce374803a4c525a17cbdf858'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:20.590713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c2775bce374803a4c525a17cbdf858'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:20.600001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c2775bce374803a4c525a17cbdf858'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:20.600708 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c2775bce374803a4c525a17cbdf858'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:20.614904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c2775bce374803a4c525a17cbdf858'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:20.621274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1231/2475] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:22:20 2022] DELETE /identity/v3/users/48c2775bce374803a4c525a17cbdf858 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:22:20.626465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ffbef-5389-4b94-ac6d-7ade8a5523f6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:20.626750 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ffbef-5389-4b94-ac6d-7ade8a5523f6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:20.627001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ffbef-5389-4b94-ac6d-7ade8a5523f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:20.648171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bc4ffbef-5389-4b94-ac6d-7ade8a5523f6 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:20.649519 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bc4ffbef-5389-4b94-ac6d-7ade8a5523f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:20.698700 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:20.718514 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1245/2476] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:20.729491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:20.731218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:20.835625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cab6b-ff13-4c14-b948-d0198b56d5c8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:20.839720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00dd50-4314-43e0-a60c-edc2dba875a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:20.840410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00dd50-4314-43e0-a60c-edc2dba875a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:20.840679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00dd50-4314-43e0-a60c-edc2dba875a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:20.840974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00dd50-4314-43e0-a60c-edc2dba875a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:20.851376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00dd50-4314-43e0-a60c-edc2dba875a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:20.852838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00dd50-4314-43e0-a60c-edc2dba875a6 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:20.864315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1232/2477] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:22:21.179492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ffbef-5389-4b94-ac6d-7ade8a5523f6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:21.181532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bc4ffbef-5389-4b94-ac6d-7ade8a5523f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:21.194912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ffbef-5389-4b94-ac6d-7ade8a5523f6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:21.200063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa8787-db6d-4677-b76f-4dd7c380ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:21.200742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa8787-db6d-4677-b76f-4dd7c380ecf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:21.201048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa8787-db6d-4677-b76f-4dd7c380ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:21.201320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa8787-db6d-4677-b76f-4dd7c380ecf4 admin admin] PATH_INFO: `/v3/projects/5e73a6ce6a9d4b05aefcece10738b719` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:21.202678 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa8787-db6d-4677-b76f-4dd7c380ecf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e73a6ce6a9d4b05aefcece10738b719)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:21.204714 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa8787-db6d-4677-b76f-4dd7c380ecf4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:21.265117 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-77fa8787-db6d-4677-b76f-4dd7c380ecf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e73a6ce6a9d4b05aefcece10738b719', 'request_id': 'req-77fa8787-db6d-4677-b76f-4dd7c380ecf4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:21.275954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-77fa8787-db6d-4677-b76f-4dd7c380ecf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e73a6ce6a9d4b05aefcece10738b719', 'request_id': 'req-77fa8787-db6d-4677-b76f-4dd7c380ecf4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:21.286010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-77fa8787-db6d-4677-b76f-4dd7c380ecf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e73a6ce6a9d4b05aefcece10738b719', 'request_id': 'req-77fa8787-db6d-4677-b76f-4dd7c380ecf4'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:21.299338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-77fa8787-db6d-4677-b76f-4dd7c380ecf4 admin admin] The token cache is being invalidate because project 5e73a6ce6a9d4b05aefcece10738b719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:22:21.299772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-77fa8787-db6d-4677-b76f-4dd7c380ecf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:21.300325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-77fa8787-db6d-4677-b76f-4dd7c380ecf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:21.301962 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1246/2478] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:22:21 2022] DELETE /identity/v3/projects/5e73a6ce6a9d4b05aefcece10738b719 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:22:21.307413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681e22f-fe67-476c-a123-f756ab6b7ba0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:21.308297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681e22f-fe67-476c-a123-f756ab6b7ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:21.308462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681e22f-fe67-476c-a123-f756ab6b7ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:21.324378 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:21.333557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2681e22f-fe67-476c-a123-f756ab6b7ba0 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:21.336225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2681e22f-fe67-476c-a123-f756ab6b7ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:21.413264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1233/2479] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:21.421442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20104f5e-4aca-4c10-a2bf-969983818334 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:21.421633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20104f5e-4aca-4c10-a2bf-969983818334 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:21.421919 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20104f5e-4aca-4c10-a2bf-969983818334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:21.443005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-20104f5e-4aca-4c10-a2bf-969983818334 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:21.444266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-20104f5e-4aca-4c10-a2bf-969983818334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:21.454132 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1247/2480] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:21.458818 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681e22f-fe67-476c-a123-f756ab6b7ba0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:21.469405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681e22f-fe67-476c-a123-f756ab6b7ba0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:21.475466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30282f8-e83a-4fe8-90fb-0c51561db45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:21.476098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30282f8-e83a-4fe8-90fb-0c51561db45e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:21.476401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30282f8-e83a-4fe8-90fb-0c51561db45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:21.476667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30282f8-e83a-4fe8-90fb-0c51561db45e admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:21.477428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30282f8-e83a-4fe8-90fb-0c51561db45e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:22:21.477729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30282f8-e83a-4fe8-90fb-0c51561db45e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:21.479328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30282f8-e83a-4fe8-90fb-0c51561db45e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:21.492777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1234/2481] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:22:21.497656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20104f5e-4aca-4c10-a2bf-969983818334 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:21.507661 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20104f5e-4aca-4c10-a2bf-969983818334 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:21.512731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf5b92-7a04-4619-bc8c-27b8a4844fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:21.513889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf5b92-7a04-4619-bc8c-27b8a4844fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:21.514207 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf5b92-7a04-4619-bc8c-27b8a4844fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:21.514515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf5b92-7a04-4619-bc8c-27b8a4844fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:21.515244 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf5b92-7a04-4619-bc8c-27b8a4844fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:21.517452 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf5b92-7a04-4619-bc8c-27b8a4844fa2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:21.550320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1248/2482] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:22:21 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:22:21.555018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30282f8-e83a-4fe8-90fb-0c51561db45e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:21.566964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30282f8-e83a-4fe8-90fb-0c51561db45e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:21.630191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955eee8-6df4-4c7d-bac7-58d433f16ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:21.630836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955eee8-6df4-4c7d-bac7-58d433f16ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:21.631116 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955eee8-6df4-4c7d-bac7-58d433f16ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:21.631386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955eee8-6df4-4c7d-bac7-58d433f16ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:21.632061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955eee8-6df4-4c7d-bac7-58d433f16ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:21.634315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955eee8-6df4-4c7d-bac7-58d433f16ca1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:21.658431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1235/2483] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:22:21 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:22:21.662918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf5b92-7a04-4619-bc8c-27b8a4844fa2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:21.676442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf5b92-7a04-4619-bc8c-27b8a4844fa2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:21.681469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171e936-fbf7-4a0d-ac2f-74049c2e0b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:21.682087 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e936-fbf7-4a0d-ac2f-74049c2e0b9b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:21.682365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e936-fbf7-4a0d-ac2f-74049c2e0b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:21.682634 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e936-fbf7-4a0d-ac2f-74049c2e0b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:21.683335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171e936-fbf7-4a0d-ac2f-74049c2e0b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:21.685023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171e936-fbf7-4a0d-ac2f-74049c2e0b9b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:21.696420 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1249/2484] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:22:21.700810 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955eee8-6df4-4c7d-bac7-58d433f16ca1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:21.711827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955eee8-6df4-4c7d-bac7-58d433f16ca1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:21.717108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80279c-d9fb-4a32-8ad5-d58d3e9c9f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:21.717740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80279c-d9fb-4a32-8ad5-d58d3e9c9f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:21.718023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80279c-d9fb-4a32-8ad5-d58d3e9c9f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:21.718297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80279c-d9fb-4a32-8ad5-d58d3e9c9f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:21.718994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80279c-d9fb-4a32-8ad5-d58d3e9c9f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:21.720660 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80279c-d9fb-4a32-8ad5-d58d3e9c9f68 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:21.732439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1236/2485] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:22:21.736994 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171e936-fbf7-4a0d-ac2f-74049c2e0b9b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:21.747999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171e936-fbf7-4a0d-ac2f-74049c2e0b9b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:21.754091 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57c15b-0929-4851-94e8-11fbffa0ffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:21.754772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57c15b-0929-4851-94e8-11fbffa0ffb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:21.755049 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57c15b-0929-4851-94e8-11fbffa0ffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:21.755323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57c15b-0929-4851-94e8-11fbffa0ffb8 admin admin] PATH_INFO: `/v3/projects/c51b1f720188421386aafd00a519502a/users/d55c1d3d10f142528b4a803c3fb4e9f3/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:21.772705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57c15b-0929-4851-94e8-11fbffa0ffb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51b1f720188421386aafd00a519502a, user_id=d55c1d3d10f142528b4a803c3fb4e9f3, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:21.775446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57c15b-0929-4851-94e8-11fbffa0ffb8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:21.795949 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1250/2486] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:22:21 2022] PUT /identity/v3/projects/c51b1f720188421386aafd00a519502a/users/d55c1d3d10f142528b4a803c3fb4e9f3/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:22:21.811286 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18e889-c0bf-47c6-a9e5-1858110774b0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:21.811883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18e889-c0bf-47c6-a9e5-1858110774b0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:21.812453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18e889-c0bf-47c6-a9e5-1858110774b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:21.849340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6a18e889-c0bf-47c6-a9e5-1858110774b0 None None] MFA Rules not processed for user `d55c1d3d10f142528b4a803c3fb4e9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:21.850591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6a18e889-c0bf-47c6-a9e5-1858110774b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:21.919040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1237/2487] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:21.932133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57c15b-0929-4851-94e8-11fbffa0ffb8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:21.935479 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1b57c15b-0929-4851-94e8-11fbffa0ffb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:21.999141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57c15b-0929-4851-94e8-11fbffa0ffb8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:22.003774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709e8d4-39fc-44e6-b383-8c66c1011219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:22.004446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709e8d4-39fc-44e6-b383-8c66c1011219 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:22.004726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709e8d4-39fc-44e6-b383-8c66c1011219 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:22.005034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709e8d4-39fc-44e6-b383-8c66c1011219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:22.015563 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709e8d4-39fc-44e6-b383-8c66c1011219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:22.017226 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709e8d4-39fc-44e6-b383-8c66c1011219 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:22.029335 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1251/2488] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:22:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:22:31.915844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:32.023264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:44.716164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18e889-c0bf-47c6-a9e5-1858110774b0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:44.790052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18e889-c0bf-47c6-a9e5-1858110774b0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:44.796178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:44.797045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:44.797327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:44.797625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] PATH_INFO: `/v3/users/d55c1d3d10f142528b4a803c3fb4e9f3` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:44.799171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55c1d3d10f142528b4a803c3fb4e9f3)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:44.801714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:44.857275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55c1d3d10f142528b4a803c3fb4e9f3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:44.865714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55c1d3d10f142528b4a803c3fb4e9f3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:44.874559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55c1d3d10f142528b4a803c3fb4e9f3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:44.875539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55c1d3d10f142528b4a803c3fb4e9f3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:44.890087 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55c1d3d10f142528b4a803c3fb4e9f3'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:44.896972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1238/2489] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:22:44 2022] DELETE /identity/v3/users/d55c1d3d10f142528b4a803c3fb4e9f3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:22:44.902032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc3aef-920f-42f1-abe7-a45ed1f8862d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:44.902602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc3aef-920f-42f1-abe7-a45ed1f8862d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:44.902602 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc3aef-920f-42f1-abe7-a45ed1f8862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:44.926039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bdcc3aef-920f-42f1-abe7-a45ed1f8862d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:44.928030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bdcc3aef-920f-42f1-abe7-a45ed1f8862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:44.995972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1252/2490] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:45.008104 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:45.009624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:45.075756 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18127628-dad3-4aa8-a5fe-f75ee56a856e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:45.079543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba09538-8c9b-4847-af6c-260c6d52f098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:45.080180 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba09538-8c9b-4847-af6c-260c6d52f098 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:45.080472 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba09538-8c9b-4847-af6c-260c6d52f098 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:45.080742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba09538-8c9b-4847-af6c-260c6d52f098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:45.090996 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba09538-8c9b-4847-af6c-260c6d52f098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:45.092467 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba09538-8c9b-4847-af6c-260c6d52f098 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:45.103319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1239/2491] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:22:45.398112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc3aef-920f-42f1-abe7-a45ed1f8862d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:45.399650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bdcc3aef-920f-42f1-abe7-a45ed1f8862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:45.412008 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc3aef-920f-42f1-abe7-a45ed1f8862d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:45.416988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161877a-fbc0-41a9-a3cb-7db6501e92e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:45.417658 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161877a-fbc0-41a9-a3cb-7db6501e92e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:45.417934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161877a-fbc0-41a9-a3cb-7db6501e92e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:45.418208 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161877a-fbc0-41a9-a3cb-7db6501e92e3 admin admin] PATH_INFO: `/v3/projects/c51b1f720188421386aafd00a519502a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:45.419448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161877a-fbc0-41a9-a3cb-7db6501e92e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51b1f720188421386aafd00a519502a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:45.421408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161877a-fbc0-41a9-a3cb-7db6501e92e3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:45.470303 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8161877a-fbc0-41a9-a3cb-7db6501e92e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51b1f720188421386aafd00a519502a', 'request_id': 'req-8161877a-fbc0-41a9-a3cb-7db6501e92e3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:45.479855 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8161877a-fbc0-41a9-a3cb-7db6501e92e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51b1f720188421386aafd00a519502a', 'request_id': 'req-8161877a-fbc0-41a9-a3cb-7db6501e92e3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:45.485898 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8161877a-fbc0-41a9-a3cb-7db6501e92e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51b1f720188421386aafd00a519502a', 'request_id': 'req-8161877a-fbc0-41a9-a3cb-7db6501e92e3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:45.497843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8161877a-fbc0-41a9-a3cb-7db6501e92e3 admin admin] The token cache is being invalidate because project c51b1f720188421386aafd00a519502a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:22:45.498133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8161877a-fbc0-41a9-a3cb-7db6501e92e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:45.498812 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8161877a-fbc0-41a9-a3cb-7db6501e92e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:22:45.500354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1253/2492] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:22:45 2022] DELETE /identity/v3/projects/c51b1f720188421386aafd00a519502a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:22:45.505625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc4f18-e9f8-4e60-a938-96fbec2fa3b7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:45.505845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc4f18-e9f8-4e60-a938-96fbec2fa3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:45.506194 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc4f18-e9f8-4e60-a938-96fbec2fa3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:45.526265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-5cdc4f18-e9f8-4e60-a938-96fbec2fa3b7 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:45.527479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5cdc4f18-e9f8-4e60-a938-96fbec2fa3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:45.546411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:45.591129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1240/2493] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:45.599471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28fc7a-ec21-4657-ab2f-4b8f8c72da6a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:45.599761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28fc7a-ec21-4657-ab2f-4b8f8c72da6a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:45.600130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28fc7a-ec21-4657-ab2f-4b8f8c72da6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:45.621581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2d28fc7a-ec21-4657-ab2f-4b8f8c72da6a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:45.622816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2d28fc7a-ec21-4657-ab2f-4b8f8c72da6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:45.633233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1254/2494] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:45.638239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc4f18-e9f8-4e60-a938-96fbec2fa3b7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:45.648712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc4f18-e9f8-4e60-a938-96fbec2fa3b7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:45.654333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef4c59-17be-4bd8-951c-789d634bc68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:45.654948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef4c59-17be-4bd8-951c-789d634bc68a admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:45.655222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef4c59-17be-4bd8-951c-789d634bc68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:45.655488 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef4c59-17be-4bd8-951c-789d634bc68a admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:45.656183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef4c59-17be-4bd8-951c-789d634bc68a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:22:45.656481 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef4c59-17be-4bd8-951c-789d634bc68a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:45.658088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef4c59-17be-4bd8-951c-789d634bc68a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:45.670671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1241/2495] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:22:45.675603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28fc7a-ec21-4657-ab2f-4b8f8c72da6a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:45.685235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28fc7a-ec21-4657-ab2f-4b8f8c72da6a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:45.690674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf2e05-4732-4c12-aced-62c21b07c984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:45.691474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf2e05-4732-4c12-aced-62c21b07c984 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:45.691764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf2e05-4732-4c12-aced-62c21b07c984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:45.692036 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf2e05-4732-4c12-aced-62c21b07c984 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:45.692740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf2e05-4732-4c12-aced-62c21b07c984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:45.694789 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf2e05-4732-4c12-aced-62c21b07c984 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:45.726351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1255/2496] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:22:45 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:22:45.732038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef4c59-17be-4bd8-951c-789d634bc68a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:45.742857 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef4c59-17be-4bd8-951c-789d634bc68a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:45.804727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0d0d0-c90b-4d5a-8a14-c7a80ddb810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:45.805270 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0d0d0-c90b-4d5a-8a14-c7a80ddb810b admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:45.805550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0d0d0-c90b-4d5a-8a14-c7a80ddb810b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:45.805825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0d0d0-c90b-4d5a-8a14-c7a80ddb810b admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:45.806503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0d0d0-c90b-4d5a-8a14-c7a80ddb810b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:45.808463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0d0d0-c90b-4d5a-8a14-c7a80ddb810b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:45.831559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1242/2497] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:22:45 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:22:45.836031 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf2e05-4732-4c12-aced-62c21b07c984 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:45.848438 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf2e05-4732-4c12-aced-62c21b07c984 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:45.853603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c07b32-74a6-4560-89ea-9c6137e12210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:45.854232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c07b32-74a6-4560-89ea-9c6137e12210 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:45.854537 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c07b32-74a6-4560-89ea-9c6137e12210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:45.854808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c07b32-74a6-4560-89ea-9c6137e12210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:45.855511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c07b32-74a6-4560-89ea-9c6137e12210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:45.857213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c07b32-74a6-4560-89ea-9c6137e12210 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:45.868042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1256/2498] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:22:45.872388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0d0d0-c90b-4d5a-8a14-c7a80ddb810b admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:45.882795 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0d0d0-c90b-4d5a-8a14-c7a80ddb810b admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:45.888059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27b0f3-6b4c-49f5-97ba-f6ced47bd32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:45.888662 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27b0f3-6b4c-49f5-97ba-f6ced47bd32c admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:45.888924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27b0f3-6b4c-49f5-97ba-f6ced47bd32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:45.889231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27b0f3-6b4c-49f5-97ba-f6ced47bd32c admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:45.889922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27b0f3-6b4c-49f5-97ba-f6ced47bd32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:45.891522 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27b0f3-6b4c-49f5-97ba-f6ced47bd32c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:45.903256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1243/2499] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:22:45.907805 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c07b32-74a6-4560-89ea-9c6137e12210 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:45.919482 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c07b32-74a6-4560-89ea-9c6137e12210 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:45.926481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a76b5b-7fab-4dc1-996e-2d7acd301560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:45.927177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a76b5b-7fab-4dc1-996e-2d7acd301560 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:45.927464 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a76b5b-7fab-4dc1-996e-2d7acd301560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:45.927743 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a76b5b-7fab-4dc1-996e-2d7acd301560 admin admin] PATH_INFO: `/v3/projects/1d6a92e28cc44d6b9abe831fb219eea0/users/e383fda8f4ce4ddc841552c751f1a7bf/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:45.946392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a76b5b-7fab-4dc1-996e-2d7acd301560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6a92e28cc44d6b9abe831fb219eea0, user_id=e383fda8f4ce4ddc841552c751f1a7bf, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:45.949184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a76b5b-7fab-4dc1-996e-2d7acd301560 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:45.965722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1257/2500] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:22:45 2022] PUT /identity/v3/projects/1d6a92e28cc44d6b9abe831fb219eea0/users/e383fda8f4ce4ddc841552c751f1a7bf/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:22:45.971060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83a9e8-cb2e-44c2-b1f1-c2ad3b047062 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:45.971350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83a9e8-cb2e-44c2-b1f1-c2ad3b047062 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:45.971605 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83a9e8-cb2e-44c2-b1f1-c2ad3b047062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:45.992390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-4f83a9e8-cb2e-44c2-b1f1-c2ad3b047062 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:45.993667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4f83a9e8-cb2e-44c2-b1f1-c2ad3b047062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:46.070026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1244/2501] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:46.080556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a76b5b-7fab-4dc1-996e-2d7acd301560 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:46.082430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d7a76b5b-7fab-4dc1-996e-2d7acd301560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:46.106599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:46.150247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a76b5b-7fab-4dc1-996e-2d7acd301560 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:46.154411 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7def9-5153-4535-97db-47f38f991788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:46.155094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7def9-5153-4535-97db-47f38f991788 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:46.155374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7def9-5153-4535-97db-47f38f991788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:46.155648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7def9-5153-4535-97db-47f38f991788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:46.166393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7def9-5153-4535-97db-47f38f991788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:46.167852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7def9-5153-4535-97db-47f38f991788 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:46.178832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1258/2502] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:22:50.672964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dc4be-fb62-44a7-bc71-306480a72d55 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:50.673930 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dc4be-fb62-44a7-bc71-306480a72d55 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:50.674564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dc4be-fb62-44a7-bc71-306480a72d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:50.713885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-798dc4be-fb62-44a7-bc71-306480a72d55 None None] MFA Rules not processed for user `e383fda8f4ce4ddc841552c751f1a7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:50.715121 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-798dc4be-fb62-44a7-bc71-306480a72d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:50.736287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:50.799338 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1245/2503] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:50.805355 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7def9-5153-4535-97db-47f38f991788 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:50.816239 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7def9-5153-4535-97db-47f38f991788 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:50.821909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b354-a884-4ef5-a909-03f8ce2784dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:50.822556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b354-a884-4ef5-a909-03f8ce2784dd admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:50.822829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b354-a884-4ef5-a909-03f8ce2784dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:50.823101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b354-a884-4ef5-a909-03f8ce2784dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:50.823876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838b354-a884-4ef5-a909-03f8ce2784dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:50.826032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838b354-a884-4ef5-a909-03f8ce2784dd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:50.861086 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1259/2504] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:22:50 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:22:50.865547 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dc4be-fb62-44a7-bc71-306480a72d55 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:50.877606 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dc4be-fb62-44a7-bc71-306480a72d55 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:50.961393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76568e-14d9-4aa3-8055-c7637ba96bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:50.962313 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76568e-14d9-4aa3-8055-c7637ba96bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:50.962701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76568e-14d9-4aa3-8055-c7637ba96bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:50.963079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76568e-14d9-4aa3-8055-c7637ba96bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:50.964114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76568e-14d9-4aa3-8055-c7637ba96bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:50.966710 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76568e-14d9-4aa3-8055-c7637ba96bc2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:50.992505 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1246/2505] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:22:50 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:22:50.997116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b354-a884-4ef5-a909-03f8ce2784dd admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:51.008781 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b354-a884-4ef5-a909-03f8ce2784dd admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:51.014791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782d9e2-7708-482a-8a4d-c7759c843ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:51.015451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d9e2-7708-482a-8a4d-c7759c843ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:51.015732 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d9e2-7708-482a-8a4d-c7759c843ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:51.016006 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d9e2-7708-482a-8a4d-c7759c843ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:51.016847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782d9e2-7708-482a-8a4d-c7759c843ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:51.018800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782d9e2-7708-482a-8a4d-c7759c843ca6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:51.032679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1260/2506] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:22:51.037377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76568e-14d9-4aa3-8055-c7637ba96bc2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:51.053711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76568e-14d9-4aa3-8055-c7637ba96bc2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:51.063253 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e1289-f9ee-4a4b-809d-ad944888e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:51.063955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e1289-f9ee-4a4b-809d-ad944888e7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:51.064232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e1289-f9ee-4a4b-809d-ad944888e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:51.064506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e1289-f9ee-4a4b-809d-ad944888e7ff admin admin] PATH_INFO: `/v3/projects/d1ddc228dd00477198281e67f48933df/users/37213692959f425b983852fec0f872ce/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:51.082570 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e1289-f9ee-4a4b-809d-ad944888e7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ddc228dd00477198281e67f48933df, user_id=37213692959f425b983852fec0f872ce, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:51.085551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e1289-f9ee-4a4b-809d-ad944888e7ff admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:51.102318 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1247/2507] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:22:51 2022] PUT /identity/v3/projects/d1ddc228dd00477198281e67f48933df/users/37213692959f425b983852fec0f872ce/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:22:51.106829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782d9e2-7708-482a-8a4d-c7759c843ca6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:51.118258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782d9e2-7708-482a-8a4d-c7759c843ca6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:51.180999 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead4e04-537b-4d8f-a8ea-270e5a0821c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:51.181635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead4e04-537b-4d8f-a8ea-270e5a0821c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:51.181911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead4e04-537b-4d8f-a8ea-270e5a0821c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:51.182188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead4e04-537b-4d8f-a8ea-270e5a0821c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:51.185067 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead4e04-537b-4d8f-a8ea-270e5a0821c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:51.185067 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead4e04-537b-4d8f-a8ea-270e5a0821c5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:51.199571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1261/2508] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:22:51.200811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e1289-f9ee-4a4b-809d-ad944888e7ff admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:51.211745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e1289-f9ee-4a4b-809d-ad944888e7ff admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:51.217229 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673851c8-25a4-4e5c-8ba1-5fefb1462269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:51.218054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673851c8-25a4-4e5c-8ba1-5fefb1462269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:51.218477 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673851c8-25a4-4e5c-8ba1-5fefb1462269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:51.218795 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673851c8-25a4-4e5c-8ba1-5fefb1462269 admin admin] PATH_INFO: `/v3/projects/d1ddc228dd00477198281e67f48933df/users/37213692959f425b983852fec0f872ce/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:51.220869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673851c8-25a4-4e5c-8ba1-5fefb1462269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ddc228dd00477198281e67f48933df, user_id=37213692959f425b983852fec0f872ce, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:51.223654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673851c8-25a4-4e5c-8ba1-5fefb1462269 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:51.241215 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1248/2509] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:22:51 2022] PUT /identity/v3/projects/d1ddc228dd00477198281e67f48933df/users/37213692959f425b983852fec0f872ce/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:22:56.190688 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041eaf55-ef24-47c5-a5b0-4d75e21357de None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:56.191186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041eaf55-ef24-47c5-a5b0-4d75e21357de None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:56.191296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041eaf55-ef24-47c5-a5b0-4d75e21357de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:56.238232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-041eaf55-ef24-47c5-a5b0-4d75e21357de None None] MFA Rules not processed for user `37213692959f425b983852fec0f872ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:56.240380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-041eaf55-ef24-47c5-a5b0-4d75e21357de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:56.335001 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1262/2510] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:22:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:56.343969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673851c8-25a4-4e5c-8ba1-5fefb1462269 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:56.346107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-673851c8-25a4-4e5c-8ba1-5fefb1462269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:56.443719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673851c8-25a4-4e5c-8ba1-5fefb1462269 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:56.447781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0545c9-a4c6-4f70-8b84-9e0575476241 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c3d7cdad7f44f0f8df944ec7f69de26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:56.448411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0545c9-a4c6-4f70-8b84-9e0575476241 service glance] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:56.448802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0545c9-a4c6-4f70-8b84-9e0575476241 service glance] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:56.449102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0545c9-a4c6-4f70-8b84-9e0575476241 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:56.477740 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:56.517113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0545c9-a4c6-4f70-8b84-9e0575476241 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:56.518750 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0545c9-a4c6-4f70-8b84-9e0575476241 service glance] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:56.529365 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1249/2511] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:22:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:22:56.720692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a902b8d-ec2a-411a-a9cc-dfdf65406e6b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:56.721059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a902b8d-ec2a-411a-a9cc-dfdf65406e6b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:56.721360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a902b8d-ec2a-411a-a9cc-dfdf65406e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:56.752640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4a902b8d-ec2a-411a-a9cc-dfdf65406e6b None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:22:56.754528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4a902b8d-ec2a-411a-a9cc-dfdf65406e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:56.762922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:22:56.839790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1263/2512] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:22:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:22:56.848345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0545c9-a4c6-4f70-8b84-9e0575476241 service glance] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:22:56.850735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3f0545c9-a4c6-4f70-8b84-9e0575476241 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:22:56.975411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0545c9-a4c6-4f70-8b84-9e0575476241 service glance] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:22:56.996285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65607d62-27af-43f7-a7a9-9f796cff006f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:22:56.997129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65607d62-27af-43f7-a7a9-9f796cff006f service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:22:56.997473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65607d62-27af-43f7-a7a9-9f796cff006f service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:22:56.997812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65607d62-27af-43f7-a7a9-9f796cff006f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:22:57.019168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65607d62-27af-43f7-a7a9-9f796cff006f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:22:57.021079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65607d62-27af-43f7-a7a9-9f796cff006f service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:22:57.035037 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1250/2513] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:22:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:23:05.926448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22334c-9db1-4c2e-ad6f-76c710435a23 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:05.927127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22334c-9db1-4c2e-ad6f-76c710435a23 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:05.927127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22334c-9db1-4c2e-ad6f-76c710435a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:05.947940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4c22334c-9db1-4c2e-ad6f-76c710435a23 None None] MFA Rules not processed for user `e383fda8f4ce4ddc841552c751f1a7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:23:05.949643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4c22334c-9db1-4c2e-ad6f-76c710435a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:05.957619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1264/2514] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:23:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:23:06.797222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65607d62-27af-43f7-a7a9-9f796cff006f service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:06.799522 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-65607d62-27af-43f7-a7a9-9f796cff006f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:06.928429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65607d62-27af-43f7-a7a9-9f796cff006f service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:06.938285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03eabf7-a930-4275-9066-01dba43ad635 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:06.939361 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03eabf7-a930-4275-9066-01dba43ad635 service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:06.939906 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03eabf7-a930-4275-9066-01dba43ad635 service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:06.940429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03eabf7-a930-4275-9066-01dba43ad635 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:06.943891 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b03eabf7-a930-4275-9066-01dba43ad635 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:06.966768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03eabf7-a930-4275-9066-01dba43ad635 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:06.969726 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03eabf7-a930-4275-9066-01dba43ad635 service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:07.001457 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1251/2515] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:23:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:23:08.585010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31c00-a4a0-410e-9df8-42ac47104a38 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:08.585932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31c00-a4a0-410e-9df8-42ac47104a38 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:08.585932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31c00-a4a0-410e-9df8-42ac47104a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:08.609642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b3d31c00-a4a0-410e-9df8-42ac47104a38 None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:23:08.611085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b3d31c00-a4a0-410e-9df8-42ac47104a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:08.622815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1265/2516] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:23:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:23:08.635628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03eabf7-a930-4275-9066-01dba43ad635 service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:08.649075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03eabf7-a930-4275-9066-01dba43ad635 service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:08.655479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965b823-4d0b-464e-a138-e83788736a40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:08.656127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965b823-4d0b-464e-a138-e83788736a40 service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:08.656407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965b823-4d0b-464e-a138-e83788736a40 service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:08.656683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965b823-4d0b-464e-a138-e83788736a40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:08.666662 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965b823-4d0b-464e-a138-e83788736a40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:08.668283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965b823-4d0b-464e-a138-e83788736a40 service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:08.678003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1252/2517] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:23:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:23:18.602516 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=26 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:18.673991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=86 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:31.493422 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d31c00-a4a0-410e-9df8-42ac47104a38 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:31.495250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b3d31c00-a4a0-410e-9df8-42ac47104a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:31.561705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d31c00-a4a0-410e-9df8-42ac47104a38 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:31.565693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c8487-9b69-4ca5-ac68-55e20b286cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:31.566320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c8487-9b69-4ca5-ac68-55e20b286cdd service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:31.566595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c8487-9b69-4ca5-ac68-55e20b286cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:31.566864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c8487-9b69-4ca5-ac68-55e20b286cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:31.568752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e80c8487-9b69-4ca5-ac68-55e20b286cdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:31.645797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c8487-9b69-4ca5-ac68-55e20b286cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:31.647379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c8487-9b69-4ca5-ac68-55e20b286cdd service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:31.667320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1266/2518] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:23:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:23:32.159712 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddb414-425f-4388-9ffe-f79c79614617 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:32.160273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddb414-425f-4388-9ffe-f79c79614617 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:32.160273 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddb414-425f-4388-9ffe-f79c79614617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:32.181151 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-e4ddb414-425f-4388-9ffe-f79c79614617 None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:23:32.183116 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e4ddb414-425f-4388-9ffe-f79c79614617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:32.191072 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1253/2519] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:23:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:23:32.204228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c8487-9b69-4ca5-ac68-55e20b286cdd service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:32.216695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c8487-9b69-4ca5-ac68-55e20b286cdd service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:32.221873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10658502-0d0f-455d-afc9-84306e18f57b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:32.222752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10658502-0d0f-455d-afc9-84306e18f57b service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:32.223028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10658502-0d0f-455d-afc9-84306e18f57b service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:32.223300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10658502-0d0f-455d-afc9-84306e18f57b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:32.231995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10658502-0d0f-455d-afc9-84306e18f57b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:32.233628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10658502-0d0f-455d-afc9-84306e18f57b service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:32.243221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1267/2520] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:23:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:23:42.175532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:42.245510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=54 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:43.173295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c07df-c964-4281-8c28-cdb8182b0895 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:43.173909 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c07df-c964-4281-8c28-cdb8182b0895 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:43.174377 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c07df-c964-4281-8c28-cdb8182b0895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:43.200439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-c59c07df-c964-4281-8c28-cdb8182b0895 None None] MFA Rules not processed for user `43ef613541cb4fd49faa3a3cec1a58c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:23:43.201899 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c59c07df-c964-4281-8c28-cdb8182b0895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:43.227241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1254/2521] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:23:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:23:46.286258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10658502-0d0f-455d-afc9-84306e18f57b service swift] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:46.288063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-10658502-0d0f-455d-afc9-84306e18f57b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:46.356800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10658502-0d0f-455d-afc9-84306e18f57b service swift] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:46.361133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9759-4861-4556-9546-af31a858a850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:46.361801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9759-4861-4556-9546-af31a858a850 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:46.362075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9759-4861-4556-9546-af31a858a850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:46.362345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9759-4861-4556-9546-af31a858a850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:46.364368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-790a9759-4861-4556-9546-af31a858a850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:46.429301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a9759-4861-4556-9546-af31a858a850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:46.430734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a9759-4861-4556-9546-af31a858a850 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:46.441778 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1268/2522] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:23:49.153234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c07df-c964-4281-8c28-cdb8182b0895 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:49.159549 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c59c07df-c964-4281-8c28-cdb8182b0895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:49.178232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c07df-c964-4281-8c28-cdb8182b0895 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:49.182126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57127362-5793-4fca-827f-dc1a19733320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:49.183032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57127362-5793-4fca-827f-dc1a19733320 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:49.183310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57127362-5793-4fca-827f-dc1a19733320 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:49.183582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57127362-5793-4fca-827f-dc1a19733320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:49.185526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-57127362-5793-4fca-827f-dc1a19733320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:49.334416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57127362-5793-4fca-827f-dc1a19733320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:49.335905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57127362-5793-4fca-827f-dc1a19733320 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:49.369569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1255/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:23:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:23:49.727754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9759-4861-4556-9546-af31a858a850 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:49.739741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9759-4861-4556-9546-af31a858a850 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:49.744372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd2884-395a-4642-bdca-26e4b543cdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:49.745833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd2884-395a-4642-bdca-26e4b543cdbd service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:49.746192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd2884-395a-4642-bdca-26e4b543cdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:49.746575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd2884-395a-4642-bdca-26e4b543cdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:49.761237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd2884-395a-4642-bdca-26e4b543cdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:49.762815 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd2884-395a-4642-bdca-26e4b543cdbd service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:49.775211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1269/2524] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:23:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:23:49.862622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57127362-5793-4fca-827f-dc1a19733320 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:49.879711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57127362-5793-4fca-827f-dc1a19733320 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:49.885073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1567dd8-d801-4dcc-a113-9c0a984ec307 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c3d7cdad7f44f0f8df944ec7f69de26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:49.886051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1567dd8-d801-4dcc-a113-9c0a984ec307 service glance] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:49.886544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1567dd8-d801-4dcc-a113-9c0a984ec307 service glance] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:49.886999 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1567dd8-d801-4dcc-a113-9c0a984ec307 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:49.888886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b1567dd8-d801-4dcc-a113-9c0a984ec307 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:49.904589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1567dd8-d801-4dcc-a113-9c0a984ec307 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:49.906631 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1567dd8-d801-4dcc-a113-9c0a984ec307 service glance] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:49.925537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1256/2525] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:23:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:23:50.101350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd2884-395a-4642-bdca-26e4b543cdbd service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:50.111572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd2884-395a-4642-bdca-26e4b543cdbd service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:50.116186 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630074d0-2e4a-4849-9724-c9a5bbbfcdda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:50.116940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630074d0-2e4a-4849-9724-c9a5bbbfcdda service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:50.117287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630074d0-2e4a-4849-9724-c9a5bbbfcdda service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:50.117601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630074d0-2e4a-4849-9724-c9a5bbbfcdda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:50.120090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-630074d0-2e4a-4849-9724-c9a5bbbfcdda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:50.132092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630074d0-2e4a-4849-9724-c9a5bbbfcdda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:50.134911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630074d0-2e4a-4849-9724-c9a5bbbfcdda service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:50.145301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1270/2526] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:23:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:23:50.385185 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1567dd8-d801-4dcc-a113-9c0a984ec307 service glance] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:50.399787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1567dd8-d801-4dcc-a113-9c0a984ec307 service glance] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:50.406661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866fd09-021e-4143-9f9d-930fc8318585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:50.407869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866fd09-021e-4143-9f9d-930fc8318585 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:50.408599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866fd09-021e-4143-9f9d-930fc8318585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:50.409127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866fd09-021e-4143-9f9d-930fc8318585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:50.411348 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2866fd09-021e-4143-9f9d-930fc8318585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:50.454455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866fd09-021e-4143-9f9d-930fc8318585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:50.460381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866fd09-021e-4143-9f9d-930fc8318585 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:50.487603 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1257/2527] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:23:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:23:51.207754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630074d0-2e4a-4849-9724-c9a5bbbfcdda service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:51.218426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630074d0-2e4a-4849-9724-c9a5bbbfcdda service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:51.223243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe147181-2420-4ed6-b047-10a0d38bfb98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:51.223950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe147181-2420-4ed6-b047-10a0d38bfb98 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:51.233975 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe147181-2420-4ed6-b047-10a0d38bfb98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:51.234495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe147181-2420-4ed6-b047-10a0d38bfb98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:51.237827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fe147181-2420-4ed6-b047-10a0d38bfb98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:51.269489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe147181-2420-4ed6-b047-10a0d38bfb98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:51.273373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe147181-2420-4ed6-b047-10a0d38bfb98 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:51.287861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1271/2528] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:23:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:23:51.439475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866fd09-021e-4143-9f9d-930fc8318585 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:51.441288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2866fd09-021e-4143-9f9d-930fc8318585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:51.459865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866fd09-021e-4143-9f9d-930fc8318585 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:51.465154 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee140d-dde3-4f0a-a979-bfe2c08d5e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:51.465939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee140d-dde3-4f0a-a979-bfe2c08d5e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:51.466319 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee140d-dde3-4f0a-a979-bfe2c08d5e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:51.466691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee140d-dde3-4f0a-a979-bfe2c08d5e19 admin admin] PATH_INFO: `/v3/users/02c685b300874351ab2dbd62bea1a669` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:51.489212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee140d-dde3-4f0a-a979-bfe2c08d5e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c685b300874351ab2dbd62bea1a669)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:51.492098 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee140d-dde3-4f0a-a979-bfe2c08d5e19 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:51.574241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-15ee140d-dde3-4f0a-a979-bfe2c08d5e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c685b300874351ab2dbd62bea1a669'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:23:51.589563 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-15ee140d-dde3-4f0a-a979-bfe2c08d5e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c685b300874351ab2dbd62bea1a669'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:23:51.597940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-15ee140d-dde3-4f0a-a979-bfe2c08d5e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c685b300874351ab2dbd62bea1a669'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:23:51.598911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-15ee140d-dde3-4f0a-a979-bfe2c08d5e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c685b300874351ab2dbd62bea1a669'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:23:51.614556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:51.618932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-15ee140d-dde3-4f0a-a979-bfe2c08d5e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c685b300874351ab2dbd62bea1a669'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:23:51.627785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1258/2529] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:23:51 2022] DELETE /identity/v3/users/02c685b300874351ab2dbd62bea1a669 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:23:51.817804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe147181-2420-4ed6-b047-10a0d38bfb98 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:51.843364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe147181-2420-4ed6-b047-10a0d38bfb98 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:51.915800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538225e1-187e-4a8a-92ea-b1bbce0222dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:51.916665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538225e1-187e-4a8a-92ea-b1bbce0222dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:51.917107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538225e1-187e-4a8a-92ea-b1bbce0222dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:51.917540 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538225e1-187e-4a8a-92ea-b1bbce0222dc admin admin] PATH_INFO: `/v3/projects/92e23c5c336e486f995f88c12b72b2c5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:51.934918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538225e1-187e-4a8a-92ea-b1bbce0222dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e23c5c336e486f995f88c12b72b2c5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:51.936603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538225e1-187e-4a8a-92ea-b1bbce0222dc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:51.940506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:51.990488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-538225e1-187e-4a8a-92ea-b1bbce0222dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e23c5c336e486f995f88c12b72b2c5', 'request_id': 'req-538225e1-187e-4a8a-92ea-b1bbce0222dc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:23:51.998731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-538225e1-187e-4a8a-92ea-b1bbce0222dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e23c5c336e486f995f88c12b72b2c5', 'request_id': 'req-538225e1-187e-4a8a-92ea-b1bbce0222dc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:23:52.004817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-538225e1-187e-4a8a-92ea-b1bbce0222dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e23c5c336e486f995f88c12b72b2c5', 'request_id': 'req-538225e1-187e-4a8a-92ea-b1bbce0222dc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:23:52.029056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-538225e1-187e-4a8a-92ea-b1bbce0222dc admin admin] The token cache is being invalidate because project 92e23c5c336e486f995f88c12b72b2c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:23:52.029056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-538225e1-187e-4a8a-92ea-b1bbce0222dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:23:52.029056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-538225e1-187e-4a8a-92ea-b1bbce0222dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:23:52.029056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1272/2530] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:23:51 2022] DELETE /identity/v3/projects/92e23c5c336e486f995f88c12b72b2c5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:23:52.031035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef86e2-a3a5-4f74-bef3-28ea1742309c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:52.031312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef86e2-a3a5-4f74-bef3-28ea1742309c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:52.031595 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef86e2-a3a5-4f74-bef3-28ea1742309c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:52.054850 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b6ef86e2-a3a5-4f74-bef3-28ea1742309c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:23:52.056168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b6ef86e2-a3a5-4f74-bef3-28ea1742309c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:52.121539 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1259/2531] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:23:52.128803 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f79947-79cd-4e22-8e01-83898741cc5f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:52.129220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f79947-79cd-4e22-8e01-83898741cc5f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:52.129548 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f79947-79cd-4e22-8e01-83898741cc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:52.153191 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e6f79947-79cd-4e22-8e01-83898741cc5f None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:23:52.154534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e6f79947-79cd-4e22-8e01-83898741cc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:52.163092 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1273/2532] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:23:52.167851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef86e2-a3a5-4f74-bef3-28ea1742309c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:52.180912 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef86e2-a3a5-4f74-bef3-28ea1742309c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:52.187094 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0395e7-614f-4560-8ea8-b7eae3ecd07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:52.189099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0395e7-614f-4560-8ea8-b7eae3ecd07f admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:52.189099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0395e7-614f-4560-8ea8-b7eae3ecd07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:52.189099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0395e7-614f-4560-8ea8-b7eae3ecd07f admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:52.189704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0395e7-614f-4560-8ea8-b7eae3ecd07f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:23:52.189880 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0395e7-614f-4560-8ea8-b7eae3ecd07f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:52.191646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0395e7-614f-4560-8ea8-b7eae3ecd07f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:52.212950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1260/2533] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:23:52.215506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f79947-79cd-4e22-8e01-83898741cc5f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:52.227480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f79947-79cd-4e22-8e01-83898741cc5f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:52.232828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca82ca-4858-428a-b127-ad69cc47d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:52.233524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca82ca-4858-428a-b127-ad69cc47d308 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:52.233828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca82ca-4858-428a-b127-ad69cc47d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:52.234150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca82ca-4858-428a-b127-ad69cc47d308 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:52.234893 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca82ca-4858-428a-b127-ad69cc47d308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:52.237047 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca82ca-4858-428a-b127-ad69cc47d308 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:52.282900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1274/2534] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:23:52 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:23:52.289214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0395e7-614f-4560-8ea8-b7eae3ecd07f admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:52.300480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0395e7-614f-4560-8ea8-b7eae3ecd07f admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:52.379103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c9dc0-016c-42e7-93b0-a4a734e2272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:52.379797 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c9dc0-016c-42e7-93b0-a4a734e2272d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:52.380239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c9dc0-016c-42e7-93b0-a4a734e2272d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:52.380340 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c9dc0-016c-42e7-93b0-a4a734e2272d admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:52.381164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c9dc0-016c-42e7-93b0-a4a734e2272d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:52.383147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c9dc0-016c-42e7-93b0-a4a734e2272d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:52.408684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1261/2535] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:23:52 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:23:52.413227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca82ca-4858-428a-b127-ad69cc47d308 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:52.426132 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca82ca-4858-428a-b127-ad69cc47d308 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:52.432204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ef7d7-4d9a-4fb7-b550-b3873041a3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:52.432851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ef7d7-4d9a-4fb7-b550-b3873041a3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:52.433174 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ef7d7-4d9a-4fb7-b550-b3873041a3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:52.433448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ef7d7-4d9a-4fb7-b550-b3873041a3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:52.434159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ef7d7-4d9a-4fb7-b550-b3873041a3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:52.435774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ef7d7-4d9a-4fb7-b550-b3873041a3d7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:52.447261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1275/2536] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:23:52.451354 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c9dc0-016c-42e7-93b0-a4a734e2272d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:52.463294 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c9dc0-016c-42e7-93b0-a4a734e2272d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:52.469836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acada1a-39ef-48f3-ad13-8a6858a8fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:52.470664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acada1a-39ef-48f3-ad13-8a6858a8fc12 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:52.471093 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acada1a-39ef-48f3-ad13-8a6858a8fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:52.471430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acada1a-39ef-48f3-ad13-8a6858a8fc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:52.472213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acada1a-39ef-48f3-ad13-8a6858a8fc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:52.473962 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acada1a-39ef-48f3-ad13-8a6858a8fc12 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:52.485809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1262/2537] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:23:52.491490 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ef7d7-4d9a-4fb7-b550-b3873041a3d7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:52.500934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ef7d7-4d9a-4fb7-b550-b3873041a3d7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:52.507554 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271c684-ab37-44ea-a546-994102e64f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:52.508384 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271c684-ab37-44ea-a546-994102e64f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:52.508836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271c684-ab37-44ea-a546-994102e64f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:52.509133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271c684-ab37-44ea-a546-994102e64f75 admin admin] PATH_INFO: `/v3/projects/bf49b3f9c17a4a15bb2392edbab6d3cc/users/642019ed21ca4864a413989fee03dc49/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:52.540885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271c684-ab37-44ea-a546-994102e64f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf49b3f9c17a4a15bb2392edbab6d3cc, user_id=642019ed21ca4864a413989fee03dc49, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:52.543765 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271c684-ab37-44ea-a546-994102e64f75 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:52.563915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1276/2538] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:23:52 2022] PUT /identity/v3/projects/bf49b3f9c17a4a15bb2392edbab6d3cc/users/642019ed21ca4864a413989fee03dc49/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:23:52.574434 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5241-3f8b-4316-8519-83358f52858e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:52.574974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5241-3f8b-4316-8519-83358f52858e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:52.575249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5241-3f8b-4316-8519-83358f52858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:52.606659 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-611f5241-3f8b-4316-8519-83358f52858e None None] MFA Rules not processed for user `642019ed21ca4864a413989fee03dc49`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:23:52.607956 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-611f5241-3f8b-4316-8519-83358f52858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:52.684038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:52.706593 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1263/2539] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:23:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:23:52.717909 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271c684-ab37-44ea-a546-994102e64f75 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:52.719994 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b271c684-ab37-44ea-a546-994102e64f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:52.803901 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271c684-ab37-44ea-a546-994102e64f75 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:52.812735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84892e0b-2801-4c30-8cdb-d656db7eb979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:52.812735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84892e0b-2801-4c30-8cdb-d656db7eb979 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:52.812735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84892e0b-2801-4c30-8cdb-d656db7eb979 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:52.812735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84892e0b-2801-4c30-8cdb-d656db7eb979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:52.821185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84892e0b-2801-4c30-8cdb-d656db7eb979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:52.822790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84892e0b-2801-4c30-8cdb-d656db7eb979 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:52.832206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1277/2540] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:23:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:23:53.957878 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eb202-bddb-41d1-9346-6f524c691a4c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:53.958376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eb202-bddb-41d1-9346-6f524c691a4c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:53.958720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eb202-bddb-41d1-9346-6f524c691a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:53.982142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ff7eb202-bddb-41d1-9346-6f524c691a4c None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:23:53.983386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ff7eb202-bddb-41d1-9346-6f524c691a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:54.050172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1264/2541] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:23:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:23:54.063596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84892e0b-2801-4c30-8cdb-d656db7eb979 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:23:54.067437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-84892e0b-2801-4c30-8cdb-d656db7eb979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:23:54.078273 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:23:54.157819 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84892e0b-2801-4c30-8cdb-d656db7eb979 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:23:54.165058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420434eb-6579-4e10-bce2-6daa57efd222 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:23:54.166052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420434eb-6579-4e10-bce2-6daa57efd222 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:23:54.166565 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420434eb-6579-4e10-bce2-6daa57efd222 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:23:54.167153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420434eb-6579-4e10-bce2-6daa57efd222 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:23:54.179889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420434eb-6579-4e10-bce2-6daa57efd222 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:23:54.182172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420434eb-6579-4e10-bce2-6daa57efd222 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:23:54.195029 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1278/2542] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:23:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:04.041881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=30 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:04.189993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=30 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:04.907548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7eb202-bddb-41d1-9346-6f524c691a4c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:04.981183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7eb202-bddb-41d1-9346-6f524c691a4c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:04.988507 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:04.989321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:04.989610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:04.989908 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] PATH_INFO: `/v3/users/642019ed21ca4864a413989fee03dc49` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:04.991166 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=642019ed21ca4864a413989fee03dc49)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:04.993146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:05.051568 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642019ed21ca4864a413989fee03dc49'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:05.060867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642019ed21ca4864a413989fee03dc49'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:05.070781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642019ed21ca4864a413989fee03dc49'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:05.071415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642019ed21ca4864a413989fee03dc49'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:05.086947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642019ed21ca4864a413989fee03dc49'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:05.094114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1265/2543] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:24:04 2022] DELETE /identity/v3/users/642019ed21ca4864a413989fee03dc49 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:05.101747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b802d69-78b0-425d-9c31-a8fe9ba5a530 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:05.102164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b802d69-78b0-425d-9c31-a8fe9ba5a530 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:05.102618 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b802d69-78b0-425d-9c31-a8fe9ba5a530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:05.133474 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6b802d69-78b0-425d-9c31-a8fe9ba5a530 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:05.135740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6b802d69-78b0-425d-9c31-a8fe9ba5a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:05.216844 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1279/2544] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:05.227897 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:05.229409 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:05.307039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d54981-e85b-417b-81c1-7a6c30c1a493 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:05.311646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6da8f8-23e9-4de3-9039-6660190e7589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:05.312419 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6da8f8-23e9-4de3-9039-6660190e7589 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:05.312803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6da8f8-23e9-4de3-9039-6660190e7589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:05.313201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6da8f8-23e9-4de3-9039-6660190e7589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:05.327205 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6da8f8-23e9-4de3-9039-6660190e7589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:05.350078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6da8f8-23e9-4de3-9039-6660190e7589 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:05.369007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1266/2545] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:24:05.666084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b802d69-78b0-425d-9c31-a8fe9ba5a530 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:05.667839 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6b802d69-78b0-425d-9c31-a8fe9ba5a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:05.697724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b802d69-78b0-425d-9c31-a8fe9ba5a530 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:05.704668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26987285-9bc6-400f-b263-0285729017a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:05.705663 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26987285-9bc6-400f-b263-0285729017a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:05.706320 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26987285-9bc6-400f-b263-0285729017a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:05.706774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26987285-9bc6-400f-b263-0285729017a7 admin admin] PATH_INFO: `/v3/projects/bf49b3f9c17a4a15bb2392edbab6d3cc` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:05.708238 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26987285-9bc6-400f-b263-0285729017a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf49b3f9c17a4a15bb2392edbab6d3cc)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:05.710331 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26987285-9bc6-400f-b263-0285729017a7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:05.765023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-26987285-9bc6-400f-b263-0285729017a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf49b3f9c17a4a15bb2392edbab6d3cc', 'request_id': 'req-26987285-9bc6-400f-b263-0285729017a7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:05.775064 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-26987285-9bc6-400f-b263-0285729017a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf49b3f9c17a4a15bb2392edbab6d3cc', 'request_id': 'req-26987285-9bc6-400f-b263-0285729017a7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:05.783313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-26987285-9bc6-400f-b263-0285729017a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf49b3f9c17a4a15bb2392edbab6d3cc', 'request_id': 'req-26987285-9bc6-400f-b263-0285729017a7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:05.796761 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-26987285-9bc6-400f-b263-0285729017a7 admin admin] The token cache is being invalidate because project bf49b3f9c17a4a15bb2392edbab6d3cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:24:05.797148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-26987285-9bc6-400f-b263-0285729017a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:05.797927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-26987285-9bc6-400f-b263-0285729017a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:05.803044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1280/2546] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:24:05 2022] DELETE /identity/v3/projects/bf49b3f9c17a4a15bb2392edbab6d3cc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:05.805141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed7ba1-ee73-4d01-ab30-aa7770948a11 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:05.805455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed7ba1-ee73-4d01-ab30-aa7770948a11 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:05.806194 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed7ba1-ee73-4d01-ab30-aa7770948a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:05.833130 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-87ed7ba1-ee73-4d01-ab30-aa7770948a11 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:05.835665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-87ed7ba1-ee73-4d01-ab30-aa7770948a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:05.852933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:05.898816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1267/2547] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:05.907013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c240f98-eafb-4e3d-a79b-4abbcb1c12df None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:05.907300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c240f98-eafb-4e3d-a79b-4abbcb1c12df None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:05.907572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c240f98-eafb-4e3d-a79b-4abbcb1c12df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:05.929082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2c240f98-eafb-4e3d-a79b-4abbcb1c12df None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:05.930496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2c240f98-eafb-4e3d-a79b-4abbcb1c12df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:05.946544 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed7ba1-ee73-4d01-ab30-aa7770948a11 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:05.949121 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1281/2548] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:05.958411 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed7ba1-ee73-4d01-ab30-aa7770948a11 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:05.967761 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b7d7-610d-4c8e-add1-df7c5630ad29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:05.969311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b7d7-610d-4c8e-add1-df7c5630ad29 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:05.970589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b7d7-610d-4c8e-add1-df7c5630ad29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:05.971046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b7d7-610d-4c8e-add1-df7c5630ad29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:05.971953 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b7d7-610d-4c8e-add1-df7c5630ad29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:24:05.972419 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b7d7-610d-4c8e-add1-df7c5630ad29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:05.974303 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b7d7-610d-4c8e-add1-df7c5630ad29 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:05.990466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1268/2549] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:24:05.994616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c240f98-eafb-4e3d-a79b-4abbcb1c12df None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:06.004670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c240f98-eafb-4e3d-a79b-4abbcb1c12df None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:06.014132 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ccadd-fdfc-403a-b4e6-522adaa2d84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:06.014410 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ccadd-fdfc-403a-b4e6-522adaa2d84a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:06.014606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ccadd-fdfc-403a-b4e6-522adaa2d84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:06.014873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ccadd-fdfc-403a-b4e6-522adaa2d84a admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:06.015543 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ccadd-fdfc-403a-b4e6-522adaa2d84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:06.017517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ccadd-fdfc-403a-b4e6-522adaa2d84a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:06.061637 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1282/2550] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:05 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:24:06.064843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b7d7-610d-4c8e-add1-df7c5630ad29 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:06.076329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b7d7-610d-4c8e-add1-df7c5630ad29 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:06.149329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58f0f1-6057-41ce-918e-5ba66cc3bc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:06.150228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58f0f1-6057-41ce-918e-5ba66cc3bc70 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:06.150508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58f0f1-6057-41ce-918e-5ba66cc3bc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:06.150785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58f0f1-6057-41ce-918e-5ba66cc3bc70 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:06.151457 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58f0f1-6057-41ce-918e-5ba66cc3bc70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:06.153453 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58f0f1-6057-41ce-918e-5ba66cc3bc70 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:06.177433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1269/2551] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:06 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:06.181698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ccadd-fdfc-403a-b4e6-522adaa2d84a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:06.192635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ccadd-fdfc-403a-b4e6-522adaa2d84a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:06.197676 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be0eb2-cdb9-4ee8-b881-567838ab460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:06.198294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be0eb2-cdb9-4ee8-b881-567838ab460e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:06.198574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be0eb2-cdb9-4ee8-b881-567838ab460e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:06.198864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be0eb2-cdb9-4ee8-b881-567838ab460e admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:06.199557 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be0eb2-cdb9-4ee8-b881-567838ab460e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:06.201276 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be0eb2-cdb9-4ee8-b881-567838ab460e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:06.211642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1283/2552] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:06.215804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58f0f1-6057-41ce-918e-5ba66cc3bc70 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:06.226293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58f0f1-6057-41ce-918e-5ba66cc3bc70 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:06.231390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265064a0-8a5f-47e0-a108-73ae080e805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:06.232001 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265064a0-8a5f-47e0-a108-73ae080e805a admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:06.232280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265064a0-8a5f-47e0-a108-73ae080e805a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:06.232557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265064a0-8a5f-47e0-a108-73ae080e805a admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:06.233290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265064a0-8a5f-47e0-a108-73ae080e805a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:06.234907 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265064a0-8a5f-47e0-a108-73ae080e805a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:06.246930 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1270/2553] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:06.251523 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be0eb2-cdb9-4ee8-b881-567838ab460e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:06.263875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be0eb2-cdb9-4ee8-b881-567838ab460e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:06.269345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4170cd-df4d-45e3-a1a8-4ffca022a0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:06.270321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4170cd-df4d-45e3-a1a8-4ffca022a0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:06.270790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4170cd-df4d-45e3-a1a8-4ffca022a0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:06.271261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4170cd-df4d-45e3-a1a8-4ffca022a0a0 admin admin] PATH_INFO: `/v3/projects/9e51cef785c945c6ac6ba7fdf5df9f78/users/aa4b363ee3f04a61bdced8423890b33b/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:06.293228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4170cd-df4d-45e3-a1a8-4ffca022a0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e51cef785c945c6ac6ba7fdf5df9f78, user_id=aa4b363ee3f04a61bdced8423890b33b, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:06.295937 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4170cd-df4d-45e3-a1a8-4ffca022a0a0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:06.311059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1284/2554] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:06 2022] PUT /identity/v3/projects/9e51cef785c945c6ac6ba7fdf5df9f78/users/aa4b363ee3f04a61bdced8423890b33b/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:06.322811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62444527-25c9-48c7-847e-ca14592b62d3 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:06.323097 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62444527-25c9-48c7-847e-ca14592b62d3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:06.323374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62444527-25c9-48c7-847e-ca14592b62d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:06.351992 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-62444527-25c9-48c7-847e-ca14592b62d3 None None] MFA Rules not processed for user `aa4b363ee3f04a61bdced8423890b33b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:06.353252 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-62444527-25c9-48c7-847e-ca14592b62d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:06.451239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1271/2555] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:06.471770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4170cd-df4d-45e3-a1a8-4ffca022a0a0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:06.474682 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6a4170cd-df4d-45e3-a1a8-4ffca022a0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:06.528501 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:06.589194 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4170cd-df4d-45e3-a1a8-4ffca022a0a0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:06.593387 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30967f2d-3c01-4853-83a7-31fb6b2ba612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:06.594030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30967f2d-3c01-4853-83a7-31fb6b2ba612 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:06.594300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30967f2d-3c01-4853-83a7-31fb6b2ba612 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:06.594566 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30967f2d-3c01-4853-83a7-31fb6b2ba612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:06.607987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30967f2d-3c01-4853-83a7-31fb6b2ba612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:06.609547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30967f2d-3c01-4853-83a7-31fb6b2ba612 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:06.619740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1285/2556] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:24:16.447206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:16.615018 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=17 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:17.967749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62444527-25c9-48c7-847e-ca14592b62d3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:18.055994 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62444527-25c9-48c7-847e-ca14592b62d3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:18.062221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:18.062986 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:18.063326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:18.063669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] PATH_INFO: `/v3/users/aa4b363ee3f04a61bdced8423890b33b` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:18.065346 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4b363ee3f04a61bdced8423890b33b)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:18.069524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:18.132228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4b363ee3f04a61bdced8423890b33b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:18.144924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4b363ee3f04a61bdced8423890b33b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:18.155721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4b363ee3f04a61bdced8423890b33b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:18.156949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4b363ee3f04a61bdced8423890b33b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:18.178159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4b363ee3f04a61bdced8423890b33b'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:18.188720 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1272/2557] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:24:17 2022] DELETE /identity/v3/users/aa4b363ee3f04a61bdced8423890b33b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:18.194933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80e8b-c2e6-44b2-94d9-613388631659 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:18.195739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80e8b-c2e6-44b2-94d9-613388631659 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:18.195739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80e8b-c2e6-44b2-94d9-613388631659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:18.222782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5fc80e8b-c2e6-44b2-94d9-613388631659 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:18.224083 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5fc80e8b-c2e6-44b2-94d9-613388631659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:18.299012 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1286/2558] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:18.322177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:18.330634 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:18.396236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05ce70-7e07-4586-b5a9-1f009db5eea5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:18.399929 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719f18a-bb02-4663-921e-ef4841f374ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:18.400553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719f18a-bb02-4663-921e-ef4841f374ed service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:18.400833 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719f18a-bb02-4663-921e-ef4841f374ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:18.401136 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719f18a-bb02-4663-921e-ef4841f374ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:18.410673 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719f18a-bb02-4663-921e-ef4841f374ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:18.412302 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719f18a-bb02-4663-921e-ef4841f374ed service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:18.423064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1273/2559] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:24:18.770902 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80e8b-c2e6-44b2-94d9-613388631659 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:18.772865 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5fc80e8b-c2e6-44b2-94d9-613388631659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:18.794374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80e8b-c2e6-44b2-94d9-613388631659 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:18.799347 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2137e-1af2-40bd-835d-136e27e649f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:18.800085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2137e-1af2-40bd-835d-136e27e649f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:18.800352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2137e-1af2-40bd-835d-136e27e649f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:18.800633 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2137e-1af2-40bd-835d-136e27e649f9 admin admin] PATH_INFO: `/v3/projects/9e51cef785c945c6ac6ba7fdf5df9f78` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:18.802567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2137e-1af2-40bd-835d-136e27e649f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e51cef785c945c6ac6ba7fdf5df9f78)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:18.804830 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2137e-1af2-40bd-835d-136e27e649f9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:18.871212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-96c2137e-1af2-40bd-835d-136e27e649f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e51cef785c945c6ac6ba7fdf5df9f78', 'request_id': 'req-96c2137e-1af2-40bd-835d-136e27e649f9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:18.895674 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-96c2137e-1af2-40bd-835d-136e27e649f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e51cef785c945c6ac6ba7fdf5df9f78', 'request_id': 'req-96c2137e-1af2-40bd-835d-136e27e649f9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:18.903587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-96c2137e-1af2-40bd-835d-136e27e649f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e51cef785c945c6ac6ba7fdf5df9f78', 'request_id': 'req-96c2137e-1af2-40bd-835d-136e27e649f9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:18.922345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-96c2137e-1af2-40bd-835d-136e27e649f9 admin admin] The token cache is being invalidate because project 9e51cef785c945c6ac6ba7fdf5df9f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:24:18.922624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-96c2137e-1af2-40bd-835d-136e27e649f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:18.923351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-96c2137e-1af2-40bd-835d-136e27e649f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:18.925069 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1287/2560] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:24:18 2022] DELETE /identity/v3/projects/9e51cef785c945c6ac6ba7fdf5df9f78 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:18.930305 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce5b25-8f19-4b52-bcb5-87b10b5ad080 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:18.930588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce5b25-8f19-4b52-bcb5-87b10b5ad080 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:18.930897 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce5b25-8f19-4b52-bcb5-87b10b5ad080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:18.951439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-00ce5b25-8f19-4b52-bcb5-87b10b5ad080 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:18.952686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-00ce5b25-8f19-4b52-bcb5-87b10b5ad080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:18.971985 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:19.019802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1274/2561] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:19.028015 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98364721-5d96-4c6c-b460-5a41da57f5c3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.028524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98364721-5d96-4c6c-b460-5a41da57f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.028820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98364721-5d96-4c6c-b460-5a41da57f5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.051119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-98364721-5d96-4c6c-b460-5a41da57f5c3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:19.052331 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-98364721-5d96-4c6c-b460-5a41da57f5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:19.062834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1288/2562] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:19.067414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce5b25-8f19-4b52-bcb5-87b10b5ad080 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:19.079650 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce5b25-8f19-4b52-bcb5-87b10b5ad080 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:19.088574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11afac-8870-407c-88c1-1dd276d01212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:19.089258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11afac-8870-407c-88c1-1dd276d01212 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.089537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11afac-8870-407c-88c1-1dd276d01212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.089808 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11afac-8870-407c-88c1-1dd276d01212 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.090524 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11afac-8870-407c-88c1-1dd276d01212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:24:19.090823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11afac-8870-407c-88c1-1dd276d01212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:19.092664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11afac-8870-407c-88c1-1dd276d01212 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:19.107479 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1275/2563] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:24:19.112640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98364721-5d96-4c6c-b460-5a41da57f5c3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:19.126594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98364721-5d96-4c6c-b460-5a41da57f5c3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:19.132587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9debe4-542b-41ef-852f-30b7c036144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:19.133610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9debe4-542b-41ef-852f-30b7c036144b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.133893 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9debe4-542b-41ef-852f-30b7c036144b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.134163 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9debe4-542b-41ef-852f-30b7c036144b admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.134853 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9debe4-542b-41ef-852f-30b7c036144b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:19.136764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9debe4-542b-41ef-852f-30b7c036144b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:19.166838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1289/2564] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:19 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:19.171749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11afac-8870-407c-88c1-1dd276d01212 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:19.182830 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11afac-8870-407c-88c1-1dd276d01212 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:19.250511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeeb3f-7438-487c-b455-4693f4188c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:19.251198 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeeb3f-7438-487c-b455-4693f4188c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.251443 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeeb3f-7438-487c-b455-4693f4188c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.251723 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeeb3f-7438-487c-b455-4693f4188c4e admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.252546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeeeb3f-7438-487c-b455-4693f4188c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:19.255020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeeeb3f-7438-487c-b455-4693f4188c4e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:19.279889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1276/2565] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:19 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:19.289137 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9debe4-542b-41ef-852f-30b7c036144b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:19.304518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9debe4-542b-41ef-852f-30b7c036144b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:19.309486 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e656b-9d60-4d26-879d-c5488cdfdb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:19.310305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e656b-9d60-4d26-879d-c5488cdfdb8d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.310471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e656b-9d60-4d26-879d-c5488cdfdb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.310737 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e656b-9d60-4d26-879d-c5488cdfdb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.311451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e656b-9d60-4d26-879d-c5488cdfdb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:19.313093 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e656b-9d60-4d26-879d-c5488cdfdb8d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:19.324931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1290/2566] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:19.329588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeeb3f-7438-487c-b455-4693f4188c4e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:19.342987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeeb3f-7438-487c-b455-4693f4188c4e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:19.348177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2834c22-6ad0-4f6c-b101-1aec5926792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:19.348820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2834c22-6ad0-4f6c-b101-1aec5926792a admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.349223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2834c22-6ad0-4f6c-b101-1aec5926792a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.349531 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2834c22-6ad0-4f6c-b101-1aec5926792a admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.350236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2834c22-6ad0-4f6c-b101-1aec5926792a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:19.351851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2834c22-6ad0-4f6c-b101-1aec5926792a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:19.363426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1277/2567] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:19.368747 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e656b-9d60-4d26-879d-c5488cdfdb8d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:19.379757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e656b-9d60-4d26-879d-c5488cdfdb8d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:19.387845 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa2f94-70ef-4bed-b497-eabd2ef28fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:19.389033 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa2f94-70ef-4bed-b497-eabd2ef28fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.389520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa2f94-70ef-4bed-b497-eabd2ef28fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.390006 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa2f94-70ef-4bed-b497-eabd2ef28fe3 admin admin] PATH_INFO: `/v3/projects/6e82781a53c74d9db53a8da2c1c68fc9/users/50aa01c6cfcb41d8bef64bbc3a6e1522/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.415589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa2f94-70ef-4bed-b497-eabd2ef28fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e82781a53c74d9db53a8da2c1c68fc9, user_id=50aa01c6cfcb41d8bef64bbc3a6e1522, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:19.418342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa2f94-70ef-4bed-b497-eabd2ef28fe3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:19.444535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1291/2568] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:19 2022] PUT /identity/v3/projects/6e82781a53c74d9db53a8da2c1c68fc9/users/50aa01c6cfcb41d8bef64bbc3a6e1522/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:24:19.446976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e4d3-fa21-4e7d-8708-1c362e092163 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.447212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e4d3-fa21-4e7d-8708-1c362e092163 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.447478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e4d3-fa21-4e7d-8708-1c362e092163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.479640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-90f9e4d3-fa21-4e7d-8708-1c362e092163 None None] MFA Rules not processed for user `50aa01c6cfcb41d8bef64bbc3a6e1522`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:19.481313 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-90f9e4d3-fa21-4e7d-8708-1c362e092163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:19.564552 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1278/2569] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:19 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:19.569029 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa2f94-70ef-4bed-b497-eabd2ef28fe3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:19.593274 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:19.645449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa2f94-70ef-4bed-b497-eabd2ef28fe3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:19.650286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93fc8-0c5d-4e6c-b7df-428adaae7f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:19.650918 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93fc8-0c5d-4e6c-b7df-428adaae7f99 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.651198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93fc8-0c5d-4e6c-b7df-428adaae7f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.651475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd93fc8-0c5d-4e6c-b7df-428adaae7f99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.652161 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd93fc8-0c5d-4e6c-b7df-428adaae7f99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:19.654134 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd93fc8-0c5d-4e6c-b7df-428adaae7f99 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:19.686853 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1292/2570] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:19 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:24:19.688105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9e4d3-fa21-4e7d-8708-1c362e092163 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:19.705373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9e4d3-fa21-4e7d-8708-1c362e092163 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:19.719525 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:19.767667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403480b-8aff-46ca-a69a-57efc8ae18ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:19.768295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403480b-8aff-46ca-a69a-57efc8ae18ee admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.768579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403480b-8aff-46ca-a69a-57efc8ae18ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.768858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403480b-8aff-46ca-a69a-57efc8ae18ee admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.769570 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403480b-8aff-46ca-a69a-57efc8ae18ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:19.771628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403480b-8aff-46ca-a69a-57efc8ae18ee admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:19.799928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1279/2571] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:19 2022] POST /identity/v3/users => generated 309 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:24:19.804678 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93fc8-0c5d-4e6c-b7df-428adaae7f99 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:19.817010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd93fc8-0c5d-4e6c-b7df-428adaae7f99 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:19.822990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399dd43-ccc6-4671-a904-5567b5beea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:19.823728 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399dd43-ccc6-4671-a904-5567b5beea81 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.824018 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399dd43-ccc6-4671-a904-5567b5beea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.824316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399dd43-ccc6-4671-a904-5567b5beea81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.825120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399dd43-ccc6-4671-a904-5567b5beea81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:19.826854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399dd43-ccc6-4671-a904-5567b5beea81 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:19.840617 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1293/2572] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:19.845424 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403480b-8aff-46ca-a69a-57efc8ae18ee admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:19.857170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403480b-8aff-46ca-a69a-57efc8ae18ee admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:19.863750 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc1b0b-48d9-48a2-a2fb-f64e380b3746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:19.864505 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc1b0b-48d9-48a2-a2fb-f64e380b3746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.864802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc1b0b-48d9-48a2-a2fb-f64e380b3746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.865103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc1b0b-48d9-48a2-a2fb-f64e380b3746 admin admin] PATH_INFO: `/v3/projects/9c1633ef19d24550ab75d025f4710bec/users/178e718c8b5648978807183b12df4147/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.882760 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc1b0b-48d9-48a2-a2fb-f64e380b3746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1633ef19d24550ab75d025f4710bec, user_id=178e718c8b5648978807183b12df4147, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:19.885900 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc1b0b-48d9-48a2-a2fb-f64e380b3746 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:19.901541 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1280/2573] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:19 2022] PUT /identity/v3/projects/9c1633ef19d24550ab75d025f4710bec/users/178e718c8b5648978807183b12df4147/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:19.906375 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399dd43-ccc6-4671-a904-5567b5beea81 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:19.924419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399dd43-ccc6-4671-a904-5567b5beea81 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:19.995945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54b2ff-0e13-44db-afae-b7c01bf12e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:19.996587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54b2ff-0e13-44db-afae-b7c01bf12e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:19.996867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54b2ff-0e13-44db-afae-b7c01bf12e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:19.997175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54b2ff-0e13-44db-afae-b7c01bf12e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:19.997895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54b2ff-0e13-44db-afae-b7c01bf12e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:19.999561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54b2ff-0e13-44db-afae-b7c01bf12e14 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:20.016143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1294/2574] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:20.020877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc1b0b-48d9-48a2-a2fb-f64e380b3746 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:20.039601 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc1b0b-48d9-48a2-a2fb-f64e380b3746 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:20.046704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643389f8-0677-4ec3-8b9a-384c34f5a4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:20.047432 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643389f8-0677-4ec3-8b9a-384c34f5a4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:20.047718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643389f8-0677-4ec3-8b9a-384c34f5a4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:20.048041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643389f8-0677-4ec3-8b9a-384c34f5a4e8 admin admin] PATH_INFO: `/v3/projects/9c1633ef19d24550ab75d025f4710bec/users/178e718c8b5648978807183b12df4147/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:20.050705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643389f8-0677-4ec3-8b9a-384c34f5a4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1633ef19d24550ab75d025f4710bec, user_id=178e718c8b5648978807183b12df4147, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:20.054413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643389f8-0677-4ec3-8b9a-384c34f5a4e8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:20.066447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1281/2575] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:20 2022] PUT /identity/v3/projects/9c1633ef19d24550ab75d025f4710bec/users/178e718c8b5648978807183b12df4147/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:20.077287 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1647787-1d69-4efa-8b5d-abb93382dab9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:20.077517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1647787-1d69-4efa-8b5d-abb93382dab9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:20.077797 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1647787-1d69-4efa-8b5d-abb93382dab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:20.120378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f1647787-1d69-4efa-8b5d-abb93382dab9 None None] MFA Rules not processed for user `178e718c8b5648978807183b12df4147`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:20.121842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f1647787-1d69-4efa-8b5d-abb93382dab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:20.229986 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1295/2576] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:20 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:20.242854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643389f8-0677-4ec3-8b9a-384c34f5a4e8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:20.244878 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-643389f8-0677-4ec3-8b9a-384c34f5a4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:20.313904 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643389f8-0677-4ec3-8b9a-384c34f5a4e8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:20.318514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8703dbd-128d-49e6-9999-e28edecb9cad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:20.319161 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8703dbd-128d-49e6-9999-e28edecb9cad service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:20.319659 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8703dbd-128d-49e6-9999-e28edecb9cad service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:20.319973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8703dbd-128d-49e6-9999-e28edecb9cad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:20.331380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8703dbd-128d-49e6-9999-e28edecb9cad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:20.332742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8703dbd-128d-49e6-9999-e28edecb9cad service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:20.344380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1282/2577] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:20 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:24:20.513556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1647787-1d69-4efa-8b5d-abb93382dab9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:20.535272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:20.593506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1647787-1d69-4efa-8b5d-abb93382dab9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:20.598154 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:20.598849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:20.599231 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:20.599542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] PATH_INFO: `/v3/users/50aa01c6cfcb41d8bef64bbc3a6e1522` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:20.600955 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50aa01c6cfcb41d8bef64bbc3a6e1522)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:20.602885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:20.662827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50aa01c6cfcb41d8bef64bbc3a6e1522'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:20.663704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50aa01c6cfcb41d8bef64bbc3a6e1522'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:20.674187 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50aa01c6cfcb41d8bef64bbc3a6e1522'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:20.675132 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50aa01c6cfcb41d8bef64bbc3a6e1522'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:20.696993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50aa01c6cfcb41d8bef64bbc3a6e1522'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:20.715897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1296/2578] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:24:20 2022] DELETE /identity/v3/users/50aa01c6cfcb41d8bef64bbc3a6e1522 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:20.721394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5135f-c605-4ea1-a035-508e6f4fdebc None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:20.721678 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5135f-c605-4ea1-a035-508e6f4fdebc None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:20.721957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5135f-c605-4ea1-a035-508e6f4fdebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:20.765661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-74d5135f-c605-4ea1-a035-508e6f4fdebc None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:20.767370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-74d5135f-c605-4ea1-a035-508e6f4fdebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:20.853611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1283/2579] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:20.862015 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:20.863662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:20.930282 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482d63-889f-4e08-8229-38a1eb08283a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:20.930663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482d63-889f-4e08-8229-38a1eb08283a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:20.931090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb482d63-889f-4e08-8229-38a1eb08283a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:20.959818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d50823-42c3-4a41-849a-b5844c3e340a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:20.965584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ca86e-fe34-4125-b5f7-7bbab387ba84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:20.965989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:20.966337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ca86e-fe34-4125-b5f7-7bbab387ba84 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:20.966630 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ca86e-fe34-4125-b5f7-7bbab387ba84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:20.966900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ca86e-fe34-4125-b5f7-7bbab387ba84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:20.979540 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ca86e-fe34-4125-b5f7-7bbab387ba84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:20.981126 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ca86e-fe34-4125-b5f7-7bbab387ba84 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:20.992400 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1297/2580] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:24:21.004050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-bb482d63-889f-4e08-8229-38a1eb08283a None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:21.005394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bb482d63-889f-4e08-8229-38a1eb08283a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:21.079753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1284/2581] 10.222.0.27 () {58 vars in 967 bytes} [Fri Aug 5 07:24:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:21.106227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ca86e-fe34-4125-b5f7-7bbab387ba84 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:21.107713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f60ca86e-fe34-4125-b5f7-7bbab387ba84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:21.165760 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:21.236051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ca86e-fe34-4125-b5f7-7bbab387ba84 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:21.243968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a6c8b-b83a-43e2-9cfb-d82ca744c894 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:21.244872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a6c8b-b83a-43e2-9cfb-d82ca744c894 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:21.245323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a6c8b-b83a-43e2-9cfb-d82ca744c894 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:21.245699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a6c8b-b83a-43e2-9cfb-d82ca744c894 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:21.257222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a6c8b-b83a-43e2-9cfb-d82ca744c894 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:21.260741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a6c8b-b83a-43e2-9cfb-d82ca744c894 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:21.280086 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1298/2582] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:24:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:24:21.476065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb482d63-889f-4e08-8229-38a1eb08283a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:21.478272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-bb482d63-889f-4e08-8229-38a1eb08283a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:21.505569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb482d63-889f-4e08-8229-38a1eb08283a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:21.516102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:21.516916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:21.517230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:21.517730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] PATH_INFO: `/v3/projects/6e82781a53c74d9db53a8da2c1c68fc9` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:21.519662 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e82781a53c74d9db53a8da2c1c68fc9)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:21.523126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:21.593798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e82781a53c74d9db53a8da2c1c68fc9', 'request_id': 'req-1443a395-9f20-4963-b84e-bb2ee818a4f2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:21.603785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e82781a53c74d9db53a8da2c1c68fc9', 'request_id': 'req-1443a395-9f20-4963-b84e-bb2ee818a4f2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:21.614223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e82781a53c74d9db53a8da2c1c68fc9', 'request_id': 'req-1443a395-9f20-4963-b84e-bb2ee818a4f2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:21.631556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] The token cache is being invalidate because project 6e82781a53c74d9db53a8da2c1c68fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:24:21.632015 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:21.633622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:21.636371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1285/2583] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:24:21 2022] DELETE /identity/v3/projects/6e82781a53c74d9db53a8da2c1c68fc9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:21.641326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a6c8b-b83a-43e2-9cfb-d82ca744c894 service swift] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:21.652478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a6c8b-b83a-43e2-9cfb-d82ca744c894 service swift] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:21.744064 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801abc9-1f9d-448b-8f59-8c9b570675ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:21.744849 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801abc9-1f9d-448b-8f59-8c9b570675ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:21.745233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801abc9-1f9d-448b-8f59-8c9b570675ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:21.745574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801abc9-1f9d-448b-8f59-8c9b570675ce admin admin] PATH_INFO: `/v3/users/178e718c8b5648978807183b12df4147` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:21.747025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801abc9-1f9d-448b-8f59-8c9b570675ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=178e718c8b5648978807183b12df4147)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:21.749060 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801abc9-1f9d-448b-8f59-8c9b570675ce admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:21.831418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e801abc9-1f9d-448b-8f59-8c9b570675ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '178e718c8b5648978807183b12df4147'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:21.833263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e801abc9-1f9d-448b-8f59-8c9b570675ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '178e718c8b5648978807183b12df4147'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:21.849492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e801abc9-1f9d-448b-8f59-8c9b570675ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '178e718c8b5648978807183b12df4147'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:21.850531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e801abc9-1f9d-448b-8f59-8c9b570675ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '178e718c8b5648978807183b12df4147'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:21.867657 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e801abc9-1f9d-448b-8f59-8c9b570675ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '178e718c8b5648978807183b12df4147'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:21.881076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1299/2584] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:24:21 2022] DELETE /identity/v3/users/178e718c8b5648978807183b12df4147 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:22.314657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:22.316958 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:22.333577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443a395-9f20-4963-b84e-bb2ee818a4f2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:22.401734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5672cf7-c521-484d-af80-b4192f782bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:22.402918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5672cf7-c521-484d-af80-b4192f782bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:22.402918 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5672cf7-c521-484d-af80-b4192f782bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:22.403179 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5672cf7-c521-484d-af80-b4192f782bac admin admin] PATH_INFO: `/v3/projects/9c1633ef19d24550ab75d025f4710bec` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:22.405651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5672cf7-c521-484d-af80-b4192f782bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1633ef19d24550ab75d025f4710bec)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:22.406416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5672cf7-c521-484d-af80-b4192f782bac admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:22.421091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:22.495513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b5672cf7-c521-484d-af80-b4192f782bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1633ef19d24550ab75d025f4710bec', 'request_id': 'req-b5672cf7-c521-484d-af80-b4192f782bac'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:22.505085 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b5672cf7-c521-484d-af80-b4192f782bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1633ef19d24550ab75d025f4710bec', 'request_id': 'req-b5672cf7-c521-484d-af80-b4192f782bac'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:22.517511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b5672cf7-c521-484d-af80-b4192f782bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1633ef19d24550ab75d025f4710bec', 'request_id': 'req-b5672cf7-c521-484d-af80-b4192f782bac'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:22.534145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b5672cf7-c521-484d-af80-b4192f782bac admin admin] The token cache is being invalidate because project 9c1633ef19d24550ab75d025f4710bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:24:22.534466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b5672cf7-c521-484d-af80-b4192f782bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:22.535325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b5672cf7-c521-484d-af80-b4192f782bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:22.542069 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1286/2585] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:24:22 2022] DELETE /identity/v3/projects/9c1633ef19d24550ab75d025f4710bec => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:22.544374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5dd65-6dcf-4510-95d5-28bb3933ccf9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:22.544661 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5dd65-6dcf-4510-95d5-28bb3933ccf9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:22.545203 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5dd65-6dcf-4510-95d5-28bb3933ccf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:22.586594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d8c5dd65-6dcf-4510-95d5-28bb3933ccf9 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:22.587821 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d8c5dd65-6dcf-4510-95d5-28bb3933ccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:22.611264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:22.667656 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1300/2586] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:22.676461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4e92-2c11-4907-ade8-7f4757c40e54 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:22.676823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4e92-2c11-4907-ade8-7f4757c40e54 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:22.677386 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4e92-2c11-4907-ade8-7f4757c40e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:22.702009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b52f4e92-2c11-4907-ade8-7f4757c40e54 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:22.703298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b52f4e92-2c11-4907-ade8-7f4757c40e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:22.713910 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1287/2587] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:22.718487 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5dd65-6dcf-4510-95d5-28bb3933ccf9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:22.730310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5dd65-6dcf-4510-95d5-28bb3933ccf9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:22.737082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fff57-eee4-4ae1-b399-b23d4813651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:22.737299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fff57-eee4-4ae1-b399-b23d4813651b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:22.737630 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fff57-eee4-4ae1-b399-b23d4813651b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:22.737826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fff57-eee4-4ae1-b399-b23d4813651b admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:22.738686 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fff57-eee4-4ae1-b399-b23d4813651b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:24:22.738994 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fff57-eee4-4ae1-b399-b23d4813651b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:22.740822 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fff57-eee4-4ae1-b399-b23d4813651b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:22.758800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1301/2588] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:24:22.760276 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f4e92-2c11-4907-ade8-7f4757c40e54 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:22.770804 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f4e92-2c11-4907-ade8-7f4757c40e54 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:22.777454 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b36e98-77bd-4b62-86d5-57ad969e7f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:22.778121 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b36e98-77bd-4b62-86d5-57ad969e7f28 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:22.778408 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b36e98-77bd-4b62-86d5-57ad969e7f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:22.778675 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b36e98-77bd-4b62-86d5-57ad969e7f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:22.779348 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b36e98-77bd-4b62-86d5-57ad969e7f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:22.781352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b36e98-77bd-4b62-86d5-57ad969e7f28 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:22.813260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1288/2589] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:22 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:22.819020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fff57-eee4-4ae1-b399-b23d4813651b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:22.830114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fff57-eee4-4ae1-b399-b23d4813651b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:22.907415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a39e24-b2a1-4c89-abc3-f8f1c85a2f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:22.908662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a39e24-b2a1-4c89-abc3-f8f1c85a2f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:22.909011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a39e24-b2a1-4c89-abc3-f8f1c85a2f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:22.909297 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a39e24-b2a1-4c89-abc3-f8f1c85a2f15 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:22.910009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a39e24-b2a1-4c89-abc3-f8f1c85a2f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:22.912596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a39e24-b2a1-4c89-abc3-f8f1c85a2f15 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:22.947398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1302/2590] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:22 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:22.948699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b36e98-77bd-4b62-86d5-57ad969e7f28 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:22.959762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b36e98-77bd-4b62-86d5-57ad969e7f28 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:22.965048 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98d8f1-06ef-4915-b6bf-a4c755578db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:22.965728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98d8f1-06ef-4915-b6bf-a4c755578db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:22.966103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98d8f1-06ef-4915-b6bf-a4c755578db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:22.966258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98d8f1-06ef-4915-b6bf-a4c755578db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:22.966972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98d8f1-06ef-4915-b6bf-a4c755578db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:22.968667 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98d8f1-06ef-4915-b6bf-a4c755578db3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:22.992714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1289/2591] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:22.997123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a39e24-b2a1-4c89-abc3-f8f1c85a2f15 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:23.012388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a39e24-b2a1-4c89-abc3-f8f1c85a2f15 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:23.021097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9bc6f-377d-4eaa-ab63-dab0f7ecb320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:23.021987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9bc6f-377d-4eaa-ab63-dab0f7ecb320 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:23.022471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9bc6f-377d-4eaa-ab63-dab0f7ecb320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:23.023139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9bc6f-377d-4eaa-ab63-dab0f7ecb320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:23.024655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9bc6f-377d-4eaa-ab63-dab0f7ecb320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:23.027788 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9bc6f-377d-4eaa-ab63-dab0f7ecb320 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:23.052939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1303/2592] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:24:23.054686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98d8f1-06ef-4915-b6bf-a4c755578db3 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:23.069312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98d8f1-06ef-4915-b6bf-a4c755578db3 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:23.074406 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d8cc5-c963-4fde-950b-89f3d64b3021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:23.075127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d8cc5-c963-4fde-950b-89f3d64b3021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:23.075730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d8cc5-c963-4fde-950b-89f3d64b3021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:23.076020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d8cc5-c963-4fde-950b-89f3d64b3021 admin admin] PATH_INFO: `/v3/projects/f479f67711434d1ba7b78cbb742c933d/users/32ce6f6a69b547729df2fa52fd37e6cc/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:23.095300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d8cc5-c963-4fde-950b-89f3d64b3021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f479f67711434d1ba7b78cbb742c933d, user_id=32ce6f6a69b547729df2fa52fd37e6cc, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:23.098556 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d8cc5-c963-4fde-950b-89f3d64b3021 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:23.122998 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1290/2593] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:23 2022] PUT /identity/v3/projects/f479f67711434d1ba7b78cbb742c933d/users/32ce6f6a69b547729df2fa52fd37e6cc/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:23.138722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36f463-211f-4a06-ba55-360b1de3cab5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:23.139020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36f463-211f-4a06-ba55-360b1de3cab5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:23.139399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36f463-211f-4a06-ba55-360b1de3cab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:23.174756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bd36f463-211f-4a06-ba55-360b1de3cab5 None None] MFA Rules not processed for user `32ce6f6a69b547729df2fa52fd37e6cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:23.175995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bd36f463-211f-4a06-ba55-360b1de3cab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:23.271736 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1304/2594] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:23.288553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d8cc5-c963-4fde-950b-89f3d64b3021 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:23.290763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-985d8cc5-c963-4fde-950b-89f3d64b3021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:23.409574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d8cc5-c963-4fde-950b-89f3d64b3021 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:23.414702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f523895-e016-4246-8808-15718c405a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:23.415363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f523895-e016-4246-8808-15718c405a45 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:23.415642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f523895-e016-4246-8808-15718c405a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:23.415919 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f523895-e016-4246-8808-15718c405a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:23.426236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f523895-e016-4246-8808-15718c405a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:23.427863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f523895-e016-4246-8808-15718c405a45 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:23.439966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1291/2595] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:24:33.141734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36f463-211f-4a06-ba55-360b1de3cab5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:33.143754 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bd36f463-211f-4a06-ba55-360b1de3cab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:33.158652 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36f463-211f-4a06-ba55-360b1de3cab5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:33.163497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1662b4f-a498-487f-8da9-e1b334dee56b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:33.164162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1662b4f-a498-487f-8da9-e1b334dee56b service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:33.164435 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1662b4f-a498-487f-8da9-e1b334dee56b service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:33.164730 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1662b4f-a498-487f-8da9-e1b334dee56b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:33.167140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e1662b4f-a498-487f-8da9-e1b334dee56b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:33.193968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:33.286746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1662b4f-a498-487f-8da9-e1b334dee56b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:33.288376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1662b4f-a498-487f-8da9-e1b334dee56b service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:33.314453 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1305/2596] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:24:33.434305 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:35.224578 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f523895-e016-4246-8808-15718c405a45 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:35.226416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3f523895-e016-4246-8808-15718c405a45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:35.293292 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f523895-e016-4246-8808-15718c405a45 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:35.297360 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb20065-f0fd-455c-8cb1-520a43c4d9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:35.297954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb20065-f0fd-455c-8cb1-520a43c4d9fc service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:35.298317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb20065-f0fd-455c-8cb1-520a43c4d9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:35.298739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb20065-f0fd-455c-8cb1-520a43c4d9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:35.300684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5eb20065-f0fd-455c-8cb1-520a43c4d9fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:35.312725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb20065-f0fd-455c-8cb1-520a43c4d9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:35.314232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb20065-f0fd-455c-8cb1-520a43c4d9fc service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:35.323657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1292/2597] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:24:37.958350 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1662b4f-a498-487f-8da9-e1b334dee56b service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:37.960216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e1662b4f-a498-487f-8da9-e1b334dee56b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:37.973945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1662b4f-a498-487f-8da9-e1b334dee56b service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:37.978200 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03f1c0-76ed-400c-809f-c7ad1943e2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:37.978866 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03f1c0-76ed-400c-809f-c7ad1943e2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:37.979120 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03f1c0-76ed-400c-809f-c7ad1943e2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:37.979396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03f1c0-76ed-400c-809f-c7ad1943e2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:37.981935 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6d03f1c0-76ed-400c-809f-c7ad1943e2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:38.060241 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03f1c0-76ed-400c-809f-c7ad1943e2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:38.061743 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03f1c0-76ed-400c-809f-c7ad1943e2b5 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:38.073576 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1306/2598] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:24:38.639915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb20065-f0fd-455c-8cb1-520a43c4d9fc service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:38.650310 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb20065-f0fd-455c-8cb1-520a43c4d9fc service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:38.654705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480f3af-3955-4cd3-94a7-e961133489cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:38.655895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480f3af-3955-4cd3-94a7-e961133489cc service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:38.656165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480f3af-3955-4cd3-94a7-e961133489cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:38.656822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480f3af-3955-4cd3-94a7-e961133489cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:38.659131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4480f3af-3955-4cd3-94a7-e961133489cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:38.742618 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480f3af-3955-4cd3-94a7-e961133489cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:38.744100 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480f3af-3955-4cd3-94a7-e961133489cc service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:38.755221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1293/2599] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:24:43.233837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03f1c0-76ed-400c-809f-c7ad1943e2b5 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:43.235766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6d03f1c0-76ed-400c-809f-c7ad1943e2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:43.261229 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03f1c0-76ed-400c-809f-c7ad1943e2b5 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:43.269669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048432d1-fa6c-4e60-9d2d-72d63e5e7308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:43.270478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048432d1-fa6c-4e60-9d2d-72d63e5e7308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:43.271004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048432d1-fa6c-4e60-9d2d-72d63e5e7308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:43.271414 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048432d1-fa6c-4e60-9d2d-72d63e5e7308 admin admin] PATH_INFO: `/v3/users/096d0da1a0bc401c95bfbb8fc150a27b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:43.273142 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048432d1-fa6c-4e60-9d2d-72d63e5e7308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=096d0da1a0bc401c95bfbb8fc150a27b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:43.275663 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048432d1-fa6c-4e60-9d2d-72d63e5e7308 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:43.350402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-048432d1-fa6c-4e60-9d2d-72d63e5e7308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096d0da1a0bc401c95bfbb8fc150a27b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:43.351123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-048432d1-fa6c-4e60-9d2d-72d63e5e7308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096d0da1a0bc401c95bfbb8fc150a27b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:43.362018 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-048432d1-fa6c-4e60-9d2d-72d63e5e7308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096d0da1a0bc401c95bfbb8fc150a27b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:43.362762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-048432d1-fa6c-4e60-9d2d-72d63e5e7308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096d0da1a0bc401c95bfbb8fc150a27b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:43.381778 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-048432d1-fa6c-4e60-9d2d-72d63e5e7308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096d0da1a0bc401c95bfbb8fc150a27b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:43.393517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:43.402175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1307/2600] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:24:43 2022] DELETE /identity/v3/users/096d0da1a0bc401c95bfbb8fc150a27b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:43.638026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480f3af-3955-4cd3-94a7-e961133489cc service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:43.652500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480f3af-3955-4cd3-94a7-e961133489cc service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:43.722535 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74f89f-2bba-49d3-a369-e41ccb065dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:43.723249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74f89f-2bba-49d3-a369-e41ccb065dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:43.723595 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74f89f-2bba-49d3-a369-e41ccb065dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:43.723983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74f89f-2bba-49d3-a369-e41ccb065dd2 admin admin] PATH_INFO: `/v3/projects/61bf4a49abd8479f895e68d4954412b2` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:43.725492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74f89f-2bba-49d3-a369-e41ccb065dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61bf4a49abd8479f895e68d4954412b2)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:43.728214 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74f89f-2bba-49d3-a369-e41ccb065dd2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:43.774972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:43.786511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1b74f89f-2bba-49d3-a369-e41ccb065dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61bf4a49abd8479f895e68d4954412b2', 'request_id': 'req-1b74f89f-2bba-49d3-a369-e41ccb065dd2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:43.796048 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1b74f89f-2bba-49d3-a369-e41ccb065dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61bf4a49abd8479f895e68d4954412b2', 'request_id': 'req-1b74f89f-2bba-49d3-a369-e41ccb065dd2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:43.802711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1b74f89f-2bba-49d3-a369-e41ccb065dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61bf4a49abd8479f895e68d4954412b2', 'request_id': 'req-1b74f89f-2bba-49d3-a369-e41ccb065dd2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:43.816503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1b74f89f-2bba-49d3-a369-e41ccb065dd2 admin admin] The token cache is being invalidate because project 61bf4a49abd8479f895e68d4954412b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:24:43.816826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1b74f89f-2bba-49d3-a369-e41ccb065dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:43.817769 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1b74f89f-2bba-49d3-a369-e41ccb065dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:43.819373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1294/2601] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:24:43 2022] DELETE /identity/v3/projects/61bf4a49abd8479f895e68d4954412b2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:43.825605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb800630-1245-4fcf-94cc-48dae81392ad None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:43.825916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb800630-1245-4fcf-94cc-48dae81392ad None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:43.826141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb800630-1245-4fcf-94cc-48dae81392ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:43.848315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-eb800630-1245-4fcf-94cc-48dae81392ad None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:43.849700 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-eb800630-1245-4fcf-94cc-48dae81392ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:43.920061 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1308/2602] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:43.928724 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaff93f-2103-4d98-bbfd-af1ed483e37c None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:43.929064 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaff93f-2103-4d98-bbfd-af1ed483e37c None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:43.929275 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaff93f-2103-4d98-bbfd-af1ed483e37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:43.951415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-daaff93f-2103-4d98-bbfd-af1ed483e37c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:43.952683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-daaff93f-2103-4d98-bbfd-af1ed483e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:43.964754 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1295/2603] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:43.969640 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb800630-1245-4fcf-94cc-48dae81392ad None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:43.980775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb800630-1245-4fcf-94cc-48dae81392ad None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:43.986357 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78ce84-4c3c-444c-8e27-82c9fc575761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:43.987055 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78ce84-4c3c-444c-8e27-82c9fc575761 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:43.987373 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78ce84-4c3c-444c-8e27-82c9fc575761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:43.987685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78ce84-4c3c-444c-8e27-82c9fc575761 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:43.988480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78ce84-4c3c-444c-8e27-82c9fc575761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:24:43.988869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78ce84-4c3c-444c-8e27-82c9fc575761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:43.990759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78ce84-4c3c-444c-8e27-82c9fc575761 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:44.004950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1309/2604] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:24:44.010238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaff93f-2103-4d98-bbfd-af1ed483e37c None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:44.020853 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaff93f-2103-4d98-bbfd-af1ed483e37c None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:44.026840 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d3341-6e96-4cad-b558-e986b1fba3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:44.027550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d3341-6e96-4cad-b558-e986b1fba3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:44.027873 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d3341-6e96-4cad-b558-e986b1fba3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:44.028193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d3341-6e96-4cad-b558-e986b1fba3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:44.029045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d3341-6e96-4cad-b558-e986b1fba3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:44.031458 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d3341-6e96-4cad-b558-e986b1fba3e5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:44.078460 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1296/2605] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:44 2022] POST /identity/v3/projects => generated 399 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:44.085074 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78ce84-4c3c-444c-8e27-82c9fc575761 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:44.102201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78ce84-4c3c-444c-8e27-82c9fc575761 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:44.205649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85476ca9-ae1f-4df0-a601-ba4541cd9416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:44.206592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85476ca9-ae1f-4df0-a601-ba4541cd9416 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:44.207084 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85476ca9-ae1f-4df0-a601-ba4541cd9416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:44.207561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85476ca9-ae1f-4df0-a601-ba4541cd9416 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:44.208872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85476ca9-ae1f-4df0-a601-ba4541cd9416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:44.212686 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85476ca9-ae1f-4df0-a601-ba4541cd9416 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:44.244963 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1310/2606] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:44 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:44.249912 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d3341-6e96-4cad-b558-e986b1fba3e5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:44.272032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d3341-6e96-4cad-b558-e986b1fba3e5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:44.279785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dce308-8c8f-4dda-a3b7-0e1c4f570726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:44.280976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dce308-8c8f-4dda-a3b7-0e1c4f570726 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:44.281492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dce308-8c8f-4dda-a3b7-0e1c4f570726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:44.281949 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dce308-8c8f-4dda-a3b7-0e1c4f570726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:44.283433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dce308-8c8f-4dda-a3b7-0e1c4f570726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:44.286419 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dce308-8c8f-4dda-a3b7-0e1c4f570726 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:44.299733 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1297/2607] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:44.304493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85476ca9-ae1f-4df0-a601-ba4541cd9416 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:44.318233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85476ca9-ae1f-4df0-a601-ba4541cd9416 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:44.326896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6744cc8-e030-43c7-adb3-d99d3ade264d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:44.328048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6744cc8-e030-43c7-adb3-d99d3ade264d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:44.328541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6744cc8-e030-43c7-adb3-d99d3ade264d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:44.329096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6744cc8-e030-43c7-adb3-d99d3ade264d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:44.330473 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6744cc8-e030-43c7-adb3-d99d3ade264d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:44.333717 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6744cc8-e030-43c7-adb3-d99d3ade264d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:44.355538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1311/2608] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:24:44.360004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dce308-8c8f-4dda-a3b7-0e1c4f570726 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:44.373331 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dce308-8c8f-4dda-a3b7-0e1c4f570726 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:44.380161 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1621b-de0f-423c-9c89-d38c44a14940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:44.380825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1621b-de0f-423c-9c89-d38c44a14940 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:44.381326 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1621b-de0f-423c-9c89-d38c44a14940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:44.381703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1621b-de0f-423c-9c89-d38c44a14940 admin admin] PATH_INFO: `/v3/projects/8165f970a71e4082ac10deab46e602da/users/1085342cf7994aaf9bd152a450db0163/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:44.405506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1621b-de0f-423c-9c89-d38c44a14940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8165f970a71e4082ac10deab46e602da, user_id=1085342cf7994aaf9bd152a450db0163, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:44.409788 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1621b-de0f-423c-9c89-d38c44a14940 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:44.435425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1298/2609] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:44 2022] PUT /identity/v3/projects/8165f970a71e4082ac10deab46e602da/users/1085342cf7994aaf9bd152a450db0163/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:44.454957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf112e65-b3c2-4838-8bc4-1e4bf85e0e5f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:44.455289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf112e65-b3c2-4838-8bc4-1e4bf85e0e5f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:44.455493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf112e65-b3c2-4838-8bc4-1e4bf85e0e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:44.500462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-bf112e65-b3c2-4838-8bc4-1e4bf85e0e5f None None] MFA Rules not processed for user `1085342cf7994aaf9bd152a450db0163`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:44.502769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bf112e65-b3c2-4838-8bc4-1e4bf85e0e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:44.608734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:44.623020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1312/2610] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:44.627868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1621b-de0f-423c-9c89-d38c44a14940 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:44.713017 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1621b-de0f-423c-9c89-d38c44a14940 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:44.718467 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4f893-24ae-420e-8061-dae73734aafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:44.719270 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4f893-24ae-420e-8061-dae73734aafd admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:44.719619 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4f893-24ae-420e-8061-dae73734aafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:44.719964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4f893-24ae-420e-8061-dae73734aafd admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:44.720717 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4f893-24ae-420e-8061-dae73734aafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:44.723071 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4f893-24ae-420e-8061-dae73734aafd admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:44.769636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1299/2611] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:44 2022] POST /identity/v3/projects => generated 401 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:44.776264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf112e65-b3c2-4838-8bc4-1e4bf85e0e5f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:44.791969 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf112e65-b3c2-4838-8bc4-1e4bf85e0e5f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:44.882934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565afef1-b0b8-4ca6-8197-1a05097785b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:44.883941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565afef1-b0b8-4ca6-8197-1a05097785b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:44.884236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565afef1-b0b8-4ca6-8197-1a05097785b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:44.884494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565afef1-b0b8-4ca6-8197-1a05097785b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:44.885250 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565afef1-b0b8-4ca6-8197-1a05097785b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:44.887252 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565afef1-b0b8-4ca6-8197-1a05097785b8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:44.915247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1313/2612] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:44 2022] POST /identity/v3/users => generated 307 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:44.916855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4f893-24ae-420e-8061-dae73734aafd admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:44.930621 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4f893-24ae-420e-8061-dae73734aafd admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:44.936136 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba3d5d-b52c-4acd-80b4-5c1b83e1659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:44.936977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba3d5d-b52c-4acd-80b4-5c1b83e1659d admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:44.937327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba3d5d-b52c-4acd-80b4-5c1b83e1659d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:44.937663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba3d5d-b52c-4acd-80b4-5c1b83e1659d admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:44.938504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba3d5d-b52c-4acd-80b4-5c1b83e1659d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:44.940554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba3d5d-b52c-4acd-80b4-5c1b83e1659d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:44.953585 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1300/2613] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:24:44.960392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565afef1-b0b8-4ca6-8197-1a05097785b8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:44.976572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565afef1-b0b8-4ca6-8197-1a05097785b8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:44.982897 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece11a7-c61d-4408-9d82-13bce0713a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:44.983886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece11a7-c61d-4408-9d82-13bce0713a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:44.984156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece11a7-c61d-4408-9d82-13bce0713a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:44.984439 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece11a7-c61d-4408-9d82-13bce0713a82 admin admin] PATH_INFO: `/v3/projects/5b816c813a764e84adca34439503e29a/users/02c51a205f064b45bb4ec5686041bce5/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:45.003668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece11a7-c61d-4408-9d82-13bce0713a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b816c813a764e84adca34439503e29a, user_id=02c51a205f064b45bb4ec5686041bce5, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:45.006481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece11a7-c61d-4408-9d82-13bce0713a82 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:45.022613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1314/2614] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:44 2022] PUT /identity/v3/projects/5b816c813a764e84adca34439503e29a/users/02c51a205f064b45bb4ec5686041bce5/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:45.028511 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba3d5d-b52c-4acd-80b4-5c1b83e1659d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:45.046987 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba3d5d-b52c-4acd-80b4-5c1b83e1659d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:45.093048 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:45.136599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a5ab3-a48d-4bee-9895-739ce17d58a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:45.137651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a5ab3-a48d-4bee-9895-739ce17d58a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:45.138056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a5ab3-a48d-4bee-9895-739ce17d58a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:45.138367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a5ab3-a48d-4bee-9895-739ce17d58a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:45.139137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a5ab3-a48d-4bee-9895-739ce17d58a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:45.141110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a5ab3-a48d-4bee-9895-739ce17d58a9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:45.155842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1301/2615] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:24:45.160808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece11a7-c61d-4408-9d82-13bce0713a82 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:45.179744 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece11a7-c61d-4408-9d82-13bce0713a82 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:45.185664 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90717ed0-29e9-44d2-b4c8-f0c123398b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:45.186354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90717ed0-29e9-44d2-b4c8-f0c123398b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:45.186764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90717ed0-29e9-44d2-b4c8-f0c123398b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:45.186922 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90717ed0-29e9-44d2-b4c8-f0c123398b14 admin admin] PATH_INFO: `/v3/projects/5b816c813a764e84adca34439503e29a/users/02c51a205f064b45bb4ec5686041bce5/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:45.190026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90717ed0-29e9-44d2-b4c8-f0c123398b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b816c813a764e84adca34439503e29a, user_id=02c51a205f064b45bb4ec5686041bce5, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:45.195770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90717ed0-29e9-44d2-b4c8-f0c123398b14 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:45.216011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1315/2616] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:45 2022] PUT /identity/v3/projects/5b816c813a764e84adca34439503e29a/users/02c51a205f064b45bb4ec5686041bce5/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:45.235419 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ff3d6-a2c4-4dd2-a5ef-da569032f517 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:45.235796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ff3d6-a2c4-4dd2-a5ef-da569032f517 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:45.236271 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ff3d6-a2c4-4dd2-a5ef-da569032f517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:45.286811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-105ff3d6-a2c4-4dd2-a5ef-da569032f517 None None] MFA Rules not processed for user `02c51a205f064b45bb4ec5686041bce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:45.288135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-105ff3d6-a2c4-4dd2-a5ef-da569032f517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:45.389600 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1302/2617] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:45 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:45.402850 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90717ed0-29e9-44d2-b4c8-f0c123398b14 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:45.405876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-90717ed0-29e9-44d2-b4c8-f0c123398b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:45.518872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90717ed0-29e9-44d2-b4c8-f0c123398b14 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:45.526724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06eb52-cd9e-4fdb-ad71-5f98be73ac9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:45.527940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06eb52-cd9e-4fdb-ad71-5f98be73ac9a service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:45.528449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06eb52-cd9e-4fdb-ad71-5f98be73ac9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:45.529000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06eb52-cd9e-4fdb-ad71-5f98be73ac9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:45.546832 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06eb52-cd9e-4fdb-ad71-5f98be73ac9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:45.549735 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06eb52-cd9e-4fdb-ad71-5f98be73ac9a service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:45.570211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1316/2618] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:45 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:24:45.676491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ff3d6-a2c4-4dd2-a5ef-da569032f517 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:45.687068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ff3d6-a2c4-4dd2-a5ef-da569032f517 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:45.690775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e394a9-798e-431b-b1e6-85a58632edc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:45.691436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e394a9-798e-431b-b1e6-85a58632edc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:45.691701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e394a9-798e-431b-b1e6-85a58632edc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:45.691977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e394a9-798e-431b-b1e6-85a58632edc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:45.758813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e394a9-798e-431b-b1e6-85a58632edc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:45.760176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e394a9-798e-431b-b1e6-85a58632edc4 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:45.770291 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1303/2619] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:24:49.335329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06eb52-cd9e-4fdb-ad71-5f98be73ac9a service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:49.337725 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2d06eb52-cd9e-4fdb-ad71-5f98be73ac9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:49.410702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:49.430477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06eb52-cd9e-4fdb-ad71-5f98be73ac9a service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:49.435661 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:49.436385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:49.436690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:49.437078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] PATH_INFO: `/v3/users/32ce6f6a69b547729df2fa52fd37e6cc` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:49.438457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ce6f6a69b547729df2fa52fd37e6cc)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:49.440544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:49.507826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ce6f6a69b547729df2fa52fd37e6cc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:49.509158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ce6f6a69b547729df2fa52fd37e6cc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:49.519814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ce6f6a69b547729df2fa52fd37e6cc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:49.520521 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ce6f6a69b547729df2fa52fd37e6cc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:49.538828 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ce6f6a69b547729df2fa52fd37e6cc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:49.554460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1317/2620] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:24:49 2022] DELETE /identity/v3/users/32ce6f6a69b547729df2fa52fd37e6cc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:49.558714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c62e82-39ec-44e3-95c9-ddbd63a81ca3 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:49.559611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c62e82-39ec-44e3-95c9-ddbd63a81ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:49.559611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c62e82-39ec-44e3-95c9-ddbd63a81ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:49.581978 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-47c62e82-39ec-44e3-95c9-ddbd63a81ca3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:49.583466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-47c62e82-39ec-44e3-95c9-ddbd63a81ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:49.660749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:49.677792 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1304/2621] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:49.689704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:49.692269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:49.794983 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800fd08-b3cf-4a23-ac96-660b97557ccc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:49.799143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b09ec-645a-407e-8614-07e83bfb3115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:49.799934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b09ec-645a-407e-8614-07e83bfb3115 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:49.800312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b09ec-645a-407e-8614-07e83bfb3115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:49.800685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b09ec-645a-407e-8614-07e83bfb3115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:49.814165 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b09ec-645a-407e-8614-07e83bfb3115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:49.815888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b09ec-645a-407e-8614-07e83bfb3115 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:49.833881 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1318/2622] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:24:50.176747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c62e82-39ec-44e3-95c9-ddbd63a81ca3 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:50.178991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-47c62e82-39ec-44e3-95c9-ddbd63a81ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:50.195394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c62e82-39ec-44e3-95c9-ddbd63a81ca3 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:50.204464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726838c-e303-4a9c-abfe-043b4f391209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:50.206236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726838c-e303-4a9c-abfe-043b4f391209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:50.206750 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726838c-e303-4a9c-abfe-043b4f391209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:50.207256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726838c-e303-4a9c-abfe-043b4f391209 admin admin] PATH_INFO: `/v3/users/1085342cf7994aaf9bd152a450db0163` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:50.212849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726838c-e303-4a9c-abfe-043b4f391209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1085342cf7994aaf9bd152a450db0163)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:50.213214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b09ec-645a-407e-8614-07e83bfb3115 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:50.215494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-676b09ec-645a-407e-8614-07e83bfb3115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:50.216859 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726838c-e303-4a9c-abfe-043b4f391209 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:50.238128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b09ec-645a-407e-8614-07e83bfb3115 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:50.245451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7056dd-541c-463f-8c96-2a98bea8a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:50.246653 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7056dd-541c-463f-8c96-2a98bea8a6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:50.246917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7056dd-541c-463f-8c96-2a98bea8a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:50.247508 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7056dd-541c-463f-8c96-2a98bea8a6df admin admin] PATH_INFO: `/v3/projects/f479f67711434d1ba7b78cbb742c933d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:50.265321 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7056dd-541c-463f-8c96-2a98bea8a6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=f479f67711434d1ba7b78cbb742c933d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:50.268375 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7056dd-541c-463f-8c96-2a98bea8a6df admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:50.314578 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b726838c-e303-4a9c-abfe-043b4f391209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1085342cf7994aaf9bd152a450db0163'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:50.326274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b726838c-e303-4a9c-abfe-043b4f391209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1085342cf7994aaf9bd152a450db0163'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:50.339869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b726838c-e303-4a9c-abfe-043b4f391209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1085342cf7994aaf9bd152a450db0163'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:50.340731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b726838c-e303-4a9c-abfe-043b4f391209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1085342cf7994aaf9bd152a450db0163'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:50.352268 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed7056dd-541c-463f-8c96-2a98bea8a6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f479f67711434d1ba7b78cbb742c933d', 'request_id': 'req-ed7056dd-541c-463f-8c96-2a98bea8a6df'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:50.358393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-b726838c-e303-4a9c-abfe-043b4f391209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1085342cf7994aaf9bd152a450db0163'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:50.363205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed7056dd-541c-463f-8c96-2a98bea8a6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f479f67711434d1ba7b78cbb742c933d', 'request_id': 'req-ed7056dd-541c-463f-8c96-2a98bea8a6df'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:50.369193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1305/2623] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:24:50 2022] DELETE /identity/v3/users/1085342cf7994aaf9bd152a450db0163 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:24:50.373376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed7056dd-541c-463f-8c96-2a98bea8a6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f479f67711434d1ba7b78cbb742c933d', 'request_id': 'req-ed7056dd-541c-463f-8c96-2a98bea8a6df'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:50.374082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5def33-193c-4b79-848f-366132788ca0 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:50.374374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5def33-193c-4b79-848f-366132788ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:50.374679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5def33-193c-4b79-848f-366132788ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:50.375911 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:50.399308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed7056dd-541c-463f-8c96-2a98bea8a6df admin admin] The token cache is being invalidate because project f479f67711434d1ba7b78cbb742c933d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:24:50.399936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed7056dd-541c-463f-8c96-2a98bea8a6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:50.401245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed7056dd-541c-463f-8c96-2a98bea8a6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:50.401574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ba5def33-193c-4b79-848f-366132788ca0 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:50.403375 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ba5def33-193c-4b79-848f-366132788ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:50.403596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1319/2624] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:24:50 2022] DELETE /identity/v3/projects/f479f67711434d1ba7b78cbb742c933d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:24:50.408778 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5e6b9-a797-4312-96a6-c1c9f7dcd9ec None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:50.409107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5e6b9-a797-4312-96a6-c1c9f7dcd9ec None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:50.409389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5e6b9-a797-4312-96a6-c1c9f7dcd9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:50.435884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-40a5e6b9-a797-4312-96a6-c1c9f7dcd9ec None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:50.437407 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-40a5e6b9-a797-4312-96a6-c1c9f7dcd9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:50.491845 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1306/2625] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:50.505168 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5def33-193c-4b79-848f-366132788ca0 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:50.506865 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ba5def33-193c-4b79-848f-366132788ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:50.535670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1320/2626] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:50.542421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2cdc8-b692-4dcf-ab45-b13dbcaa8831 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:50.543019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2cdc8-b692-4dcf-ab45-b13dbcaa8831 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:50.543575 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2cdc8-b692-4dcf-ab45-b13dbcaa8831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:50.576106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cde2cdc8-b692-4dcf-ab45-b13dbcaa8831 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:50.579063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cde2cdc8-b692-4dcf-ab45-b13dbcaa8831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:50.593330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1321/2627] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:50.598133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2cdc8-b692-4dcf-ab45-b13dbcaa8831 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:50.598784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5def33-193c-4b79-848f-366132788ca0 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:50.603041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77753f47-a765-412b-87e7-c1f15255eca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:50.603690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77753f47-a765-412b-87e7-c1f15255eca4 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:50.603948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77753f47-a765-412b-87e7-c1f15255eca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:50.604226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77753f47-a765-412b-87e7-c1f15255eca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:50.610589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2cdc8-b692-4dcf-ab45-b13dbcaa8831 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:50.615790 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77753f47-a765-412b-87e7-c1f15255eca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:50.617575 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77753f47-a765-412b-87e7-c1f15255eca4 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:50.618544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8dceb-1e32-4986-9d9e-d52803d0c225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:50.619712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8dceb-1e32-4986-9d9e-d52803d0c225 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:50.620311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8dceb-1e32-4986-9d9e-d52803d0c225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:50.620936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8dceb-1e32-4986-9d9e-d52803d0c225 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:50.622709 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8dceb-1e32-4986-9d9e-d52803d0c225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:24:50.624345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8dceb-1e32-4986-9d9e-d52803d0c225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:50.627705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8dceb-1e32-4986-9d9e-d52803d0c225 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:50.628885 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1307/2628] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:24:50.654475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1322/2629] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:24:50.656118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77753f47-a765-412b-87e7-c1f15255eca4 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:50.669636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77753f47-a765-412b-87e7-c1f15255eca4 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:50.677875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a98d2d-5e29-4ad2-a94c-56da748cb2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:50.679205 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98d2d-5e29-4ad2-a94c-56da748cb2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:50.679665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98d2d-5e29-4ad2-a94c-56da748cb2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:50.680109 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a98d2d-5e29-4ad2-a94c-56da748cb2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:50.681651 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a98d2d-5e29-4ad2-a94c-56da748cb2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:50.685509 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a98d2d-5e29-4ad2-a94c-56da748cb2e3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:50.709537 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:50.740033 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1308/2630] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:50 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:24:50.751531 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8dceb-1e32-4986-9d9e-d52803d0c225 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:50.764716 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8dceb-1e32-4986-9d9e-d52803d0c225 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:50.843065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea6a07-93e0-49a5-a9db-88a483fc3a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:50.843720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea6a07-93e0-49a5-a9db-88a483fc3a05 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:50.844000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea6a07-93e0-49a5-a9db-88a483fc3a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:50.844279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea6a07-93e0-49a5-a9db-88a483fc3a05 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:50.845031 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea6a07-93e0-49a5-a9db-88a483fc3a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:50.847125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea6a07-93e0-49a5-a9db-88a483fc3a05 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:50.884491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1323/2631] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:50 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:24:50.890262 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a98d2d-5e29-4ad2-a94c-56da748cb2e3 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:50.902303 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a98d2d-5e29-4ad2-a94c-56da748cb2e3 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:50.907545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6436c9f-e3c3-44df-9d7d-4445c10b64ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:50.908219 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436c9f-e3c3-44df-9d7d-4445c10b64ae admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:50.908498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436c9f-e3c3-44df-9d7d-4445c10b64ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:50.908776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6436c9f-e3c3-44df-9d7d-4445c10b64ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:50.909543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6436c9f-e3c3-44df-9d7d-4445c10b64ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:50.911281 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6436c9f-e3c3-44df-9d7d-4445c10b64ae admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:50.923705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1309/2632] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:50.928469 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea6a07-93e0-49a5-a9db-88a483fc3a05 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:50.943660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea6a07-93e0-49a5-a9db-88a483fc3a05 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:50.953156 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f18055-7513-4186-b92c-d0e610896e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:50.954149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f18055-7513-4186-b92c-d0e610896e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:50.954714 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f18055-7513-4186-b92c-d0e610896e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:50.955603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f18055-7513-4186-b92c-d0e610896e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:50.957030 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f18055-7513-4186-b92c-d0e610896e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:50.960755 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f18055-7513-4186-b92c-d0e610896e18 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:50.979489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1324/2633] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:24:50.984105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6436c9f-e3c3-44df-9d7d-4445c10b64ae admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:50.999232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6436c9f-e3c3-44df-9d7d-4445c10b64ae admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:51.006362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab7e33-98c7-4e8d-bd58-d8311fc7b562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:51.007383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab7e33-98c7-4e8d-bd58-d8311fc7b562 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:51.008747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab7e33-98c7-4e8d-bd58-d8311fc7b562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:51.009052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab7e33-98c7-4e8d-bd58-d8311fc7b562 admin admin] PATH_INFO: `/v3/projects/0d1378d126e6441f9d2fb535f68a6e7f/users/14c59b6365ac4977b8fee0ca340f6642/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:51.028609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab7e33-98c7-4e8d-bd58-d8311fc7b562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1378d126e6441f9d2fb535f68a6e7f, user_id=14c59b6365ac4977b8fee0ca340f6642, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:51.031588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab7e33-98c7-4e8d-bd58-d8311fc7b562 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:51.048236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1310/2634] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:50 2022] PUT /identity/v3/projects/0d1378d126e6441f9d2fb535f68a6e7f/users/14c59b6365ac4977b8fee0ca340f6642/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:51.059080 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074f0b-4bb1-41b4-8a1c-431b4d057b37 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:51.059385 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074f0b-4bb1-41b4-8a1c-431b4d057b37 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:51.059631 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01074f0b-4bb1-41b4-8a1c-431b4d057b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:51.096279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-01074f0b-4bb1-41b4-8a1c-431b4d057b37 None None] MFA Rules not processed for user `14c59b6365ac4977b8fee0ca340f6642`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:51.097783 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-01074f0b-4bb1-41b4-8a1c-431b4d057b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:51.115213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab7e33-98c7-4e8d-bd58-d8311fc7b562 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:51.118176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-08ab7e33-98c7-4e8d-bd58-d8311fc7b562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:51.170456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:51.200097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1325/2635] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:51.211856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01074f0b-4bb1-41b4-8a1c-431b4d057b37 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:51.215451 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-01074f0b-4bb1-41b4-8a1c-431b4d057b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:51.218613 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab7e33-98c7-4e8d-bd58-d8311fc7b562 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:51.224420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:51.225145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:51.225427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:51.225703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] PATH_INFO: `/v3/projects/8165f970a71e4082ac10deab46e602da` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:51.227295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8165f970a71e4082ac10deab46e602da)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:51.229499 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:51.303529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8165f970a71e4082ac10deab46e602da', 'request_id': 'req-dea99cba-8f0e-461d-95a9-05394ae42122'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:51.315369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01074f0b-4bb1-41b4-8a1c-431b4d057b37 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:51.315769 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8165f970a71e4082ac10deab46e602da', 'request_id': 'req-dea99cba-8f0e-461d-95a9-05394ae42122'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:51.324327 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8165f970a71e4082ac10deab46e602da', 'request_id': 'req-dea99cba-8f0e-461d-95a9-05394ae42122'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:51.339237 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] The token cache is being invalidate because project 8165f970a71e4082ac10deab46e602da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:24:51.339604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:51.340637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:51.343116 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1311/2636] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:24:51 2022] DELETE /identity/v3/projects/8165f970a71e4082ac10deab46e602da => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:24:51.348289 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:51.350582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:51.405352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21756ba-f1f8-4658-9aa9-db4bd2859b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:51.406368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21756ba-f1f8-4658-9aa9-db4bd2859b54 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:51.406595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21756ba-f1f8-4658-9aa9-db4bd2859b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:51.407008 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21756ba-f1f8-4658-9aa9-db4bd2859b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:51.409556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e21756ba-f1f8-4658-9aa9-db4bd2859b54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:51.420452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:51.448538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea99cba-8f0e-461d-95a9-05394ae42122 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:51.454493 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76343dd6-91ef-4493-a9fb-f36daec3c450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:51.455293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76343dd6-91ef-4493-a9fb-f36daec3c450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:51.455630 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76343dd6-91ef-4493-a9fb-f36daec3c450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:51.455967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76343dd6-91ef-4493-a9fb-f36daec3c450 admin admin] PATH_INFO: `/v3/users/02c51a205f064b45bb4ec5686041bce5` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:51.457643 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76343dd6-91ef-4493-a9fb-f36daec3c450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c51a205f064b45bb4ec5686041bce5)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:51.459952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76343dd6-91ef-4493-a9fb-f36daec3c450 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:51.499240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21756ba-f1f8-4658-9aa9-db4bd2859b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:51.501188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21756ba-f1f8-4658-9aa9-db4bd2859b54 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:51.516128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1326/2637] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:24:51.528635 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-76343dd6-91ef-4493-a9fb-f36daec3c450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c51a205f064b45bb4ec5686041bce5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:51.537858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-76343dd6-91ef-4493-a9fb-f36daec3c450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c51a205f064b45bb4ec5686041bce5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:51.547984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-76343dd6-91ef-4493-a9fb-f36daec3c450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c51a205f064b45bb4ec5686041bce5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:51.548800 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-76343dd6-91ef-4493-a9fb-f36daec3c450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c51a205f064b45bb4ec5686041bce5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:51.567003 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-76343dd6-91ef-4493-a9fb-f36daec3c450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c51a205f064b45bb4ec5686041bce5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:51.574519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1312/2638] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:24:51 2022] DELETE /identity/v3/users/02c51a205f064b45bb4ec5686041bce5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:51.996851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21756ba-f1f8-4658-9aa9-db4bd2859b54 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:52.014446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21756ba-f1f8-4658-9aa9-db4bd2859b54 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:52.078004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:52.088461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a9158-2962-46e0-b2b7-457e843b4ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:52.089211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9158-2962-46e0-b2b7-457e843b4ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:52.089492 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9158-2962-46e0-b2b7-457e843b4ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:52.089767 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9158-2962-46e0-b2b7-457e843b4ba1 admin admin] PATH_INFO: `/v3/projects/5b816c813a764e84adca34439503e29a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:52.091112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a9158-2962-46e0-b2b7-457e843b4ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b816c813a764e84adca34439503e29a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:52.093137 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a9158-2962-46e0-b2b7-457e843b4ba1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:52.149094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ec0a9158-2962-46e0-b2b7-457e843b4ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b816c813a764e84adca34439503e29a', 'request_id': 'req-ec0a9158-2962-46e0-b2b7-457e843b4ba1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:52.159885 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ec0a9158-2962-46e0-b2b7-457e843b4ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b816c813a764e84adca34439503e29a', 'request_id': 'req-ec0a9158-2962-46e0-b2b7-457e843b4ba1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:52.168629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ec0a9158-2962-46e0-b2b7-457e843b4ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b816c813a764e84adca34439503e29a', 'request_id': 'req-ec0a9158-2962-46e0-b2b7-457e843b4ba1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:52.182525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ec0a9158-2962-46e0-b2b7-457e843b4ba1 admin admin] The token cache is being invalidate because project 5b816c813a764e84adca34439503e29a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:24:52.182966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ec0a9158-2962-46e0-b2b7-457e843b4ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:52.183979 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ec0a9158-2962-46e0-b2b7-457e843b4ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:52.186252 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1327/2639] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:24:51 2022] DELETE /identity/v3/projects/5b816c813a764e84adca34439503e29a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:52.191504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c48949-f16c-4e76-a3d8-6980d07be53a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:52.192206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c48949-f16c-4e76-a3d8-6980d07be53a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:52.192206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c48949-f16c-4e76-a3d8-6980d07be53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:52.214587 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d7c48949-f16c-4e76-a3d8-6980d07be53a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:52.215890 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d7c48949-f16c-4e76-a3d8-6980d07be53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:52.295080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1313/2640] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:52.303690 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6ea5e-2b05-4b39-9203-f3bc3ef5d9d9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:52.304019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6ea5e-2b05-4b39-9203-f3bc3ef5d9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:52.304247 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6ea5e-2b05-4b39-9203-f3bc3ef5d9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:52.326491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cec6ea5e-2b05-4b39-9203-f3bc3ef5d9d9 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:52.327780 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cec6ea5e-2b05-4b39-9203-f3bc3ef5d9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:52.336576 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1328/2641] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:52.341184 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c48949-f16c-4e76-a3d8-6980d07be53a None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:52.351811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c48949-f16c-4e76-a3d8-6980d07be53a None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:52.356843 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75834855-793a-415d-b11d-7ef5b14a21c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:52.357525 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75834855-793a-415d-b11d-7ef5b14a21c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:52.357802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75834855-793a-415d-b11d-7ef5b14a21c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:52.358073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75834855-793a-415d-b11d-7ef5b14a21c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:52.358810 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75834855-793a-415d-b11d-7ef5b14a21c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:24:52.359113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75834855-793a-415d-b11d-7ef5b14a21c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:52.360784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75834855-793a-415d-b11d-7ef5b14a21c4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:52.375292 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1314/2642] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:24:52.379831 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6ea5e-2b05-4b39-9203-f3bc3ef5d9d9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:52.391115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6ea5e-2b05-4b39-9203-f3bc3ef5d9d9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:52.397379 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f65df8-5800-4a39-a800-7190ce49c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:52.398044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f65df8-5800-4a39-a800-7190ce49c89f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:52.398322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f65df8-5800-4a39-a800-7190ce49c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:52.398597 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f65df8-5800-4a39-a800-7190ce49c89f admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:52.399307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f65df8-5800-4a39-a800-7190ce49c89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:52.401343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f65df8-5800-4a39-a800-7190ce49c89f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:52.437874 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1329/2643] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:52 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:52.443030 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75834855-793a-415d-b11d-7ef5b14a21c4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:52.459917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75834855-793a-415d-b11d-7ef5b14a21c4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:52.544196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:52.560715 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083742-b630-4702-af19-327167b5ef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:52.561795 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083742-b630-4702-af19-327167b5ef0d admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:52.562240 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083742-b630-4702-af19-327167b5ef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:52.562719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083742-b630-4702-af19-327167b5ef0d admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:52.563848 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65083742-b630-4702-af19-327167b5ef0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:52.567157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65083742-b630-4702-af19-327167b5ef0d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:52.593824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1315/2644] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:52 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:52.598447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f65df8-5800-4a39-a800-7190ce49c89f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:52.611261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f65df8-5800-4a39-a800-7190ce49c89f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:52.618270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba45d12-7d7d-4285-919d-eb72b7c80d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:52.619104 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba45d12-7d7d-4285-919d-eb72b7c80d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:52.619511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba45d12-7d7d-4285-919d-eb72b7c80d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:52.619824 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba45d12-7d7d-4285-919d-eb72b7c80d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:52.620579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba45d12-7d7d-4285-919d-eb72b7c80d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:52.622289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba45d12-7d7d-4285-919d-eb72b7c80d83 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:52.635783 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1330/2645] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:52.640446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083742-b630-4702-af19-327167b5ef0d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:52.653239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083742-b630-4702-af19-327167b5ef0d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:52.659293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfecd2-4e3e-4868-a6cd-4a134520d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:52.660006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfecd2-4e3e-4868-a6cd-4a134520d22f admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:52.660425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfecd2-4e3e-4868-a6cd-4a134520d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:52.660755 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfecd2-4e3e-4868-a6cd-4a134520d22f admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:52.661743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfecd2-4e3e-4868-a6cd-4a134520d22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:52.663610 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfecd2-4e3e-4868-a6cd-4a134520d22f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:52.677131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1316/2646] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:52.682245 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba45d12-7d7d-4285-919d-eb72b7c80d83 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:52.694534 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba45d12-7d7d-4285-919d-eb72b7c80d83 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:52.700782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a794f-b195-469b-b951-6979bf7f6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:52.701578 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a794f-b195-469b-b951-6979bf7f6db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:52.701867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a794f-b195-469b-b951-6979bf7f6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:52.702148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a794f-b195-469b-b951-6979bf7f6db8 admin admin] PATH_INFO: `/v3/projects/023f4ea7709844e89b63890ed9847ebd/users/1150685ff1a4440d8e9c5731cc04f088/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:52.721459 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a794f-b195-469b-b951-6979bf7f6db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023f4ea7709844e89b63890ed9847ebd, user_id=1150685ff1a4440d8e9c5731cc04f088, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:52.724352 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a794f-b195-469b-b951-6979bf7f6db8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:52.743179 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1331/2647] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:52 2022] PUT /identity/v3/projects/023f4ea7709844e89b63890ed9847ebd/users/1150685ff1a4440d8e9c5731cc04f088/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:24:52.757967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3aab3d-df74-4d9e-b8d8-8bd91ef04bda None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:52.758825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3aab3d-df74-4d9e-b8d8-8bd91ef04bda None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:52.759268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3aab3d-df74-4d9e-b8d8-8bd91ef04bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:52.806612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-aa3aab3d-df74-4d9e-b8d8-8bd91ef04bda None None] MFA Rules not processed for user `1150685ff1a4440d8e9c5731cc04f088`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:52.808836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-aa3aab3d-df74-4d9e-b8d8-8bd91ef04bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:52.894454 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1317/2648] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:52.899880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a794f-b195-469b-b951-6979bf7f6db8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:53.015509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a794f-b195-469b-b951-6979bf7f6db8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:53.021861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8d78b-f6c5-445b-b212-2d1ba3810512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:53.022634 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8d78b-f6c5-445b-b212-2d1ba3810512 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:53.023019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8d78b-f6c5-445b-b212-2d1ba3810512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:53.023475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8d78b-f6c5-445b-b212-2d1ba3810512 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:53.024412 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8d78b-f6c5-445b-b212-2d1ba3810512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:53.027667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8d78b-f6c5-445b-b212-2d1ba3810512 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:53.070002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1332/2649] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:52 2022] POST /identity/v3/projects => generated 389 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:53.071514 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3aab3d-df74-4d9e-b8d8-8bd91ef04bda None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:53.088944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3aab3d-df74-4d9e-b8d8-8bd91ef04bda None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:53.180664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c994c-cb6e-4a27-abe7-15b396cb8b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:53.181492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c994c-cb6e-4a27-abe7-15b396cb8b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:53.181882 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c994c-cb6e-4a27-abe7-15b396cb8b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:53.182370 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c994c-cb6e-4a27-abe7-15b396cb8b52 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:53.183407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c994c-cb6e-4a27-abe7-15b396cb8b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:53.185888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c994c-cb6e-4a27-abe7-15b396cb8b52 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:53.216461 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1318/2650] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:53 2022] POST /identity/v3/users => generated 301 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:53.221704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8d78b-f6c5-445b-b212-2d1ba3810512 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:53.229787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:53.236484 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8d78b-f6c5-445b-b212-2d1ba3810512 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:53.245480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde34092-4d61-4a5f-a82d-fceb6b7cf135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:53.246648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde34092-4d61-4a5f-a82d-fceb6b7cf135 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:53.247480 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde34092-4d61-4a5f-a82d-fceb6b7cf135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:53.248606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde34092-4d61-4a5f-a82d-fceb6b7cf135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:53.249856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde34092-4d61-4a5f-a82d-fceb6b7cf135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:53.252179 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde34092-4d61-4a5f-a82d-fceb6b7cf135 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:53.270939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1333/2651] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:24:53.276061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c994c-cb6e-4a27-abe7-15b396cb8b52 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:53.293155 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c994c-cb6e-4a27-abe7-15b396cb8b52 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:53.299709 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c5b90-4410-4f24-b090-f6c57d5d7ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:53.301233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5b90-4410-4f24-b090-f6c57d5d7ace admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:53.301711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5b90-4410-4f24-b090-f6c57d5d7ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:53.302312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5b90-4410-4f24-b090-f6c57d5d7ace admin admin] PATH_INFO: `/v3/projects/f1d6eb4d44874ce0ad264eb5b889be37/users/3ad98d778e3643d284e660fe03edf38f/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:53.320933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c5b90-4410-4f24-b090-f6c57d5d7ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d6eb4d44874ce0ad264eb5b889be37, user_id=3ad98d778e3643d284e660fe03edf38f, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:53.323698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c5b90-4410-4f24-b090-f6c57d5d7ace admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:53.348060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1319/2652] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:53 2022] PUT /identity/v3/projects/f1d6eb4d44874ce0ad264eb5b889be37/users/3ad98d778e3643d284e660fe03edf38f/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:53.354597 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde34092-4d61-4a5f-a82d-fceb6b7cf135 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:53.373440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde34092-4d61-4a5f-a82d-fceb6b7cf135 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:53.468344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3e180-33a5-4da4-b3d1-716a9f63dbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:53.469491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3e180-33a5-4da4-b3d1-716a9f63dbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:53.469841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3e180-33a5-4da4-b3d1-716a9f63dbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:53.470324 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3e180-33a5-4da4-b3d1-716a9f63dbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:53.471206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3e180-33a5-4da4-b3d1-716a9f63dbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:53.473053 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3e180-33a5-4da4-b3d1-716a9f63dbe2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:53.487412 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1334/2653] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:53.492492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c5b90-4410-4f24-b090-f6c57d5d7ace admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:53.514867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c5b90-4410-4f24-b090-f6c57d5d7ace admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:53.520744 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556d97b-7b9b-4de0-a011-32420c05d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:53.521653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556d97b-7b9b-4de0-a011-32420c05d305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:53.521996 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556d97b-7b9b-4de0-a011-32420c05d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:53.522349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556d97b-7b9b-4de0-a011-32420c05d305 admin admin] PATH_INFO: `/v3/projects/f1d6eb4d44874ce0ad264eb5b889be37/users/3ad98d778e3643d284e660fe03edf38f/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:53.525061 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556d97b-7b9b-4de0-a011-32420c05d305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d6eb4d44874ce0ad264eb5b889be37, user_id=3ad98d778e3643d284e660fe03edf38f, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:53.528115 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556d97b-7b9b-4de0-a011-32420c05d305 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:53.541462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1320/2654] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:53 2022] PUT /identity/v3/projects/f1d6eb4d44874ce0ad264eb5b889be37/users/3ad98d778e3643d284e660fe03edf38f/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:53.554278 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa61ad0-14c7-4917-b607-23933632c15e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:53.554839 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa61ad0-14c7-4917-b607-23933632c15e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:53.555209 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa61ad0-14c7-4917-b607-23933632c15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:53.595858 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1aa61ad0-14c7-4917-b607-23933632c15e None None] MFA Rules not processed for user `3ad98d778e3643d284e660fe03edf38f`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:53.597642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1aa61ad0-14c7-4917-b607-23933632c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:53.689609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1335/2655] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:53.703498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556d97b-7b9b-4de0-a011-32420c05d305 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:53.705691 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4556d97b-7b9b-4de0-a011-32420c05d305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:53.729599 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:53.795050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556d97b-7b9b-4de0-a011-32420c05d305 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:53.801483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e284d09-9e2c-4b77-ad96-1d72e58deedd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:53.802505 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284d09-9e2c-4b77-ad96-1d72e58deedd service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:53.802971 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284d09-9e2c-4b77-ad96-1d72e58deedd service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:53.803450 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284d09-9e2c-4b77-ad96-1d72e58deedd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:53.821557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e284d09-9e2c-4b77-ad96-1d72e58deedd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:53.824215 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e284d09-9e2c-4b77-ad96-1d72e58deedd service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:53.840785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1321/2656] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:53 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:24:54.034432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa61ad0-14c7-4917-b607-23933632c15e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:54.114219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa61ad0-14c7-4917-b607-23933632c15e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:54.119256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:54.119915 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:54.120189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:54.120461 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] PATH_INFO: `/v3/users/1150685ff1a4440d8e9c5731cc04f088` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:54.121954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1150685ff1a4440d8e9c5731cc04f088)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:54.123946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:54.144864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:54.207620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1150685ff1a4440d8e9c5731cc04f088'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:54.209118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1150685ff1a4440d8e9c5731cc04f088'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:54.223794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1150685ff1a4440d8e9c5731cc04f088'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:54.224835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1150685ff1a4440d8e9c5731cc04f088'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:54.244437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1150685ff1a4440d8e9c5731cc04f088'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:54.261430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1336/2657] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:24:54 2022] DELETE /identity/v3/users/1150685ff1a4440d8e9c5731cc04f088 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:54.268451 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ad120-7573-4974-8b12-62ed65ed5fd4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:54.270006 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ad120-7573-4974-8b12-62ed65ed5fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:54.270757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ad120-7573-4974-8b12-62ed65ed5fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:54.299731 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-428ad120-7573-4974-8b12-62ed65ed5fd4 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:54.301075 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-428ad120-7573-4974-8b12-62ed65ed5fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:54.375088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1322/2658] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:54.387222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:54.388852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:54.466752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4c278-1550-4dd7-b35e-eb7d033373ca admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:54.471139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a59d02-0630-4e74-a9bd-59649e4e3095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:54.471944 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a59d02-0630-4e74-a9bd-59649e4e3095 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:54.472315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a59d02-0630-4e74-a9bd-59649e4e3095 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:54.472666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a59d02-0630-4e74-a9bd-59649e4e3095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:54.485976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a59d02-0630-4e74-a9bd-59649e4e3095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:54.487588 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a59d02-0630-4e74-a9bd-59649e4e3095 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:54.503342 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1337/2659] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:24:54.828565 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ad120-7573-4974-8b12-62ed65ed5fd4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:54.830289 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-428ad120-7573-4974-8b12-62ed65ed5fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:54.849241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ad120-7573-4974-8b12-62ed65ed5fd4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:54.859082 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:54.860068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:54.860553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:54.861133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] PATH_INFO: `/v3/projects/023f4ea7709844e89b63890ed9847ebd` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:54.862506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=023f4ea7709844e89b63890ed9847ebd)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:54.864826 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:54.926781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023f4ea7709844e89b63890ed9847ebd', 'request_id': 'req-1a1dfba1-5378-40d6-bacf-963d327cf5e6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:54.937606 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023f4ea7709844e89b63890ed9847ebd', 'request_id': 'req-1a1dfba1-5378-40d6-bacf-963d327cf5e6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:54.945398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023f4ea7709844e89b63890ed9847ebd', 'request_id': 'req-1a1dfba1-5378-40d6-bacf-963d327cf5e6'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:54.959900 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] The token cache is being invalidate because project 023f4ea7709844e89b63890ed9847ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:24:54.960215 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:54.960950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:54.962877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1323/2660] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:24:54 2022] DELETE /identity/v3/projects/023f4ea7709844e89b63890ed9847ebd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:24:54.967611 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a59d02-0630-4e74-a9bd-59649e4e3095 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:54.979197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a59d02-0630-4e74-a9bd-59649e4e3095 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:55.016624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:55.018455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:55.074727 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e6718-ac87-46dd-a5d0-40eb968bb9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:55.075419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e6718-ac87-46dd-a5d0-40eb968bb9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:55.075708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e6718-ac87-46dd-a5d0-40eb968bb9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:55.075978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e6718-ac87-46dd-a5d0-40eb968bb9eb admin admin] PATH_INFO: `/v3/users/3ad98d778e3643d284e660fe03edf38f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:55.077412 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e6718-ac87-46dd-a5d0-40eb968bb9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad98d778e3643d284e660fe03edf38f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:55.079504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e6718-ac87-46dd-a5d0-40eb968bb9eb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:55.096655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:55.125690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dfba1-5378-40d6-bacf-963d327cf5e6 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:55.134277 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:55.135169 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:55.136057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:55.136434 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] PATH_INFO: `/v3/users/14c59b6365ac4977b8fee0ca340f6642` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:55.138352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c59b6365ac4977b8fee0ca340f6642)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:55.140789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:55.146843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:55.155447 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ce0e6718-ac87-46dd-a5d0-40eb968bb9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad98d778e3643d284e660fe03edf38f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.156615 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ce0e6718-ac87-46dd-a5d0-40eb968bb9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad98d778e3643d284e660fe03edf38f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.166783 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ce0e6718-ac87-46dd-a5d0-40eb968bb9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad98d778e3643d284e660fe03edf38f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.167509 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ce0e6718-ac87-46dd-a5d0-40eb968bb9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad98d778e3643d284e660fe03edf38f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.183740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ce0e6718-ac87-46dd-a5d0-40eb968bb9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad98d778e3643d284e660fe03edf38f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.200651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1338/2661] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:24:54 2022] DELETE /identity/v3/users/3ad98d778e3643d284e660fe03edf38f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:55.224254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c59b6365ac4977b8fee0ca340f6642'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.234559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c59b6365ac4977b8fee0ca340f6642'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.248373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c59b6365ac4977b8fee0ca340f6642'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.249023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c59b6365ac4977b8fee0ca340f6642'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.272182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c59b6365ac4977b8fee0ca340f6642'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.284143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1324/2662] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:24:55 2022] DELETE /identity/v3/users/14c59b6365ac4977b8fee0ca340f6642 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:24:55.291636 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e542-e60d-4bbc-b639-e123a926bc20 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:55.291835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e542-e60d-4bbc-b639-e123a926bc20 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:55.292214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258e542-e60d-4bbc-b639-e123a926bc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:55.316621 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3258e542-e60d-4bbc-b639-e123a926bc20 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:55.318398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3258e542-e60d-4bbc-b639-e123a926bc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:55.406603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1339/2663] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:55.420083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:55.422508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:55.515488 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff20da-b605-471d-a776-82ecb8104a20 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:55.519367 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0bc8f-be19-47b1-835f-a97a44615d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:55.520020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0bc8f-be19-47b1-835f-a97a44615d44 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:55.520297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0bc8f-be19-47b1-835f-a97a44615d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:55.520565 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0bc8f-be19-47b1-835f-a97a44615d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:55.534557 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0bc8f-be19-47b1-835f-a97a44615d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:55.537477 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0bc8f-be19-47b1-835f-a97a44615d44 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:55.550854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1325/2664] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:24:55.565260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e542-e60d-4bbc-b639-e123a926bc20 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:55.566939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3258e542-e60d-4bbc-b639-e123a926bc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:55.580419 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258e542-e60d-4bbc-b639-e123a926bc20 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:55.586097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692d21a-ef49-4473-b740-967a1b27d733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:55.586875 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d21a-ef49-4473-b740-967a1b27d733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:55.587206 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d21a-ef49-4473-b740-967a1b27d733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:55.587547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692d21a-ef49-4473-b740-967a1b27d733 admin admin] PATH_INFO: `/v3/projects/f1d6eb4d44874ce0ad264eb5b889be37` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:55.589090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692d21a-ef49-4473-b740-967a1b27d733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d6eb4d44874ce0ad264eb5b889be37)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:55.591147 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692d21a-ef49-4473-b740-967a1b27d733 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:55.654908 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8692d21a-ef49-4473-b740-967a1b27d733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d6eb4d44874ce0ad264eb5b889be37', 'request_id': 'req-8692d21a-ef49-4473-b740-967a1b27d733'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.664264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8692d21a-ef49-4473-b740-967a1b27d733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d6eb4d44874ce0ad264eb5b889be37', 'request_id': 'req-8692d21a-ef49-4473-b740-967a1b27d733'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.672079 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8692d21a-ef49-4473-b740-967a1b27d733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d6eb4d44874ce0ad264eb5b889be37', 'request_id': 'req-8692d21a-ef49-4473-b740-967a1b27d733'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.685413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8692d21a-ef49-4473-b740-967a1b27d733 admin admin] The token cache is being invalidate because project f1d6eb4d44874ce0ad264eb5b889be37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:24:55.685814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8692d21a-ef49-4473-b740-967a1b27d733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.686596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8692d21a-ef49-4473-b740-967a1b27d733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:55.688256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1340/2665] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:24:55 2022] DELETE /identity/v3/projects/f1d6eb4d44874ce0ad264eb5b889be37 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:55.693529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6170a-b59b-48cc-b73c-7db820a09df5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:55.693836 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6170a-b59b-48cc-b73c-7db820a09df5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:55.694113 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6170a-b59b-48cc-b73c-7db820a09df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:55.728079 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-77e6170a-b59b-48cc-b73c-7db820a09df5 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:55.730292 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-77e6170a-b59b-48cc-b73c-7db820a09df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:55.832646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1326/2666] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:55.841221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087188e0-c56d-4853-886d-7a24aabf7882 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:55.841680 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087188e0-c56d-4853-886d-7a24aabf7882 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:55.842230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087188e0-c56d-4853-886d-7a24aabf7882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:55.870122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-087188e0-c56d-4853-886d-7a24aabf7882 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:55.871662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-087188e0-c56d-4853-886d-7a24aabf7882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:55.881738 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1341/2667] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:55.887969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6170a-b59b-48cc-b73c-7db820a09df5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:55.893312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:55.900997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6170a-b59b-48cc-b73c-7db820a09df5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:55.909371 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce81a8c-da7e-4558-a05b-021bbf26209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:55.910697 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce81a8c-da7e-4558-a05b-021bbf26209c admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:55.910978 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce81a8c-da7e-4558-a05b-021bbf26209c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:55.911312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce81a8c-da7e-4558-a05b-021bbf26209c admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:55.912042 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce81a8c-da7e-4558-a05b-021bbf26209c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:24:55.912352 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce81a8c-da7e-4558-a05b-021bbf26209c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:55.914132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce81a8c-da7e-4558-a05b-021bbf26209c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:55.936360 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1327/2668] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:24:55.938431 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087188e0-c56d-4853-886d-7a24aabf7882 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:55.952201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087188e0-c56d-4853-886d-7a24aabf7882 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:55.957698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1082e-384b-4ecd-863f-a40668aa7c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:55.958422 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1082e-384b-4ecd-863f-a40668aa7c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:55.958713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1082e-384b-4ecd-863f-a40668aa7c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:55.958967 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1082e-384b-4ecd-863f-a40668aa7c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:55.959729 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1082e-384b-4ecd-863f-a40668aa7c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:55.961746 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1082e-384b-4ecd-863f-a40668aa7c1d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:55.972041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce81a8c-da7e-4558-a05b-021bbf26209c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:55.974915 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-dce81a8c-da7e-4558-a05b-021bbf26209c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:55.997778 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce81a8c-da7e-4558-a05b-021bbf26209c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:55.998081 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1342/2669] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:55 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:56.002527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1082e-384b-4ecd-863f-a40668aa7c1d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.021365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:56.094688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96353f-b657-40d9-ab05-86fe1faeec6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.095689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96353f-b657-40d9-ab05-86fe1faeec6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.096176 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96353f-b657-40d9-ab05-86fe1faeec6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.096538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96353f-b657-40d9-ab05-86fe1faeec6f admin admin] PATH_INFO: `/v3/projects/0d1378d126e6441f9d2fb535f68a6e7f` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.098207 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96353f-b657-40d9-ab05-86fe1faeec6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1378d126e6441f9d2fb535f68a6e7f)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.104204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96353f-b657-40d9-ab05-86fe1faeec6f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.110152 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1082e-384b-4ecd-863f-a40668aa7c1d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.117386 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdafe4-02d5-44fd-8072-a783fc4cfeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.118510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdafe4-02d5-44fd-8072-a783fc4cfeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.119157 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdafe4-02d5-44fd-8072-a783fc4cfeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.119526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdafe4-02d5-44fd-8072-a783fc4cfeb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.120669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdafe4-02d5-44fd-8072-a783fc4cfeb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.124251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdafe4-02d5-44fd-8072-a783fc4cfeb2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.159561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1343/2670] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:56 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:24:56.164296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdafe4-02d5-44fd-8072-a783fc4cfeb2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.175227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdafe4-02d5-44fd-8072-a783fc4cfeb2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.180014 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bb96353f-b657-40d9-ab05-86fe1faeec6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1378d126e6441f9d2fb535f68a6e7f', 'request_id': 'req-bb96353f-b657-40d9-ab05-86fe1faeec6f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:56.190193 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bb96353f-b657-40d9-ab05-86fe1faeec6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1378d126e6441f9d2fb535f68a6e7f', 'request_id': 'req-bb96353f-b657-40d9-ab05-86fe1faeec6f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:56.199477 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bb96353f-b657-40d9-ab05-86fe1faeec6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1378d126e6441f9d2fb535f68a6e7f', 'request_id': 'req-bb96353f-b657-40d9-ab05-86fe1faeec6f'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:56.219295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bb96353f-b657-40d9-ab05-86fe1faeec6f admin admin] The token cache is being invalidate because project 0d1378d126e6441f9d2fb535f68a6e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:24:56.219745 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bb96353f-b657-40d9-ab05-86fe1faeec6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:56.220620 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-bb96353f-b657-40d9-ab05-86fe1faeec6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:24:56.222553 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1328/2671] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:24:55 2022] DELETE /identity/v3/projects/0d1378d126e6441f9d2fb535f68a6e7f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:56.227734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72925520-ffa5-4972-a205-d5d721342e81 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.228028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72925520-ffa5-4972-a205-d5d721342e81 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.228309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72925520-ffa5-4972-a205-d5d721342e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.252554 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-72925520-ffa5-4972-a205-d5d721342e81 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:56.252973 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6d45e-e117-45de-ae39-aa9ea0c2d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.253712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6d45e-e117-45de-ae39-aa9ea0c2d01b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.253991 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6d45e-e117-45de-ae39-aa9ea0c2d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.254265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6d45e-e117-45de-ae39-aa9ea0c2d01b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.254436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-72925520-ffa5-4972-a205-d5d721342e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:56.255017 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6d45e-e117-45de-ae39-aa9ea0c2d01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.256671 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6d45e-e117-45de-ae39-aa9ea0c2d01b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.269319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1344/2672] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:24:56.271875 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1329/2673] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:56.273666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6d45e-e117-45de-ae39-aa9ea0c2d01b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.275677 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-00d6d45e-e117-45de-ae39-aa9ea0c2d01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:56.286578 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177c445-1ef7-4317-b83d-cf8f98a601e7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.287574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177c445-1ef7-4317-b83d-cf8f98a601e7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.287574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177c445-1ef7-4317-b83d-cf8f98a601e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.297353 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6d45e-e117-45de-ae39-aa9ea0c2d01b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.304997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3500b2-f105-4f88-b127-3ad9c40c56a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.305699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3500b2-f105-4f88-b127-3ad9c40c56a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.305989 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3500b2-f105-4f88-b127-3ad9c40c56a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.306270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3500b2-f105-4f88-b127-3ad9c40c56a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.307127 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3500b2-f105-4f88-b127-3ad9c40c56a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.308741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3500b2-f105-4f88-b127-3ad9c40c56a0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.317068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0177c445-1ef7-4317-b83d-cf8f98a601e7 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:56.319096 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0177c445-1ef7-4317-b83d-cf8f98a601e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:56.321882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1345/2674] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:56.326309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3500b2-f105-4f88-b127-3ad9c40c56a0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.329368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1330/2675] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:56.334835 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177c445-1ef7-4317-b83d-cf8f98a601e7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.337676 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3500b2-f105-4f88-b127-3ad9c40c56a0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.342916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff77017-a792-4090-af9d-a857f3e2b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.343622 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff77017-a792-4090-af9d-a857f3e2b924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.343945 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff77017-a792-4090-af9d-a857f3e2b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.344173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff77017-a792-4090-af9d-a857f3e2b924 admin admin] PATH_INFO: `/v3/projects/3065d9e696de4d38aee434540849541a/users/defef2d7f1f741c2aae823c514553aa5/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.347559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177c445-1ef7-4317-b83d-cf8f98a601e7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.354935 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a799de2-f253-45ca-89a1-e8ac6cdbe54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.355972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a799de2-f253-45ca-89a1-e8ac6cdbe54b admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.356450 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a799de2-f253-45ca-89a1-e8ac6cdbe54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.356907 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a799de2-f253-45ca-89a1-e8ac6cdbe54b admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.358197 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a799de2-f253-45ca-89a1-e8ac6cdbe54b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:24:56.358751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a799de2-f253-45ca-89a1-e8ac6cdbe54b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.361051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff77017-a792-4090-af9d-a857f3e2b924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3065d9e696de4d38aee434540849541a, user_id=defef2d7f1f741c2aae823c514553aa5, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.361831 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a799de2-f253-45ca-89a1-e8ac6cdbe54b admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.363757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff77017-a792-4090-af9d-a857f3e2b924 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.379716 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1346/2676] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:56 2022] PUT /identity/v3/projects/3065d9e696de4d38aee434540849541a/users/defef2d7f1f741c2aae823c514553aa5/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:24:56.384388 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1331/2677] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:24:56.390921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff77017-a792-4090-af9d-a857f3e2b924 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.392445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63871-ef22-4b40-ba93-6f9dcf82d495 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.392914 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63871-ef22-4b40-ba93-6f9dcf82d495 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.393422 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f63871-ef22-4b40-ba93-6f9dcf82d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.438366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-78f63871-ef22-4b40-ba93-6f9dcf82d495 None None] MFA Rules not processed for user `defef2d7f1f741c2aae823c514553aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:56.440358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-78f63871-ef22-4b40-ba93-6f9dcf82d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:56.481288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff77017-a792-4090-af9d-a857f3e2b924 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.487776 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3a15e-aced-4eae-a76b-f3b0071ea7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.488551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3a15e-aced-4eae-a76b-f3b0071ea7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.488944 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3a15e-aced-4eae-a76b-f3b0071ea7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.489274 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3a15e-aced-4eae-a76b-f3b0071ea7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.490065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3a15e-aced-4eae-a76b-f3b0071ea7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.492585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3a15e-aced-4eae-a76b-f3b0071ea7b0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.499219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:56.509127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:56.534724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1347/2678] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:56 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:56.540847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3a15e-aced-4eae-a76b-f3b0071ea7b0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.554484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1332/2679] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:24:56.561518 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f63871-ef22-4b40-ba93-6f9dcf82d495 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.581172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f63871-ef22-4b40-ba93-6f9dcf82d495 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.627150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3a15e-aced-4eae-a76b-f3b0071ea7b0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.633857 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee5bac-1da4-40ec-8edd-7e48efa16a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.634712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee5bac-1da4-40ec-8edd-7e48efa16a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.635171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee5bac-1da4-40ec-8edd-7e48efa16a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.635621 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee5bac-1da4-40ec-8edd-7e48efa16a1e admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.636472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee5bac-1da4-40ec-8edd-7e48efa16a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.638842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee5bac-1da4-40ec-8edd-7e48efa16a1e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.668508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f6858-e2a8-4b3b-8ec5-76c3b05f3ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.670312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f6858-e2a8-4b3b-8ec5-76c3b05f3ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.670785 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f6858-e2a8-4b3b-8ec5-76c3b05f3ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.671425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f6858-e2a8-4b3b-8ec5-76c3b05f3ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.672725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f6858-e2a8-4b3b-8ec5-76c3b05f3ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.673391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1348/2680] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:56 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:24:56.675538 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f6858-e2a8-4b3b-8ec5-76c3b05f3ccb admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.675801 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee5bac-1da4-40ec-8edd-7e48efa16a1e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.687517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee5bac-1da4-40ec-8edd-7e48efa16a1e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.692742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470c5d5-610f-4c03-95dd-4cddbb4784a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.693421 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470c5d5-610f-4c03-95dd-4cddbb4784a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.693712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470c5d5-610f-4c03-95dd-4cddbb4784a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.693987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470c5d5-610f-4c03-95dd-4cddbb4784a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.694719 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470c5d5-610f-4c03-95dd-4cddbb4784a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.696388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470c5d5-610f-4c03-95dd-4cddbb4784a5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.714443 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1349/2681] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:56.715903 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470c5d5-610f-4c03-95dd-4cddbb4784a5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.718048 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1333/2682] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:56 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:24:56.724311 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f6858-e2a8-4b3b-8ec5-76c3b05f3ccb admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.730606 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470c5d5-610f-4c03-95dd-4cddbb4784a5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.809496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427affe5-8f61-4cf1-98be-9eecb09117e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.810851 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427affe5-8f61-4cf1-98be-9eecb09117e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.811304 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427affe5-8f61-4cf1-98be-9eecb09117e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.811758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427affe5-8f61-4cf1-98be-9eecb09117e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.812668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427affe5-8f61-4cf1-98be-9eecb09117e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.815704 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427affe5-8f61-4cf1-98be-9eecb09117e1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.820262 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f6858-e2a8-4b3b-8ec5-76c3b05f3ccb admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.829078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ad65b-e91f-477d-b2b8-d85ea82ba052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.830072 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ad65b-e91f-477d-b2b8-d85ea82ba052 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.830677 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ad65b-e91f-477d-b2b8-d85ea82ba052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.831313 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ad65b-e91f-477d-b2b8-d85ea82ba052 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.832426 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ad65b-e91f-477d-b2b8-d85ea82ba052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.835574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1350/2683] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:56.836046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ad65b-e91f-477d-b2b8-d85ea82ba052 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.842043 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427affe5-8f61-4cf1-98be-9eecb09117e1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.856616 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427affe5-8f61-4cf1-98be-9eecb09117e1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.874301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f1c2f-9e3f-43f1-afba-e81e8f5683a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.875298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f1c2f-9e3f-43f1-afba-e81e8f5683a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.875787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f1c2f-9e3f-43f1-afba-e81e8f5683a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.876219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f1c2f-9e3f-43f1-afba-e81e8f5683a6 admin admin] PATH_INFO: `/v3/projects/9655e85cc1944bfdae6f9ef7e78dc2ba/users/2d139f12296d47f588aa6f50a41047c0/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.889540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1334/2684] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:56 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:24:56.896287 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ad65b-e91f-477d-b2b8-d85ea82ba052 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.900262 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f1c2f-9e3f-43f1-afba-e81e8f5683a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9655e85cc1944bfdae6f9ef7e78dc2ba, user_id=2d139f12296d47f588aa6f50a41047c0, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.903041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f1c2f-9e3f-43f1-afba-e81e8f5683a6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.911969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ad65b-e91f-477d-b2b8-d85ea82ba052 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.917430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111c2c1-6e52-49eb-bfeb-83feebcdea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:56.918268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111c2c1-6e52-49eb-bfeb-83feebcdea54 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.918552 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111c2c1-6e52-49eb-bfeb-83feebcdea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.918821 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111c2c1-6e52-49eb-bfeb-83feebcdea54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.919529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111c2c1-6e52-49eb-bfeb-83feebcdea54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:56.921224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111c2c1-6e52-49eb-bfeb-83feebcdea54 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:56.925816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1351/2685] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:56 2022] PUT /identity/v3/projects/9655e85cc1944bfdae6f9ef7e78dc2ba/users/2d139f12296d47f588aa6f50a41047c0/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:24:56.933759 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1335/2686] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:56.945929 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7500aa4-7145-44b7-beac-e53f7c2c466a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:56.946284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111c2c1-6e52-49eb-bfeb-83feebcdea54 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:56.946733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7500aa4-7145-44b7-beac-e53f7c2c466a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:56.947317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7500aa4-7145-44b7-beac-e53f7c2c466a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:56.964417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111c2c1-6e52-49eb-bfeb-83feebcdea54 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:56.981643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c7500aa4-7145-44b7-beac-e53f7c2c466a None None] MFA Rules not processed for user `2d139f12296d47f588aa6f50a41047c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:56.982454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c7500aa4-7145-44b7-beac-e53f7c2c466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:57.014345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:57.025771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:57.048034 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31030496-3a52-45d0-873b-15f94dc36bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:57.048768 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31030496-3a52-45d0-873b-15f94dc36bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:57.049131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31030496-3a52-45d0-873b-15f94dc36bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:57.049519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31030496-3a52-45d0-873b-15f94dc36bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:57.050404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31030496-3a52-45d0-873b-15f94dc36bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:57.052573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31030496-3a52-45d0-873b-15f94dc36bc8 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:57.066132 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1336/2687] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:24:57.070483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31030496-3a52-45d0-873b-15f94dc36bc8 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:57.075372 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1352/2688] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:57.084706 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31030496-3a52-45d0-873b-15f94dc36bc8 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:57.089761 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5936fb3-e4ac-47b1-bed2-624e7d736bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:57.090472 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5936fb3-e4ac-47b1-bed2-624e7d736bea admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:57.090751 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5936fb3-e4ac-47b1-bed2-624e7d736bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:57.091030 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5936fb3-e4ac-47b1-bed2-624e7d736bea admin admin] PATH_INFO: `/v3/projects/625ce34266ca4256ae70d0ed96dc7f17/users/eb11f6ada25346199473423e910e57ab/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:57.091465 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7500aa4-7145-44b7-beac-e53f7c2c466a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:57.092982 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c7500aa4-7145-44b7-beac-e53f7c2c466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:57.114206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5936fb3-e4ac-47b1-bed2-624e7d736bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=625ce34266ca4256ae70d0ed96dc7f17, user_id=eb11f6ada25346199473423e910e57ab, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:57.117037 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5936fb3-e4ac-47b1-bed2-624e7d736bea admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:57.135280 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1337/2689] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:57 2022] PUT /identity/v3/projects/625ce34266ca4256ae70d0ed96dc7f17/users/eb11f6ada25346199473423e910e57ab/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:57.146945 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22fcb4-8c31-4a46-8822-99a095c6ddc5 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:57.147399 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22fcb4-8c31-4a46-8822-99a095c6ddc5 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:57.147770 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22fcb4-8c31-4a46-8822-99a095c6ddc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:57.182968 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7500aa4-7145-44b7-beac-e53f7c2c466a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:57.184859 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-be22fcb4-8c31-4a46-8822-99a095c6ddc5 None None] MFA Rules not processed for user `eb11f6ada25346199473423e910e57ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:57.186234 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-be22fcb4-8c31-4a46-8822-99a095c6ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:57.272675 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1338/2690] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:57.278396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22fcb4-8c31-4a46-8822-99a095c6ddc5 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:57.278906 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc1461-05ee-414e-a8fa-783e0c4e6e02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c3d7cdad7f44f0f8df944ec7f69de26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:57.279877 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc1461-05ee-414e-a8fa-783e0c4e6e02 service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:57.280308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc1461-05ee-414e-a8fa-783e0c4e6e02 service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:57.280770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc1461-05ee-414e-a8fa-783e0c4e6e02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:57.359236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc1461-05ee-414e-a8fa-783e0c4e6e02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:57.360599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc1461-05ee-414e-a8fa-783e0c4e6e02 service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:57.371876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1353/2691] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:24:57.375222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22fcb4-8c31-4a46-8822-99a095c6ddc5 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:57.381127 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9444b0-d9f7-47e8-aa22-7856076b0897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:57.381779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9444b0-d9f7-47e8-aa22-7856076b0897 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:57.382059 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9444b0-d9f7-47e8-aa22-7856076b0897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:57.382338 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9444b0-d9f7-47e8-aa22-7856076b0897 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:57.383446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9444b0-d9f7-47e8-aa22-7856076b0897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:57.385478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9444b0-d9f7-47e8-aa22-7856076b0897 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:57.420204 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1339/2692] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:24:57 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:24:57.426005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc1461-05ee-414e-a8fa-783e0c4e6e02 service glance] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:57.444265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc1461-05ee-414e-a8fa-783e0c4e6e02 service glance] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:57.490371 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:57.522718 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059000c9-47b5-45ff-bf54-46e62485161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:57.523579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059000c9-47b5-45ff-bf54-46e62485161b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:57.523943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059000c9-47b5-45ff-bf54-46e62485161b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:57.524294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059000c9-47b5-45ff-bf54-46e62485161b admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:57.525122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059000c9-47b5-45ff-bf54-46e62485161b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:57.527503 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059000c9-47b5-45ff-bf54-46e62485161b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:57.563085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1354/2693] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:24:57 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:24:57.570380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9444b0-d9f7-47e8-aa22-7856076b0897 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:57.582412 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9444b0-d9f7-47e8-aa22-7856076b0897 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:57.588073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99947c50-51f0-4e1c-9a86-b6db8556654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:57.588718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99947c50-51f0-4e1c-9a86-b6db8556654e admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:57.589036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99947c50-51f0-4e1c-9a86-b6db8556654e admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:57.589312 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99947c50-51f0-4e1c-9a86-b6db8556654e admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:57.590051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99947c50-51f0-4e1c-9a86-b6db8556654e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:57.591765 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99947c50-51f0-4e1c-9a86-b6db8556654e admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:57.603513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1340/2694] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:24:57.608044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059000c9-47b5-45ff-bf54-46e62485161b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:57.619601 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059000c9-47b5-45ff-bf54-46e62485161b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:57.625338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabffccb-a098-417a-9fa3-d8284400ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:57.626051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabffccb-a098-417a-9fa3-d8284400ee57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:57.626331 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabffccb-a098-417a-9fa3-d8284400ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:57.626609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabffccb-a098-417a-9fa3-d8284400ee57 admin admin] PATH_INFO: `/v3/projects/c6fa2e1ae9d34332b2b2aa2cdeec5639/users/a3c17c1c58ff4e87aaaf73045e46661b/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:57.646113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabffccb-a098-417a-9fa3-d8284400ee57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6fa2e1ae9d34332b2b2aa2cdeec5639, user_id=a3c17c1c58ff4e87aaaf73045e46661b, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:57.648723 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabffccb-a098-417a-9fa3-d8284400ee57 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:57.665178 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1355/2695] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:57 2022] PUT /identity/v3/projects/c6fa2e1ae9d34332b2b2aa2cdeec5639/users/a3c17c1c58ff4e87aaaf73045e46661b/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:57.669164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99947c50-51f0-4e1c-9a86-b6db8556654e admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:57.680805 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99947c50-51f0-4e1c-9a86-b6db8556654e admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:57.715464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:24:57.778196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548ed53-2bfb-4005-9df8-ce916fc83b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:57.778925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548ed53-2bfb-4005-9df8-ce916fc83b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:57.779236 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548ed53-2bfb-4005-9df8-ce916fc83b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:57.779548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548ed53-2bfb-4005-9df8-ce916fc83b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:57.780401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548ed53-2bfb-4005-9df8-ce916fc83b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:57.782285 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548ed53-2bfb-4005-9df8-ce916fc83b66 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:57.795910 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1341/2696] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:24:57.801756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabffccb-a098-417a-9fa3-d8284400ee57 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:57.817959 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabffccb-a098-417a-9fa3-d8284400ee57 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:57.825170 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a823d8-c880-4b87-bfaa-7c5e1f04dfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:57.826103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a823d8-c880-4b87-bfaa-7c5e1f04dfbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:57.826514 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a823d8-c880-4b87-bfaa-7c5e1f04dfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:57.826917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a823d8-c880-4b87-bfaa-7c5e1f04dfbc admin admin] PATH_INFO: `/v3/projects/c6fa2e1ae9d34332b2b2aa2cdeec5639/users/a3c17c1c58ff4e87aaaf73045e46661b/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:57.829504 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a823d8-c880-4b87-bfaa-7c5e1f04dfbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6fa2e1ae9d34332b2b2aa2cdeec5639, user_id=a3c17c1c58ff4e87aaaf73045e46661b, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:57.832555 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a823d8-c880-4b87-bfaa-7c5e1f04dfbc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:57.849607 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1356/2697] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:24:57 2022] PUT /identity/v3/projects/c6fa2e1ae9d34332b2b2aa2cdeec5639/users/a3c17c1c58ff4e87aaaf73045e46661b/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:24:57.863175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f49f9-480b-4fdf-bb4d-8448d6740f2e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:57.863504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f49f9-480b-4fdf-bb4d-8448d6740f2e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:57.863645 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f49f9-480b-4fdf-bb4d-8448d6740f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:57.910803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-189f49f9-480b-4fdf-bb4d-8448d6740f2e None None] MFA Rules not processed for user `a3c17c1c58ff4e87aaaf73045e46661b`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:24:57.912131 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-189f49f9-480b-4fdf-bb4d-8448d6740f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:58.015633 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1342/2698] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:24:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:24:58.028466 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a823d8-c880-4b87-bfaa-7c5e1f04dfbc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:58.030315 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b3a823d8-c880-4b87-bfaa-7c5e1f04dfbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:58.114628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a823d8-c880-4b87-bfaa-7c5e1f04dfbc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:58.119399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9e124-1b0c-415c-9d36-744902237830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:58.120139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9e124-1b0c-415c-9d36-744902237830 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:58.120456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9e124-1b0c-415c-9d36-744902237830 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:58.120852 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9e124-1b0c-415c-9d36-744902237830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:58.131931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9e124-1b0c-415c-9d36-744902237830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:58.133893 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9e124-1b0c-415c-9d36-744902237830 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:58.146148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1357/2699] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:24:58.196908 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f49f9-480b-4fdf-bb4d-8448d6740f2e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:24:58.198456 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-189f49f9-480b-4fdf-bb4d-8448d6740f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:24:58.211916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f49f9-480b-4fdf-bb4d-8448d6740f2e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:24:58.216477 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b33d4-7460-4053-b38e-dc119407358d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:24:58.217184 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b33d4-7460-4053-b38e-dc119407358d service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:24:58.217462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b33d4-7460-4053-b38e-dc119407358d service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:24:58.217727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b33d4-7460-4053-b38e-dc119407358d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:24:58.300390 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b33d4-7460-4053-b38e-dc119407358d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:24:58.301957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b33d4-7460-4053-b38e-dc119407358d service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:24:58.313550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1343/2700] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:24:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:25:01.524014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9e124-1b0c-415c-9d36-744902237830 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:01.600992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9e124-1b0c-415c-9d36-744902237830 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:01.607145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:01.607997 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:01.608507 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:01.608962 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] PATH_INFO: `/v3/users/defef2d7f1f741c2aae823c514553aa5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:01.610395 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=defef2d7f1f741c2aae823c514553aa5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:01.612613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:01.661743 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:25:01.681569 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defef2d7f1f741c2aae823c514553aa5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:01.682409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defef2d7f1f741c2aae823c514553aa5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:01.695130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defef2d7f1f741c2aae823c514553aa5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:01.695571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defef2d7f1f741c2aae823c514553aa5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:01.709836 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defef2d7f1f741c2aae823c514553aa5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:01.723673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1358/2701] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:25:01 2022] DELETE /identity/v3/users/defef2d7f1f741c2aae823c514553aa5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:25:01.730719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42f340-b405-466c-b68f-06ec42eff80d None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:01.731283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42f340-b405-466c-b68f-06ec42eff80d None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:01.731283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42f340-b405-466c-b68f-06ec42eff80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:01.752297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-0e42f340-b405-466c-b68f-06ec42eff80d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:25:01.753679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0e42f340-b405-466c-b68f-06ec42eff80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:01.797484 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:25:01.822345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1344/2702] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:25:01.835731 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:01.837291 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:01.909211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d97574-df0a-4982-9938-c93887704241 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:01.914107 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692f780-1097-4510-86fa-0fb549bfe6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:01.914806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692f780-1097-4510-86fa-0fb549bfe6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:01.915059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692f780-1097-4510-86fa-0fb549bfe6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:01.915326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692f780-1097-4510-86fa-0fb549bfe6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:01.927820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692f780-1097-4510-86fa-0fb549bfe6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:01.930645 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692f780-1097-4510-86fa-0fb549bfe6d3 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:01.951807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1359/2703] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:25:02.272796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42f340-b405-466c-b68f-06ec42eff80d None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:02.282992 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0e42f340-b405-466c-b68f-06ec42eff80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:02.298732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42f340-b405-466c-b68f-06ec42eff80d None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:02.316976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:02.317757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:02.318083 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:02.318369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] PATH_INFO: `/v3/projects/3065d9e696de4d38aee434540849541a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:02.319762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3065d9e696de4d38aee434540849541a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:02.321913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:02.381821 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3065d9e696de4d38aee434540849541a', 'request_id': 'req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:02.391462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3065d9e696de4d38aee434540849541a', 'request_id': 'req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:02.398362 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3065d9e696de4d38aee434540849541a', 'request_id': 'req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:02.414344 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] The token cache is being invalidate because project 3065d9e696de4d38aee434540849541a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:25:02.414862 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:02.416091 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:02.419462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1345/2704] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:25:02 2022] DELETE /identity/v3/projects/3065d9e696de4d38aee434540849541a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:25:02.424966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692f780-1097-4510-86fa-0fb549bfe6d3 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:02.435404 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692f780-1097-4510-86fa-0fb549bfe6d3 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:02.502749 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:02.503268 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:02.503548 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:02.503829 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] PATH_INFO: `/v3/users/eb11f6ada25346199473423e910e57ab` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:02.505129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb11f6ada25346199473423e910e57ab)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:02.507085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:02.572725 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb11f6ada25346199473423e910e57ab'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:02.573990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb11f6ada25346199473423e910e57ab'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:02.588943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb11f6ada25346199473423e910e57ab'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:02.590398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb11f6ada25346199473423e910e57ab'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:02.594668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:25:02.617097 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb11f6ada25346199473423e910e57ab'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:02.638223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1360/2705] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:25:02 2022] DELETE /identity/v3/users/eb11f6ada25346199473423e910e57ab => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:25:02.980093 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:02.982165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:03.000775 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969b8ac-e6c1-4a83-ad4b-7aa2ef04c7d1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:03.100263 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:03.101089 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:03.101372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:03.101646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] PATH_INFO: `/v3/projects/625ce34266ca4256ae70d0ed96dc7f17` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:03.102944 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=625ce34266ca4256ae70d0ed96dc7f17)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:03.104906 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:03.173225 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625ce34266ca4256ae70d0ed96dc7f17', 'request_id': 'req-5e684097-b48e-4af7-bc28-445b28e01086'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.184496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625ce34266ca4256ae70d0ed96dc7f17', 'request_id': 'req-5e684097-b48e-4af7-bc28-445b28e01086'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.192849 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625ce34266ca4256ae70d0ed96dc7f17', 'request_id': 'req-5e684097-b48e-4af7-bc28-445b28e01086'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.194922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:25:03.207835 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] The token cache is being invalidate because project 625ce34266ca4256ae70d0ed96dc7f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:25:03.208588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.210181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.212088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1346/2706] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:25:02 2022] DELETE /identity/v3/projects/625ce34266ca4256ae70d0ed96dc7f17 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:25:03.217101 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:03.221035 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:03.234921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48c451-7ae4-4f0a-82ca-a0b6f3634594 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:03.307045 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a94786-cbbc-4bca-856a-a0ced0828269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:03.307706 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a94786-cbbc-4bca-856a-a0ced0828269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:03.307995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a94786-cbbc-4bca-856a-a0ced0828269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:03.308269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a94786-cbbc-4bca-856a-a0ced0828269 admin admin] PATH_INFO: `/v3/users/a3c17c1c58ff4e87aaaf73045e46661b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:03.309592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a94786-cbbc-4bca-856a-a0ced0828269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c17c1c58ff4e87aaaf73045e46661b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:03.311532 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a94786-cbbc-4bca-856a-a0ced0828269 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:03.370814 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e3a94786-cbbc-4bca-856a-a0ced0828269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c17c1c58ff4e87aaaf73045e46661b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.371491 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e3a94786-cbbc-4bca-856a-a0ced0828269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c17c1c58ff4e87aaaf73045e46661b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.379972 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e3a94786-cbbc-4bca-856a-a0ced0828269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c17c1c58ff4e87aaaf73045e46661b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.380624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e3a94786-cbbc-4bca-856a-a0ced0828269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c17c1c58ff4e87aaaf73045e46661b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.396775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e3a94786-cbbc-4bca-856a-a0ced0828269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c17c1c58ff4e87aaaf73045e46661b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.414034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1361/2707] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:25:03 2022] DELETE /identity/v3/users/a3c17c1c58ff4e87aaaf73045e46661b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:25:03.772072 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:03.774604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:03.794964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e684097-b48e-4af7-bc28-445b28e01086 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:03.866267 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461a667-687c-431c-9809-b2661db35102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:03.866934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461a667-687c-431c-9809-b2661db35102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:03.867208 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461a667-687c-431c-9809-b2661db35102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:03.867483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461a667-687c-431c-9809-b2661db35102 admin admin] PATH_INFO: `/v3/projects/c6fa2e1ae9d34332b2b2aa2cdeec5639` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:03.868671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461a667-687c-431c-9809-b2661db35102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6fa2e1ae9d34332b2b2aa2cdeec5639)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:03.870640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461a667-687c-431c-9809-b2661db35102 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:03.927202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a461a667-687c-431c-9809-b2661db35102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6fa2e1ae9d34332b2b2aa2cdeec5639', 'request_id': 'req-a461a667-687c-431c-9809-b2661db35102'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.935383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a461a667-687c-431c-9809-b2661db35102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6fa2e1ae9d34332b2b2aa2cdeec5639', 'request_id': 'req-a461a667-687c-431c-9809-b2661db35102'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.941734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a461a667-687c-431c-9809-b2661db35102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6fa2e1ae9d34332b2b2aa2cdeec5639', 'request_id': 'req-a461a667-687c-431c-9809-b2661db35102'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.954258 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a461a667-687c-431c-9809-b2661db35102 admin admin] The token cache is being invalidate because project c6fa2e1ae9d34332b2b2aa2cdeec5639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:25:03.954543 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a461a667-687c-431c-9809-b2661db35102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.955245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a461a667-687c-431c-9809-b2661db35102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:03.956810 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1347/2708] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:25:03 2022] DELETE /identity/v3/projects/c6fa2e1ae9d34332b2b2aa2cdeec5639 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:25:03.964699 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab6795-4320-4b35-9919-9bbb6f57467c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:03.965310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab6795-4320-4b35-9919-9bbb6f57467c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:03.965425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab6795-4320-4b35-9919-9bbb6f57467c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:03.989847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ecab6795-4320-4b35-9919-9bbb6f57467c None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:25:03.991130 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ecab6795-4320-4b35-9919-9bbb6f57467c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:04.049572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:25:04.068505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1362/2709] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:25:04.081221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741396f4-0e6f-4382-8e61-44ec7cf122da None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:04.081822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741396f4-0e6f-4382-8e61-44ec7cf122da None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:04.081943 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741396f4-0e6f-4382-8e61-44ec7cf122da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:04.103828 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-741396f4-0e6f-4382-8e61-44ec7cf122da None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:25:04.105108 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-741396f4-0e6f-4382-8e61-44ec7cf122da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:04.114324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1348/2710] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:25:04.119265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab6795-4320-4b35-9919-9bbb6f57467c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:04.130212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab6795-4320-4b35-9919-9bbb6f57467c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:04.135947 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78a13-ed4d-4166-9364-f700044d9112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:04.136590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78a13-ed4d-4166-9364-f700044d9112 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:04.136869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78a13-ed4d-4166-9364-f700044d9112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:04.137179 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78a13-ed4d-4166-9364-f700044d9112 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:04.137890 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b78a13-ed4d-4166-9364-f700044d9112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:25:04.138195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b78a13-ed4d-4166-9364-f700044d9112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:04.140063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b78a13-ed4d-4166-9364-f700044d9112 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:04.158235 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1363/2711] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:25:04.159608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741396f4-0e6f-4382-8e61-44ec7cf122da None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:04.169420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741396f4-0e6f-4382-8e61-44ec7cf122da None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:04.174126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f860e-bfb3-4053-9a49-1ffb41d5c334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:04.174757 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f860e-bfb3-4053-9a49-1ffb41d5c334 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:04.175030 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f860e-bfb3-4053-9a49-1ffb41d5c334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:04.175298 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f860e-bfb3-4053-9a49-1ffb41d5c334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:04.175966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f860e-bfb3-4053-9a49-1ffb41d5c334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:04.178283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f860e-bfb3-4053-9a49-1ffb41d5c334 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:04.218540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1349/2712] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:25:04 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:25:04.224481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78a13-ed4d-4166-9364-f700044d9112 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:04.235879 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78a13-ed4d-4166-9364-f700044d9112 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:04.302124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f879cdf-c5d0-44fd-beba-fbb73db5f8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:04.302664 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f879cdf-c5d0-44fd-beba-fbb73db5f8ee admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:04.302942 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f879cdf-c5d0-44fd-beba-fbb73db5f8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:04.303212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f879cdf-c5d0-44fd-beba-fbb73db5f8ee admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:04.303886 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f879cdf-c5d0-44fd-beba-fbb73db5f8ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:04.305847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f879cdf-c5d0-44fd-beba-fbb73db5f8ee admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:04.330551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1364/2713] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:25:04 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:25:04.335661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f860e-bfb3-4053-9a49-1ffb41d5c334 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:04.348619 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f860e-bfb3-4053-9a49-1ffb41d5c334 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:04.354508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd0f33-085b-4633-a8cc-2b348319e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:04.355143 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd0f33-085b-4633-a8cc-2b348319e94c admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:04.355420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd0f33-085b-4633-a8cc-2b348319e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:04.355692 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd0f33-085b-4633-a8cc-2b348319e94c admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:04.356389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd0f33-085b-4633-a8cc-2b348319e94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:04.358052 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd0f33-085b-4633-a8cc-2b348319e94c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:04.372669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1350/2714] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:25:04.377307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f879cdf-c5d0-44fd-beba-fbb73db5f8ee admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:04.388711 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f879cdf-c5d0-44fd-beba-fbb73db5f8ee admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:04.394825 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174b027-a83c-4ab6-9213-b5664324b414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:04.395556 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b027-a83c-4ab6-9213-b5664324b414 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:04.395889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b027-a83c-4ab6-9213-b5664324b414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:04.396166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b027-a83c-4ab6-9213-b5664324b414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:04.397056 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174b027-a83c-4ab6-9213-b5664324b414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:04.398806 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174b027-a83c-4ab6-9213-b5664324b414 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:04.411530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1365/2715] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:25:04.416492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd0f33-085b-4633-a8cc-2b348319e94c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:04.431592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd0f33-085b-4633-a8cc-2b348319e94c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:04.438975 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903e52c-481c-4e59-86f0-5a6f8866b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:04.439689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e52c-481c-4e59-86f0-5a6f8866b372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:04.439969 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e52c-481c-4e59-86f0-5a6f8866b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:04.440221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e52c-481c-4e59-86f0-5a6f8866b372 admin admin] PATH_INFO: `/v3/projects/969cff30a287451992bab0e5551fe5cc/users/1eabe574e15a4c3d8b0edf19c2a28de4/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:04.458802 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903e52c-481c-4e59-86f0-5a6f8866b372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969cff30a287451992bab0e5551fe5cc, user_id=1eabe574e15a4c3d8b0edf19c2a28de4, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:04.463995 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903e52c-481c-4e59-86f0-5a6f8866b372 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:04.490574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1351/2716] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:25:04 2022] PUT /identity/v3/projects/969cff30a287451992bab0e5551fe5cc/users/1eabe574e15a4c3d8b0edf19c2a28de4/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:25:04.509164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8486-f895-4d36-b09f-038e22613746 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:04.509444 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8486-f895-4d36-b09f-038e22613746 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:04.509702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d8486-f895-4d36-b09f-038e22613746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:04.551085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cc2d8486-f895-4d36-b09f-038e22613746 None None] MFA Rules not processed for user `1eabe574e15a4c3d8b0edf19c2a28de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:25:04.552512 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cc2d8486-f895-4d36-b09f-038e22613746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:04.637837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1366/2717] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:25:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:25:04.650705 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903e52c-481c-4e59-86f0-5a6f8866b372 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:04.652533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2903e52c-481c-4e59-86f0-5a6f8866b372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:04.680738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:25:04.718473 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903e52c-481c-4e59-86f0-5a6f8866b372 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:04.722551 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4ca6f-c945-436f-90d6-6addb3762c3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c3d7cdad7f44f0f8df944ec7f69de26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:04.723201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4ca6f-c945-436f-90d6-6addb3762c3e service glance] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:04.723478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4ca6f-c945-436f-90d6-6addb3762c3e service glance] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:04.723800 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4ca6f-c945-436f-90d6-6addb3762c3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:04.733927 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4ca6f-c945-436f-90d6-6addb3762c3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:04.735486 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4ca6f-c945-436f-90d6-6addb3762c3e service glance] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:04.746218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1352/2718] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:25:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:25:14.634405 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:25:14.741274 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=16 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:25:51.144820 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8486-f895-4d36-b09f-038e22613746 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:51.147124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cc2d8486-f895-4d36-b09f-038e22613746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:51.220840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d8486-f895-4d36-b09f-038e22613746 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:51.225689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:51.226359 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:51.226639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:51.226903 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] PATH_INFO: `/v3/users/2d139f12296d47f588aa6f50a41047c0` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:51.228125 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d139f12296d47f588aa6f50a41047c0)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:51.230167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:51.283089 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d139f12296d47f588aa6f50a41047c0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:51.284066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d139f12296d47f588aa6f50a41047c0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:51.292150 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d139f12296d47f588aa6f50a41047c0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:51.292861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d139f12296d47f588aa6f50a41047c0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:51.306039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d139f12296d47f588aa6f50a41047c0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:51.319103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1367/2719] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:25:51 2022] DELETE /identity/v3/users/2d139f12296d47f588aa6f50a41047c0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:25:51.323503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622485e1-bb38-4458-b4f5-1fd67a699e28 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:51.324023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622485e1-bb38-4458-b4f5-1fd67a699e28 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:51.324110 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622485e1-bb38-4458-b4f5-1fd67a699e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:51.343483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-622485e1-bb38-4458-b4f5-1fd67a699e28 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:25:51.344707 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-622485e1-bb38-4458-b4f5-1fd67a699e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:51.403917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1353/2720] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:25:51.417497 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:51.419041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:51.481694 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88644e-b1e5-4392-b277-d4fe10b753a9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:51.485864 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45151d90-d192-4238-a75e-25f6155cab19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:51.486514 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45151d90-d192-4238-a75e-25f6155cab19 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:51.486807 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45151d90-d192-4238-a75e-25f6155cab19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:51.487075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45151d90-d192-4238-a75e-25f6155cab19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:51.498632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45151d90-d192-4238-a75e-25f6155cab19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:51.500943 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45151d90-d192-4238-a75e-25f6155cab19 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:51.515501 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1368/2721] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:25:51.834265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622485e1-bb38-4458-b4f5-1fd67a699e28 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:25:51.836732 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-622485e1-bb38-4458-b4f5-1fd67a699e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:25:51.852441 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622485e1-bb38-4458-b4f5-1fd67a699e28 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:25:51.858430 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:25:51.859099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:25:51.859380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:25:51.859658 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] PATH_INFO: `/v3/projects/9655e85cc1944bfdae6f9ef7e78dc2ba` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:25:51.860877 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9655e85cc1944bfdae6f9ef7e78dc2ba)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:25:51.863752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:25:51.944261 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9655e85cc1944bfdae6f9ef7e78dc2ba', 'request_id': 'req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:51.955173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9655e85cc1944bfdae6f9ef7e78dc2ba', 'request_id': 'req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:51.963439 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9655e85cc1944bfdae6f9ef7e78dc2ba', 'request_id': 'req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:51.978589 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] The token cache is being invalidate because project 9655e85cc1944bfdae6f9ef7e78dc2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:25:51.979133 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:51.979824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:25:51.981413 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1354/2722] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:25:51 2022] DELETE /identity/v3/projects/9655e85cc1944bfdae6f9ef7e78dc2ba => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:26:01.508706 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:01.636169 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45151d90-d192-4238-a75e-25f6155cab19 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:01.637876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-45151d90-d192-4238-a75e-25f6155cab19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:01.836560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45151d90-d192-4238-a75e-25f6155cab19 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:01.895365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a67f06-b015-4a7b-9381-07c613ae8c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:01.896173 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a67f06-b015-4a7b-9381-07c613ae8c6e service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:01.896455 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a67f06-b015-4a7b-9381-07c613ae8c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:01.896728 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a67f06-b015-4a7b-9381-07c613ae8c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:01.899171 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-42a67f06-b015-4a7b-9381-07c613ae8c6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:01.974466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:01.989133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a67f06-b015-4a7b-9381-07c613ae8c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:01.990582 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a67f06-b015-4a7b-9381-07c613ae8c6e service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:02.009620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1369/2723] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:26:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:26:02.980671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:02.982356 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:03.061742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a304a5-f455-43a4-8b7c-29cb8b6799ee admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:03.066972 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:03.067642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:03.067923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:03.068219 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] PATH_INFO: `/v3/users/1eabe574e15a4c3d8b0edf19c2a28de4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:03.069510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eabe574e15a4c3d8b0edf19c2a28de4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:03.071464 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:03.125035 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eabe574e15a4c3d8b0edf19c2a28de4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:03.135738 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eabe574e15a4c3d8b0edf19c2a28de4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:03.144990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eabe574e15a4c3d8b0edf19c2a28de4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:03.145608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eabe574e15a4c3d8b0edf19c2a28de4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:03.158192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eabe574e15a4c3d8b0edf19c2a28de4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:03.164703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1355/2724] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:26:02 2022] DELETE /identity/v3/users/1eabe574e15a4c3d8b0edf19c2a28de4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:26:03.169547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa85c7-66bc-42b6-8fc1-03a92b57bd5d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:03.170105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa85c7-66bc-42b6-8fc1-03a92b57bd5d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:03.170105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa85c7-66bc-42b6-8fc1-03a92b57bd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:03.189896 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-42fa85c7-66bc-42b6-8fc1-03a92b57bd5d None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:26:03.191167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-42fa85c7-66bc-42b6-8fc1-03a92b57bd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:03.234032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:03.256229 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1370/2725] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:26:03.267763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:03.269328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:03.344776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d49b3-6317-45c9-a47f-9424b6ba3f87 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:03.348940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665ab47-246d-4454-8599-6fc8f1df8411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:03.349558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ab47-246d-4454-8599-6fc8f1df8411 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:03.349837 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ab47-246d-4454-8599-6fc8f1df8411 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:03.350103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ab47-246d-4454-8599-6fc8f1df8411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:03.360475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665ab47-246d-4454-8599-6fc8f1df8411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:03.362039 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665ab47-246d-4454-8599-6fc8f1df8411 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:03.372434 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1356/2726] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:26:04.156520 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa85c7-66bc-42b6-8fc1-03a92b57bd5d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:04.157111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-42fa85c7-66bc-42b6-8fc1-03a92b57bd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:04.178214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa85c7-66bc-42b6-8fc1-03a92b57bd5d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:04.187328 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39291d-6395-4daa-a432-a7b8210698e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:04.188110 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39291d-6395-4daa-a432-a7b8210698e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:04.188694 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39291d-6395-4daa-a432-a7b8210698e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:04.189025 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39291d-6395-4daa-a432-a7b8210698e5 admin admin] PATH_INFO: `/v3/projects/969cff30a287451992bab0e5551fe5cc` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:04.190790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39291d-6395-4daa-a432-a7b8210698e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=969cff30a287451992bab0e5551fe5cc)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:04.193646 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39291d-6395-4daa-a432-a7b8210698e5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:04.251472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bd39291d-6395-4daa-a432-a7b8210698e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969cff30a287451992bab0e5551fe5cc', 'request_id': 'req-bd39291d-6395-4daa-a432-a7b8210698e5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:04.261456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bd39291d-6395-4daa-a432-a7b8210698e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969cff30a287451992bab0e5551fe5cc', 'request_id': 'req-bd39291d-6395-4daa-a432-a7b8210698e5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:04.270599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bd39291d-6395-4daa-a432-a7b8210698e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969cff30a287451992bab0e5551fe5cc', 'request_id': 'req-bd39291d-6395-4daa-a432-a7b8210698e5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:04.289440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bd39291d-6395-4daa-a432-a7b8210698e5 admin admin] The token cache is being invalidate because project 969cff30a287451992bab0e5551fe5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:26:04.289895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bd39291d-6395-4daa-a432-a7b8210698e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:04.290692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-bd39291d-6395-4daa-a432-a7b8210698e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:04.292370 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1371/2727] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:26:04 2022] DELETE /identity/v3/projects/969cff30a287451992bab0e5551fe5cc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:26:04.298363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309978ea-098b-48f1-b9b4-ac7cea3cc199 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:04.298905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309978ea-098b-48f1-b9b4-ac7cea3cc199 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:04.298905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309978ea-098b-48f1-b9b4-ac7cea3cc199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:04.320955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-309978ea-098b-48f1-b9b4-ac7cea3cc199 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:26:04.322202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-309978ea-098b-48f1-b9b4-ac7cea3cc199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:04.340889 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:04.392011 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1357/2728] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:26:04.401872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb81a38-badf-4cc8-b3eb-9bae3e9f2c30 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:04.402151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb81a38-badf-4cc8-b3eb-9bae3e9f2c30 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:04.402425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb81a38-badf-4cc8-b3eb-9bae3e9f2c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:04.422924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1fb81a38-badf-4cc8-b3eb-9bae3e9f2c30 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:26:04.424143 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1fb81a38-badf-4cc8-b3eb-9bae3e9f2c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:04.432733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1372/2729] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:26:04.437523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309978ea-098b-48f1-b9b4-ac7cea3cc199 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:04.448358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309978ea-098b-48f1-b9b4-ac7cea3cc199 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:04.453459 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4691d-adc0-42bd-9c5c-d844491b240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:04.454118 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4691d-adc0-42bd-9c5c-d844491b240d admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:04.454393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4691d-adc0-42bd-9c5c-d844491b240d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:04.454663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4691d-adc0-42bd-9c5c-d844491b240d admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:04.455372 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4691d-adc0-42bd-9c5c-d844491b240d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:26:04.455728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4691d-adc0-42bd-9c5c-d844491b240d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:04.457349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4691d-adc0-42bd-9c5c-d844491b240d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:04.471611 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1358/2730] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:26:04.476701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb81a38-badf-4cc8-b3eb-9bae3e9f2c30 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:04.486401 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb81a38-badf-4cc8-b3eb-9bae3e9f2c30 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:04.491237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a5599-fe4f-49f0-a6f7-afb5e05c2125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:04.491868 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a5599-fe4f-49f0-a6f7-afb5e05c2125 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:04.492141 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a5599-fe4f-49f0-a6f7-afb5e05c2125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:04.492408 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a5599-fe4f-49f0-a6f7-afb5e05c2125 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:04.493118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a5599-fe4f-49f0-a6f7-afb5e05c2125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:04.495047 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a5599-fe4f-49f0-a6f7-afb5e05c2125 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:04.524274 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1373/2731] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:26:04 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:26:04.528619 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4691d-adc0-42bd-9c5c-d844491b240d admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:04.539142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4691d-adc0-42bd-9c5c-d844491b240d admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:04.612173 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564a62a-0803-4ea2-a8bb-d5198a12cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:04.612815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564a62a-0803-4ea2-a8bb-d5198a12cfce admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:04.613164 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564a62a-0803-4ea2-a8bb-d5198a12cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:04.613431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564a62a-0803-4ea2-a8bb-d5198a12cfce admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:04.614129 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564a62a-0803-4ea2-a8bb-d5198a12cfce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:04.616114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564a62a-0803-4ea2-a8bb-d5198a12cfce admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:04.647414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1359/2732] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:26:04 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:26:04.651733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a5599-fe4f-49f0-a6f7-afb5e05c2125 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:04.663448 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a5599-fe4f-49f0-a6f7-afb5e05c2125 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:04.668319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf77c3d-4e14-4419-abf3-0004bc91e98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:04.669004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf77c3d-4e14-4419-abf3-0004bc91e98f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:04.670308 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf77c3d-4e14-4419-abf3-0004bc91e98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:04.670590 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf77c3d-4e14-4419-abf3-0004bc91e98f admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:04.671405 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf77c3d-4e14-4419-abf3-0004bc91e98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:04.673094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf77c3d-4e14-4419-abf3-0004bc91e98f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:04.690012 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1374/2733] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:26:04.695567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564a62a-0803-4ea2-a8bb-d5198a12cfce admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:04.707230 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564a62a-0803-4ea2-a8bb-d5198a12cfce admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:04.712395 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd29d15-34b4-4395-9778-94ade46551c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:04.713065 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd29d15-34b4-4395-9778-94ade46551c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:04.713363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd29d15-34b4-4395-9778-94ade46551c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:04.713621 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd29d15-34b4-4395-9778-94ade46551c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:04.714344 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd29d15-34b4-4395-9778-94ade46551c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:04.716014 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd29d15-34b4-4395-9778-94ade46551c3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:04.728037 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1360/2734] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:26:04.734202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf77c3d-4e14-4419-abf3-0004bc91e98f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:04.745703 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf77c3d-4e14-4419-abf3-0004bc91e98f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:04.751132 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc812f-c75d-44a1-8855-e1bcfe828ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:04.751952 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc812f-c75d-44a1-8855-e1bcfe828ead admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:04.752307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc812f-c75d-44a1-8855-e1bcfe828ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:04.752641 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc812f-c75d-44a1-8855-e1bcfe828ead admin admin] PATH_INFO: `/v3/projects/f5b80306557f466c911aba552768c24e/users/a8662b6620724850b0bae866c518a100/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:04.771135 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc812f-c75d-44a1-8855-e1bcfe828ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b80306557f466c911aba552768c24e, user_id=a8662b6620724850b0bae866c518a100, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:04.773916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc812f-c75d-44a1-8855-e1bcfe828ead admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:04.794505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1375/2735] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:26:04 2022] PUT /identity/v3/projects/f5b80306557f466c911aba552768c24e/users/a8662b6620724850b0bae866c518a100/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:26:04.803594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6047b5f-a6cd-4dfb-bf85-0d821abf5161 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:04.803594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6047b5f-a6cd-4dfb-bf85-0d821abf5161 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:04.804031 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6047b5f-a6cd-4dfb-bf85-0d821abf5161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:04.835964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d6047b5f-a6cd-4dfb-bf85-0d821abf5161 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:26:04.837897 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d6047b5f-a6cd-4dfb-bf85-0d821abf5161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:04.917933 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1361/2736] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:26:04.928076 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc812f-c75d-44a1-8855-e1bcfe828ead admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:04.930437 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fefc812f-c75d-44a1-8855-e1bcfe828ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:05.008568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc812f-c75d-44a1-8855-e1bcfe828ead admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:05.012670 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dd8c2-e08c-4f00-962c-0a5863fcc3b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:05.013431 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dd8c2-e08c-4f00-962c-0a5863fcc3b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:05.013917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dd8c2-e08c-4f00-962c-0a5863fcc3b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:05.014189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dd8c2-e08c-4f00-962c-0a5863fcc3b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:05.025051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dd8c2-e08c-4f00-962c-0a5863fcc3b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:05.026514 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dd8c2-e08c-4f00-962c-0a5863fcc3b6 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:05.040568 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1376/2737] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:26:06.058533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45d7ad-4de6-4ad8-a219-f50d63340f07 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:06.059480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45d7ad-4de6-4ad8-a219-f50d63340f07 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:06.059480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45d7ad-4de6-4ad8-a219-f50d63340f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:06.062736 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dd8c2-e08c-4f00-962c-0a5863fcc3b6 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:06.065329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2a9dd8c2-e08c-4f00-962c-0a5863fcc3b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:06.078905 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:06.127135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-ac45d7ad-4de6-4ad8-a219-f50d63340f07 None None] MFA Rules not processed for user `a8662b6620724850b0bae866c518a100`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:26:06.128462 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ac45d7ad-4de6-4ad8-a219-f50d63340f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:06.163483 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:06.270895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dd8c2-e08c-4f00-962c-0a5863fcc3b6 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:06.292872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93104c5-bdfe-4f43-a38a-8781a1922744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:06.294276 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93104c5-bdfe-4f43-a38a-8781a1922744 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:06.296113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93104c5-bdfe-4f43-a38a-8781a1922744 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:06.296841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93104c5-bdfe-4f43-a38a-8781a1922744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:06.299639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e93104c5-bdfe-4f43-a38a-8781a1922744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:06.327341 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93104c5-bdfe-4f43-a38a-8781a1922744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:06.331075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93104c5-bdfe-4f43-a38a-8781a1922744 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:06.349014 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1377/2738] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:26:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:26:06.356159 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1362/2739] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:26:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:26:06.378023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93104c5-bdfe-4f43-a38a-8781a1922744 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:06.383090 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e93104c5-bdfe-4f43-a38a-8781a1922744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:06.501124 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93104c5-bdfe-4f43-a38a-8781a1922744 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:06.505085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37245a7-3fd7-4917-a7fe-caa7329ddc54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:06.505713 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37245a7-3fd7-4917-a7fe-caa7329ddc54 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:06.505992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37245a7-3fd7-4917-a7fe-caa7329ddc54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:06.506260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37245a7-3fd7-4917-a7fe-caa7329ddc54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:06.517882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37245a7-3fd7-4917-a7fe-caa7329ddc54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:06.519351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37245a7-3fd7-4917-a7fe-caa7329ddc54 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:06.530223 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1378/2740] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:26:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:26:08.200771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad15f-3e16-4041-815d-31ec42294665 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:08.201431 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad15f-3e16-4041-815d-31ec42294665 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:08.201869 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad15f-3e16-4041-815d-31ec42294665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:08.238964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-7e0ad15f-3e16-4041-815d-31ec42294665 None None] MFA Rules not processed for user `a8662b6620724850b0bae866c518a100`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:26:08.240774 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7e0ad15f-3e16-4041-815d-31ec42294665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:08.253820 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1363/2741] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:26:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:26:08.571892 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37245a7-3fd7-4917-a7fe-caa7329ddc54 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:08.574012 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a37245a7-3fd7-4917-a7fe-caa7329ddc54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:08.588119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37245a7-3fd7-4917-a7fe-caa7329ddc54 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:08.592263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7ead7-ebb1-443d-b08b-e71c37a5495f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:08.592929 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7ead7-ebb1-443d-b08b-e71c37a5495f service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:08.593219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7ead7-ebb1-443d-b08b-e71c37a5495f service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:08.593493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7ead7-ebb1-443d-b08b-e71c37a5495f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:08.595513 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2cc7ead7-ebb1-443d-b08b-e71c37a5495f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:08.606284 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7ead7-ebb1-443d-b08b-e71c37a5495f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:08.607954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7ead7-ebb1-443d-b08b-e71c37a5495f service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:08.619175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1379/2742] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:26:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:26:09.016106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad15f-3e16-4041-815d-31ec42294665 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:09.017590 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7e0ad15f-3e16-4041-815d-31ec42294665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:09.134485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad15f-3e16-4041-815d-31ec42294665 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:09.142903 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c954c-1e78-4b5a-b58d-a6a85e0f2726 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:09.143523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c954c-1e78-4b5a-b58d-a6a85e0f2726 service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:09.143803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c954c-1e78-4b5a-b58d-a6a85e0f2726 service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:09.144101 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c954c-1e78-4b5a-b58d-a6a85e0f2726 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:09.146254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-176c954c-1e78-4b5a-b58d-a6a85e0f2726 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:09.160231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c954c-1e78-4b5a-b58d-a6a85e0f2726 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:09.162146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c954c-1e78-4b5a-b58d-a6a85e0f2726 service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:09.173510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1364/2743] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:26:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:26:11.176269 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7ead7-ebb1-443d-b08b-e71c37a5495f service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:11.185872 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7ead7-ebb1-443d-b08b-e71c37a5495f service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:11.190151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6224351-997a-47db-bfa3-d614b77e0b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:11.190786 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6224351-997a-47db-bfa3-d614b77e0b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:11.191162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6224351-997a-47db-bfa3-d614b77e0b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:11.191415 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6224351-997a-47db-bfa3-d614b77e0b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:11.193327 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b6224351-997a-47db-bfa3-d614b77e0b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:11.206477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6224351-997a-47db-bfa3-d614b77e0b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:11.208026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6224351-997a-47db-bfa3-d614b77e0b47 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:11.219938 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1380/2744] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:26:15.119121 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c954c-1e78-4b5a-b58d-a6a85e0f2726 service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:15.136754 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c954c-1e78-4b5a-b58d-a6a85e0f2726 service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:15.144644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc339ff-2b80-4c40-ad2f-156b16dbdeca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:15.145342 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc339ff-2b80-4c40-ad2f-156b16dbdeca service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:15.145683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc339ff-2b80-4c40-ad2f-156b16dbdeca service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:15.145960 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc339ff-2b80-4c40-ad2f-156b16dbdeca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:15.148020 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-efc339ff-2b80-4c40-ad2f-156b16dbdeca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:15.172010 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc339ff-2b80-4c40-ad2f-156b16dbdeca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:15.173940 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc339ff-2b80-4c40-ad2f-156b16dbdeca service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:15.187496 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1365/2745] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:26:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:26:15.253069 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6224351-997a-47db-bfa3-d614b77e0b47 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:15.255511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b6224351-997a-47db-bfa3-d614b77e0b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:15.286409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6224351-997a-47db-bfa3-d614b77e0b47 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:15.296983 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e55194-58b3-4830-9a02-9f51b7662517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:15.297779 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e55194-58b3-4830-9a02-9f51b7662517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:15.298475 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e55194-58b3-4830-9a02-9f51b7662517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:15.298960 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e55194-58b3-4830-9a02-9f51b7662517 admin admin] PATH_INFO: `/v3/users/723cdd3baceb4f51a57df4863af99c3e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:15.300409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e55194-58b3-4830-9a02-9f51b7662517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=723cdd3baceb4f51a57df4863af99c3e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:15.302581 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e55194-58b3-4830-9a02-9f51b7662517 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:15.368739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-45e55194-58b3-4830-9a02-9f51b7662517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723cdd3baceb4f51a57df4863af99c3e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:15.369477 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-45e55194-58b3-4830-9a02-9f51b7662517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723cdd3baceb4f51a57df4863af99c3e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:15.378305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-45e55194-58b3-4830-9a02-9f51b7662517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723cdd3baceb4f51a57df4863af99c3e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:15.378959 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-45e55194-58b3-4830-9a02-9f51b7662517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723cdd3baceb4f51a57df4863af99c3e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:15.385823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:15.394374 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-45e55194-58b3-4830-9a02-9f51b7662517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723cdd3baceb4f51a57df4863af99c3e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:15.407923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1381/2746] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:26:15 2022] DELETE /identity/v3/users/723cdd3baceb4f51a57df4863af99c3e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:26:15.607680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc339ff-2b80-4c40-ad2f-156b16dbdeca service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:15.622520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc339ff-2b80-4c40-ad2f-156b16dbdeca service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:15.697558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302b35b-318b-4b6b-881b-c3b4520dce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:15.698221 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302b35b-318b-4b6b-881b-c3b4520dce47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:15.698504 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302b35b-318b-4b6b-881b-c3b4520dce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:15.698774 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302b35b-318b-4b6b-881b-c3b4520dce47 admin admin] PATH_INFO: `/v3/projects/f3385eb4afc441ba834ec0ddc1c3fd9a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:15.699997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302b35b-318b-4b6b-881b-c3b4520dce47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3385eb4afc441ba834ec0ddc1c3fd9a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:15.702241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302b35b-318b-4b6b-881b-c3b4520dce47 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:15.742436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:15.761781 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2302b35b-318b-4b6b-881b-c3b4520dce47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'request_id': 'req-2302b35b-318b-4b6b-881b-c3b4520dce47'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:15.771571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2302b35b-318b-4b6b-881b-c3b4520dce47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'request_id': 'req-2302b35b-318b-4b6b-881b-c3b4520dce47'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:15.778316 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2302b35b-318b-4b6b-881b-c3b4520dce47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3385eb4afc441ba834ec0ddc1c3fd9a', 'request_id': 'req-2302b35b-318b-4b6b-881b-c3b4520dce47'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:15.790941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2302b35b-318b-4b6b-881b-c3b4520dce47 admin admin] The token cache is being invalidate because project f3385eb4afc441ba834ec0ddc1c3fd9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:26:15.791224 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2302b35b-318b-4b6b-881b-c3b4520dce47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:15.792009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2302b35b-318b-4b6b-881b-c3b4520dce47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:26:15.793719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1366/2747] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:26:15 2022] DELETE /identity/v3/projects/f3385eb4afc441ba834ec0ddc1c3fd9a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:26:15.799069 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a826b9-1b3d-4fc9-93d9-b5801dc31415 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:15.799351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a826b9-1b3d-4fc9-93d9-b5801dc31415 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:15.799619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a826b9-1b3d-4fc9-93d9-b5801dc31415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:15.821701 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f8a826b9-1b3d-4fc9-93d9-b5801dc31415 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:26:15.822920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f8a826b9-1b3d-4fc9-93d9-b5801dc31415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:15.900462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1382/2748] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:26:15.915016 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d21d25-945a-4752-9947-9289ebf19541 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:15.915498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d21d25-945a-4752-9947-9289ebf19541 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:15.915973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d21d25-945a-4752-9947-9289ebf19541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:15.938685 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-83d21d25-945a-4752-9947-9289ebf19541 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:26:15.939950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-83d21d25-945a-4752-9947-9289ebf19541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:15.948753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1367/2749] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:26:15.953825 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a826b9-1b3d-4fc9-93d9-b5801dc31415 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:15.964210 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a826b9-1b3d-4fc9-93d9-b5801dc31415 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:15.969630 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f922b-e3e4-4afb-a4ba-af5ec2bfcaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:15.970325 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f922b-e3e4-4afb-a4ba-af5ec2bfcaaf admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:15.970643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f922b-e3e4-4afb-a4ba-af5ec2bfcaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:15.970976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f922b-e3e4-4afb-a4ba-af5ec2bfcaaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:15.971816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f922b-e3e4-4afb-a4ba-af5ec2bfcaaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:26:15.972215 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f922b-e3e4-4afb-a4ba-af5ec2bfcaaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:15.974224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f922b-e3e4-4afb-a4ba-af5ec2bfcaaf admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:15.988387 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1383/2750] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:26:15.993420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d21d25-945a-4752-9947-9289ebf19541 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:16.003550 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d21d25-945a-4752-9947-9289ebf19541 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:16.011924 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dff0f-6860-4084-bc1b-32a55448e5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:16.012574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dff0f-6860-4084-bc1b-32a55448e5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.012852 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dff0f-6860-4084-bc1b-32a55448e5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.013182 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dff0f-6860-4084-bc1b-32a55448e5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.013907 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5dff0f-6860-4084-bc1b-32a55448e5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:16.015858 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5dff0f-6860-4084-bc1b-32a55448e5c0 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:16.051013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1368/2751] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:26:15 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:26:16.056152 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f922b-e3e4-4afb-a4ba-af5ec2bfcaaf admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:16.074446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f922b-e3e4-4afb-a4ba-af5ec2bfcaaf admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:16.154572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776b3c7-829c-4e5a-9c13-798b3afc6ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:16.155227 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776b3c7-829c-4e5a-9c13-798b3afc6ada admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.155500 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776b3c7-829c-4e5a-9c13-798b3afc6ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.155773 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776b3c7-829c-4e5a-9c13-798b3afc6ada admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.156450 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776b3c7-829c-4e5a-9c13-798b3afc6ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:16.158439 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776b3c7-829c-4e5a-9c13-798b3afc6ada admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:16.182394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1384/2752] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:26:16 2022] POST /identity/v3/users => generated 286 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:26:16.187136 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dff0f-6860-4084-bc1b-32a55448e5c0 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:16.198892 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5dff0f-6860-4084-bc1b-32a55448e5c0 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:16.205056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780d7d7-1e78-4b77-b311-9acf56695a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:16.205713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d7d7-1e78-4b77-b311-9acf56695a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.205991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d7d7-1e78-4b77-b311-9acf56695a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.206283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780d7d7-1e78-4b77-b311-9acf56695a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.206996 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780d7d7-1e78-4b77-b311-9acf56695a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:16.208644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780d7d7-1e78-4b77-b311-9acf56695a4a admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:16.220850 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1369/2753] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:26:16.225528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776b3c7-829c-4e5a-9c13-798b3afc6ada admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:16.236260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776b3c7-829c-4e5a-9c13-798b3afc6ada admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:16.241407 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402cc60-ccd9-4d78-8216-f9d45422bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:16.242044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402cc60-ccd9-4d78-8216-f9d45422bb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.242311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402cc60-ccd9-4d78-8216-f9d45422bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.242595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402cc60-ccd9-4d78-8216-f9d45422bb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.243300 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402cc60-ccd9-4d78-8216-f9d45422bb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:16.244994 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402cc60-ccd9-4d78-8216-f9d45422bb9d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:16.260772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1385/2754] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:26:16.262025 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780d7d7-1e78-4b77-b311-9acf56695a4a admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:16.273562 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780d7d7-1e78-4b77-b311-9acf56695a4a admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:16.279640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe941-be7c-47bf-aea8-6b9ef63c5245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:16.280348 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe941-be7c-47bf-aea8-6b9ef63c5245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.280626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe941-be7c-47bf-aea8-6b9ef63c5245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.280922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe941-be7c-47bf-aea8-6b9ef63c5245 admin admin] PATH_INFO: `/v3/projects/8c090af4217240089f5dec795dc9a869/users/f29106d7d0e5463899008182b3d2c330/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.307191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbe941-be7c-47bf-aea8-6b9ef63c5245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c090af4217240089f5dec795dc9a869, user_id=f29106d7d0e5463899008182b3d2c330, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:16.312700 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbe941-be7c-47bf-aea8-6b9ef63c5245 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:16.330621 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1370/2755] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:26:16 2022] PUT /identity/v3/projects/8c090af4217240089f5dec795dc9a869/users/f29106d7d0e5463899008182b3d2c330/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:26:16.342089 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808af8f-7745-4d7d-9b26-2f72f594da44 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.342442 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808af8f-7745-4d7d-9b26-2f72f594da44 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.342802 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808af8f-7745-4d7d-9b26-2f72f594da44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.378577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e808af8f-7745-4d7d-9b26-2f72f594da44 None None] MFA Rules not processed for user `f29106d7d0e5463899008182b3d2c330`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:26:16.379939 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e808af8f-7745-4d7d-9b26-2f72f594da44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:16.417151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:16.456681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1386/2756] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:26:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:26:16.461859 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe941-be7c-47bf-aea8-6b9ef63c5245 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:16.552578 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe941-be7c-47bf-aea8-6b9ef63c5245 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:16.559375 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dcc02-40dc-4941-90c0-6cd7bc010050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:16.560026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dcc02-40dc-4941-90c0-6cd7bc010050 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.560343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dcc02-40dc-4941-90c0-6cd7bc010050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.560615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dcc02-40dc-4941-90c0-6cd7bc010050 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.561353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dcc02-40dc-4941-90c0-6cd7bc010050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:16.564114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dcc02-40dc-4941-90c0-6cd7bc010050 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:16.594036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1371/2757] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:26:16 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:26:16.598594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808af8f-7745-4d7d-9b26-2f72f594da44 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:16.610356 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808af8f-7745-4d7d-9b26-2f72f594da44 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:16.675277 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4efdf-ec2b-4ed5-a4f0-f1ceaa4a770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:16.675961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4efdf-ec2b-4ed5-a4f0-f1ceaa4a770a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.676264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4efdf-ec2b-4ed5-a4f0-f1ceaa4a770a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.676542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4efdf-ec2b-4ed5-a4f0-f1ceaa4a770a admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.677265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4efdf-ec2b-4ed5-a4f0-f1ceaa4a770a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:16.679221 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4efdf-ec2b-4ed5-a4f0-f1ceaa4a770a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:16.703739 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1387/2758] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:26:16 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:26:16.709916 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dcc02-40dc-4941-90c0-6cd7bc010050 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:16.721586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dcc02-40dc-4941-90c0-6cd7bc010050 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:16.727255 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714e10-078c-4781-b015-714f862ab898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:16.727874 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714e10-078c-4781-b015-714f862ab898 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.728156 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714e10-078c-4781-b015-714f862ab898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.728427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714e10-078c-4781-b015-714f862ab898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.729165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76714e10-078c-4781-b015-714f862ab898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:16.730854 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76714e10-078c-4781-b015-714f862ab898 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:16.742090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1372/2759] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:26:16.746673 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4efdf-ec2b-4ed5-a4f0-f1ceaa4a770a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:16.758254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4efdf-ec2b-4ed5-a4f0-f1ceaa4a770a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:16.763823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07f1d1-054c-4c8d-899c-59c8633c5c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:16.764493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07f1d1-054c-4c8d-899c-59c8633c5c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.764740 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07f1d1-054c-4c8d-899c-59c8633c5c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.765034 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07f1d1-054c-4c8d-899c-59c8633c5c01 admin admin] PATH_INFO: `/v3/projects/2761ffe0aa0841cc85ca1b2eb8061fd0/users/f084f90cf09c4eac84201f7f6572cfa4/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.783932 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07f1d1-054c-4c8d-899c-59c8633c5c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2761ffe0aa0841cc85ca1b2eb8061fd0, user_id=f084f90cf09c4eac84201f7f6572cfa4, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:16.786635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07f1d1-054c-4c8d-899c-59c8633c5c01 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:16.806220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1388/2760] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:26:16 2022] PUT /identity/v3/projects/2761ffe0aa0841cc85ca1b2eb8061fd0/users/f084f90cf09c4eac84201f7f6572cfa4/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:26:16.811727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714e10-078c-4781-b015-714f862ab898 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:16.822592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714e10-078c-4781-b015-714f862ab898 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:16.850293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:16.884508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fdb41-fae0-4335-9e10-904b0e243dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:16.885170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fdb41-fae0-4335-9e10-904b0e243dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.885489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fdb41-fae0-4335-9e10-904b0e243dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.885842 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fdb41-fae0-4335-9e10-904b0e243dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.886545 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fdb41-fae0-4335-9e10-904b0e243dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:16.888229 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fdb41-fae0-4335-9e10-904b0e243dc1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:16.898975 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1373/2761] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:26:16.904931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07f1d1-054c-4c8d-899c-59c8633c5c01 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:16.916318 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07f1d1-054c-4c8d-899c-59c8633c5c01 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:16.921564 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d869d-3cb2-4f5c-99b5-d8e079719bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:16.922237 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d869d-3cb2-4f5c-99b5-d8e079719bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.922518 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d869d-3cb2-4f5c-99b5-d8e079719bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.922790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d869d-3cb2-4f5c-99b5-d8e079719bbb admin admin] PATH_INFO: `/v3/projects/2761ffe0aa0841cc85ca1b2eb8061fd0/users/f084f90cf09c4eac84201f7f6572cfa4/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.925041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d869d-3cb2-4f5c-99b5-d8e079719bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2761ffe0aa0841cc85ca1b2eb8061fd0, user_id=f084f90cf09c4eac84201f7f6572cfa4, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:16.928038 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d869d-3cb2-4f5c-99b5-d8e079719bbb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:16.940382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1389/2762] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:26:16 2022] PUT /identity/v3/projects/2761ffe0aa0841cc85ca1b2eb8061fd0/users/f084f90cf09c4eac84201f7f6572cfa4/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:26:16.950829 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95e7ab-85b8-41c0-a7b6-605b26b453c7 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:16.951147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95e7ab-85b8-41c0-a7b6-605b26b453c7 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:16.951421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95e7ab-85b8-41c0-a7b6-605b26b453c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:16.982974 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-cb95e7ab-85b8-41c0-a7b6-605b26b453c7 None None] MFA Rules not processed for user `f084f90cf09c4eac84201f7f6572cfa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:26:16.984211 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cb95e7ab-85b8-41c0-a7b6-605b26b453c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:17.059581 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1374/2763] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:26:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:26:17.071621 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d869d-3cb2-4f5c-99b5-d8e079719bbb admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:17.073696 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3e1d869d-3cb2-4f5c-99b5-d8e079719bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:17.133986 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d869d-3cb2-4f5c-99b5-d8e079719bbb admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:17.138189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07684cb0-8b51-43ac-b814-06e32e25b60c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:17.138863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07684cb0-8b51-43ac-b814-06e32e25b60c service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:17.139140 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07684cb0-8b51-43ac-b814-06e32e25b60c service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:17.139413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07684cb0-8b51-43ac-b814-06e32e25b60c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:17.154642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07684cb0-8b51-43ac-b814-06e32e25b60c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:17.156033 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07684cb0-8b51-43ac-b814-06e32e25b60c service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:17.166528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1390/2764] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:26:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:26:17.249910 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95e7ab-85b8-41c0-a7b6-605b26b453c7 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:17.261977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95e7ab-85b8-41c0-a7b6-605b26b453c7 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:17.269521 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf483f-64ea-4b2a-9525-ca91bb249026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:17.270166 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf483f-64ea-4b2a-9525-ca91bb249026 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:17.270435 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf483f-64ea-4b2a-9525-ca91bb249026 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:17.270702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf483f-64ea-4b2a-9525-ca91bb249026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:17.337032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf483f-64ea-4b2a-9525-ca91bb249026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:17.338417 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf483f-64ea-4b2a-9525-ca91bb249026 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:17.348032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1375/2765] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:26:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:26:19.457838 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07684cb0-8b51-43ac-b814-06e32e25b60c service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:26:19.459712 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-07684cb0-8b51-43ac-b814-06e32e25b60c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:19.510863 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:19.582217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07684cb0-8b51-43ac-b814-06e32e25b60c service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:26:19.591481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e98d69-d49e-4dcd-b694-7d958587ea10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:26:19.592558 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e98d69-d49e-4dcd-b694-7d958587ea10 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:26:19.593075 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e98d69-d49e-4dcd-b694-7d958587ea10 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:26:19.593573 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e98d69-d49e-4dcd-b694-7d958587ea10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:26:19.596463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-44e98d69-d49e-4dcd-b694-7d958587ea10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:26:19.618737 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e98d69-d49e-4dcd-b694-7d958587ea10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:26:19.621835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e98d69-d49e-4dcd-b694-7d958587ea10 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:26:19.643595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1391/2766] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:26:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:26:27.343823 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=78 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:26:29.633649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=21 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:12.369586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf483f-64ea-4b2a-9525-ca91bb249026 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:12.435429 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf483f-64ea-4b2a-9525-ca91bb249026 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:12.440088 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:12.440844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:12.441257 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:12.441796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] PATH_INFO: `/v3/users/f29106d7d0e5463899008182b3d2c330` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:12.442962 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29106d7d0e5463899008182b3d2c330)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:12.447137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:12.500463 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29106d7d0e5463899008182b3d2c330'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:12.507967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29106d7d0e5463899008182b3d2c330'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:12.516747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29106d7d0e5463899008182b3d2c330'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:12.517425 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29106d7d0e5463899008182b3d2c330'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:12.531798 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29106d7d0e5463899008182b3d2c330'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:12.539639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1376/2767] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:27:12 2022] DELETE /identity/v3/users/f29106d7d0e5463899008182b3d2c330 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:12.545213 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f68478-4970-4436-a8e3-22b812e7891a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:12.545861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f68478-4970-4436-a8e3-22b812e7891a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:12.545861 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f68478-4970-4436-a8e3-22b812e7891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:12.571267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-38f68478-4970-4436-a8e3-22b812e7891a None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:12.572530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-38f68478-4970-4436-a8e3-22b812e7891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:12.645612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1392/2768] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:12.656852 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:12.658508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:12.733851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745546d-8977-47ef-bd7f-abd0f73664c5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:12.738232 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0315f8-c308-44f6-a01b-e29dbc470f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:12.738896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0315f8-c308-44f6-a01b-e29dbc470f1b service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:12.739174 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0315f8-c308-44f6-a01b-e29dbc470f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:12.739468 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0315f8-c308-44f6-a01b-e29dbc470f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:12.750510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0315f8-c308-44f6-a01b-e29dbc470f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:12.752011 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0315f8-c308-44f6-a01b-e29dbc470f1b service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:12.763416 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1377/2769] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:27:13.079114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f68478-4970-4436-a8e3-22b812e7891a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:13.080726 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-38f68478-4970-4436-a8e3-22b812e7891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:13.094262 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f68478-4970-4436-a8e3-22b812e7891a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:13.099666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:13.100365 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:13.101489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:13.101489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] PATH_INFO: `/v3/projects/8c090af4217240089f5dec795dc9a869` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:13.102583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c090af4217240089f5dec795dc9a869)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:13.104666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:13.161706 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c090af4217240089f5dec795dc9a869', 'request_id': 'req-4ae53f6e-05d1-4733-acec-73061c0e2675'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:13.172401 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c090af4217240089f5dec795dc9a869', 'request_id': 'req-4ae53f6e-05d1-4733-acec-73061c0e2675'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:13.178724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c090af4217240089f5dec795dc9a869', 'request_id': 'req-4ae53f6e-05d1-4733-acec-73061c0e2675'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:13.190892 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] The token cache is being invalidate because project 8c090af4217240089f5dec795dc9a869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:27:13.191176 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:13.191854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:13.194222 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1393/2770] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:27:13 2022] DELETE /identity/v3/projects/8c090af4217240089f5dec795dc9a869 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:13.198888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0315f8-c308-44f6-a01b-e29dbc470f1b service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:13.209783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0315f8-c308-44f6-a01b-e29dbc470f1b service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:13.232672 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:13.284683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff14d3-4f95-4de0-9ab3-96184e65321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:13.285383 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff14d3-4f95-4de0-9ab3-96184e65321d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:13.285663 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff14d3-4f95-4de0-9ab3-96184e65321d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:13.285930 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff14d3-4f95-4de0-9ab3-96184e65321d admin admin] PATH_INFO: `/v3/users/f084f90cf09c4eac84201f7f6572cfa4` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:13.287190 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff14d3-4f95-4de0-9ab3-96184e65321d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f084f90cf09c4eac84201f7f6572cfa4)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:13.289304 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff14d3-4f95-4de0-9ab3-96184e65321d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:13.356434 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8bff14d3-4f95-4de0-9ab3-96184e65321d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f084f90cf09c4eac84201f7f6572cfa4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:13.370004 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8bff14d3-4f95-4de0-9ab3-96184e65321d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f084f90cf09c4eac84201f7f6572cfa4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:13.382328 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8bff14d3-4f95-4de0-9ab3-96184e65321d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f084f90cf09c4eac84201f7f6572cfa4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:13.383122 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8bff14d3-4f95-4de0-9ab3-96184e65321d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f084f90cf09c4eac84201f7f6572cfa4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:13.399040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-8bff14d3-4f95-4de0-9ab3-96184e65321d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f084f90cf09c4eac84201f7f6572cfa4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:13.405646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1378/2771] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:27:13 2022] DELETE /identity/v3/users/f084f90cf09c4eac84201f7f6572cfa4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:13.829579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:13.831111 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:13.844660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae53f6e-05d1-4733-acec-73061c0e2675 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:13.918257 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4698a-b525-4a39-8423-3dba77bdc053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:13.919146 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4698a-b525-4a39-8423-3dba77bdc053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:13.919471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4698a-b525-4a39-8423-3dba77bdc053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:13.919760 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4698a-b525-4a39-8423-3dba77bdc053 admin admin] PATH_INFO: `/v3/projects/2761ffe0aa0841cc85ca1b2eb8061fd0` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:13.920985 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4698a-b525-4a39-8423-3dba77bdc053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2761ffe0aa0841cc85ca1b2eb8061fd0)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:13.923281 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4698a-b525-4a39-8423-3dba77bdc053 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:13.969364 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:13.987678 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-47f4698a-b525-4a39-8423-3dba77bdc053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2761ffe0aa0841cc85ca1b2eb8061fd0', 'request_id': 'req-47f4698a-b525-4a39-8423-3dba77bdc053'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:13.996547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-47f4698a-b525-4a39-8423-3dba77bdc053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2761ffe0aa0841cc85ca1b2eb8061fd0', 'request_id': 'req-47f4698a-b525-4a39-8423-3dba77bdc053'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:14.002567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-47f4698a-b525-4a39-8423-3dba77bdc053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2761ffe0aa0841cc85ca1b2eb8061fd0', 'request_id': 'req-47f4698a-b525-4a39-8423-3dba77bdc053'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:14.014170 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-47f4698a-b525-4a39-8423-3dba77bdc053 admin admin] The token cache is being invalidate because project 2761ffe0aa0841cc85ca1b2eb8061fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:27:14.014454 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-47f4698a-b525-4a39-8423-3dba77bdc053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:14.015198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-47f4698a-b525-4a39-8423-3dba77bdc053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:14.016732 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1394/2772] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:27:13 2022] DELETE /identity/v3/projects/2761ffe0aa0841cc85ca1b2eb8061fd0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:14.022135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447439a-6ca5-463d-af62-c5bd7f8d1b69 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.022421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447439a-6ca5-463d-af62-c5bd7f8d1b69 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.022718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447439a-6ca5-463d-af62-c5bd7f8d1b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.043608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-b447439a-6ca5-463d-af62-c5bd7f8d1b69 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:14.044977 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b447439a-6ca5-463d-af62-c5bd7f8d1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:14.115353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1379/2773] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:14.123482 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccc5ce-3472-40c0-9cb4-e5f77c094d49 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.123764 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccc5ce-3472-40c0-9cb4-e5f77c094d49 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.124047 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccc5ce-3472-40c0-9cb4-e5f77c094d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.148505 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9eccc5ce-3472-40c0-9cb4-e5f77c094d49 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:14.150219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9eccc5ce-3472-40c0-9cb4-e5f77c094d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:14.159462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1395/2774] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:14.164117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447439a-6ca5-463d-af62-c5bd7f8d1b69 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:14.174913 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447439a-6ca5-463d-af62-c5bd7f8d1b69 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:14.180482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d25b7-087a-4a9e-97bb-c10977bb21e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:14.181138 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d25b7-087a-4a9e-97bb-c10977bb21e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.181420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d25b7-087a-4a9e-97bb-c10977bb21e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.181690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d25b7-087a-4a9e-97bb-c10977bb21e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.182384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d25b7-087a-4a9e-97bb-c10977bb21e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:27:14.182694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d25b7-087a-4a9e-97bb-c10977bb21e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:14.184320 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d25b7-087a-4a9e-97bb-c10977bb21e9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:14.197592 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1380/2775] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:27:14.202394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccc5ce-3472-40c0-9cb4-e5f77c094d49 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:14.212533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccc5ce-3472-40c0-9cb4-e5f77c094d49 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:14.218412 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dc759-f39a-4ff8-8098-899aabbfc5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:14.219167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc759-f39a-4ff8-8098-899aabbfc5ad admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.219583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc759-f39a-4ff8-8098-899aabbfc5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.219936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc759-f39a-4ff8-8098-899aabbfc5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.220679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dc759-f39a-4ff8-8098-899aabbfc5ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:14.222800 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dc759-f39a-4ff8-8098-899aabbfc5ad admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:14.268019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1396/2776] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:27:14 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:27:14.269324 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d25b7-087a-4a9e-97bb-c10977bb21e9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:14.285735 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d25b7-087a-4a9e-97bb-c10977bb21e9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:14.287870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dc759-f39a-4ff8-8098-899aabbfc5ad admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:14.289816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8a9dc759-f39a-4ff8-8098-899aabbfc5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:14.335976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:14.391540 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dc759-f39a-4ff8-8098-899aabbfc5ad admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:14.394245 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee4eb1-8a7e-4b0b-bbb5-ae423f3b24dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:14.395057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee4eb1-8a7e-4b0b-bbb5-ae423f3b24dc admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.395428 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee4eb1-8a7e-4b0b-bbb5-ae423f3b24dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.395907 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee4eb1-8a7e-4b0b-bbb5-ae423f3b24dc admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.396666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee4eb1-8a7e-4b0b-bbb5-ae423f3b24dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:14.399192 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee4eb1-8a7e-4b0b-bbb5-ae423f3b24dc admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:14.400286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0307473-458c-4703-8d93-1c4b0ddc9fd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:14.401189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0307473-458c-4703-8d93-1c4b0ddc9fd4 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.401624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0307473-458c-4703-8d93-1c4b0ddc9fd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.402069 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0307473-458c-4703-8d93-1c4b0ddc9fd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.404466 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a0307473-458c-4703-8d93-1c4b0ddc9fd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:14.423993 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0307473-458c-4703-8d93-1c4b0ddc9fd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:14.426026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0307473-458c-4703-8d93-1c4b0ddc9fd4 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:14.439146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1381/2777] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:27:14 2022] POST /identity/v3/users => generated 282 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:27:14.443730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee4eb1-8a7e-4b0b-bbb5-ae423f3b24dc admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:14.445122 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1397/2778] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:27:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:27:14.458355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee4eb1-8a7e-4b0b-bbb5-ae423f3b24dc admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:14.467076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277e628-1ab5-4326-b3bd-33940157d4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:14.467076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e628-1ab5-4326-b3bd-33940157d4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.467076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e628-1ab5-4326-b3bd-33940157d4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.467076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e628-1ab5-4326-b3bd-33940157d4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.467878 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277e628-1ab5-4326-b3bd-33940157d4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:14.469961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277e628-1ab5-4326-b3bd-33940157d4cf admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:14.482939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1382/2779] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 07:27:14.487196 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0307473-458c-4703-8d93-1c4b0ddc9fd4 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:14.499162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0307473-458c-4703-8d93-1c4b0ddc9fd4 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:14.506043 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61a407-0c69-415a-9f4e-927faec71937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:14.507550 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a407-0c69-415a-9f4e-927faec71937 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.508049 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a407-0c69-415a-9f4e-927faec71937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.508502 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a407-0c69-415a-9f4e-927faec71937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.509427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61a407-0c69-415a-9f4e-927faec71937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:14.511527 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61a407-0c69-415a-9f4e-927faec71937 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:14.533093 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1398/2780] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:27:14.535117 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277e628-1ab5-4326-b3bd-33940157d4cf admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:14.550403 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277e628-1ab5-4326-b3bd-33940157d4cf admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:14.557389 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07180e-99f4-4eb3-b5ff-0f0a12479444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:14.558485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07180e-99f4-4eb3-b5ff-0f0a12479444 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.558963 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07180e-99f4-4eb3-b5ff-0f0a12479444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.559415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07180e-99f4-4eb3-b5ff-0f0a12479444 admin admin] PATH_INFO: `/v3/projects/3f5c2fc43e7d4e00bd417dbd8642a365/users/e422f1fc52b442da800016e29f1cdc24/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.580747 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07180e-99f4-4eb3-b5ff-0f0a12479444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5c2fc43e7d4e00bd417dbd8642a365, user_id=e422f1fc52b442da800016e29f1cdc24, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:14.583579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07180e-99f4-4eb3-b5ff-0f0a12479444 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:14.603535 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1383/2781] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:27:14 2022] PUT /identity/v3/projects/3f5c2fc43e7d4e00bd417dbd8642a365/users/e422f1fc52b442da800016e29f1cdc24/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:27:14.615643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388dec-14f8-4b89-9ed5-156e53227639 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.615931 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388dec-14f8-4b89-9ed5-156e53227639 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.616212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388dec-14f8-4b89-9ed5-156e53227639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.646620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-aa388dec-14f8-4b89-9ed5-156e53227639 None None] MFA Rules not processed for user `e422f1fc52b442da800016e29f1cdc24`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:14.648251 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-aa388dec-14f8-4b89-9ed5-156e53227639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:14.705201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:14.726514 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1399/2782] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:14.731123 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07180e-99f4-4eb3-b5ff-0f0a12479444 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:14.798714 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07180e-99f4-4eb3-b5ff-0f0a12479444 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:14.804121 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e82410-f96e-4c25-8dce-51316f496195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:14.804809 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e82410-f96e-4c25-8dce-51316f496195 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.805122 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e82410-f96e-4c25-8dce-51316f496195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.805394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e82410-f96e-4c25-8dce-51316f496195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.806087 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e82410-f96e-4c25-8dce-51316f496195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:14.808043 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e82410-f96e-4c25-8dce-51316f496195 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:14.838475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1384/2783] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:27:14 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:27:14.842413 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa388dec-14f8-4b89-9ed5-156e53227639 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:14.854834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa388dec-14f8-4b89-9ed5-156e53227639 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:14.915180 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41708e5f-e7ea-4d27-894b-f8c6ae131d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:14.915804 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41708e5f-e7ea-4d27-894b-f8c6ae131d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.916077 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41708e5f-e7ea-4d27-894b-f8c6ae131d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.916348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41708e5f-e7ea-4d27-894b-f8c6ae131d19 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.917078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41708e5f-e7ea-4d27-894b-f8c6ae131d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:14.918967 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41708e5f-e7ea-4d27-894b-f8c6ae131d19 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:14.942544 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1400/2784] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:27:14 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:27:14.946895 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e82410-f96e-4c25-8dce-51316f496195 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:14.964046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e82410-f96e-4c25-8dce-51316f496195 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:14.973233 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee558f2-af82-4c7a-82b3-fcd120581240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:14.974338 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee558f2-af82-4c7a-82b3-fcd120581240 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:14.975070 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee558f2-af82-4c7a-82b3-fcd120581240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:14.976021 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee558f2-af82-4c7a-82b3-fcd120581240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:14.977029 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee558f2-af82-4c7a-82b3-fcd120581240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:14.980102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee558f2-af82-4c7a-82b3-fcd120581240 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:15.005727 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1385/2785] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:27:15.014240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41708e5f-e7ea-4d27-894b-f8c6ae131d19 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:15.025117 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41708e5f-e7ea-4d27-894b-f8c6ae131d19 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:15.030310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2878a23-53db-4d68-a4eb-aafa15bacab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:15.031002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2878a23-53db-4d68-a4eb-aafa15bacab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:15.031283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2878a23-53db-4d68-a4eb-aafa15bacab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:15.031560 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2878a23-53db-4d68-a4eb-aafa15bacab8 admin admin] PATH_INFO: `/v3/projects/8d8365cfc7314dd88a6a514e78d27142/users/a05e7b465f8d4318b2fb44460ae64a6d/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:15.049054 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2878a23-53db-4d68-a4eb-aafa15bacab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8365cfc7314dd88a6a514e78d27142, user_id=a05e7b465f8d4318b2fb44460ae64a6d, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:15.051792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2878a23-53db-4d68-a4eb-aafa15bacab8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:15.066842 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1401/2786] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:27:15 2022] PUT /identity/v3/projects/8d8365cfc7314dd88a6a514e78d27142/users/a05e7b465f8d4318b2fb44460ae64a6d/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:15.074345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee558f2-af82-4c7a-82b3-fcd120581240 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:15.085469 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee558f2-af82-4c7a-82b3-fcd120581240 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:15.144347 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:15.152085 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df74512-9fa7-421b-8410-e6bb6f4e7206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:15.152759 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df74512-9fa7-421b-8410-e6bb6f4e7206 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:15.153205 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df74512-9fa7-421b-8410-e6bb6f4e7206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:15.153480 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df74512-9fa7-421b-8410-e6bb6f4e7206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:15.154315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df74512-9fa7-421b-8410-e6bb6f4e7206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:15.156114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df74512-9fa7-421b-8410-e6bb6f4e7206 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:15.168060 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1386/2787] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:27:15.173436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2878a23-53db-4d68-a4eb-aafa15bacab8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:15.186599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2878a23-53db-4d68-a4eb-aafa15bacab8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:15.191445 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92a31b-b4d7-4942-ab88-6c2a4a6388a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:15.192131 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92a31b-b4d7-4942-ab88-6c2a4a6388a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:15.192405 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92a31b-b4d7-4942-ab88-6c2a4a6388a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:15.192733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92a31b-b4d7-4942-ab88-6c2a4a6388a1 admin admin] PATH_INFO: `/v3/projects/8d8365cfc7314dd88a6a514e78d27142/users/a05e7b465f8d4318b2fb44460ae64a6d/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:15.194632 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92a31b-b4d7-4942-ab88-6c2a4a6388a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8365cfc7314dd88a6a514e78d27142, user_id=a05e7b465f8d4318b2fb44460ae64a6d, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:15.197354 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92a31b-b4d7-4942-ab88-6c2a4a6388a1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:15.213884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1402/2788] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:27:15 2022] PUT /identity/v3/projects/8d8365cfc7314dd88a6a514e78d27142/users/a05e7b465f8d4318b2fb44460ae64a6d/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:15.226475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5552-8147-4973-8d61-c317a6e4acf6 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:15.226827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5552-8147-4973-8d61-c317a6e4acf6 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:15.227183 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5552-8147-4973-8d61-c317a6e4acf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:15.263172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2cbd5552-8147-4973-8d61-c317a6e4acf6 None None] MFA Rules not processed for user `a05e7b465f8d4318b2fb44460ae64a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:15.264513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2cbd5552-8147-4973-8d61-c317a6e4acf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:15.351644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1387/2789] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:15.363621 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92a31b-b4d7-4942-ab88-6c2a4a6388a1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:15.365658 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3d92a31b-b4d7-4942-ab88-6c2a4a6388a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:15.430904 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92a31b-b4d7-4942-ab88-6c2a4a6388a1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:15.434920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab3379-cb7b-4742-9cee-d5b18988e071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:15.435693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3379-cb7b-4742-9cee-d5b18988e071 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:15.436057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3379-cb7b-4742-9cee-d5b18988e071 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:15.436338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3379-cb7b-4742-9cee-d5b18988e071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:15.446840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab3379-cb7b-4742-9cee-d5b18988e071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:15.448201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab3379-cb7b-4742-9cee-d5b18988e071 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:15.458449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1403/2790] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:27:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:27:15.961446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd5552-8147-4973-8d61-c317a6e4acf6 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:16.034436 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd5552-8147-4973-8d61-c317a6e4acf6 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:16.039315 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:16.040038 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:16.040268 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:16.040579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] PATH_INFO: `/v3/users/e422f1fc52b442da800016e29f1cdc24` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:16.042050 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e422f1fc52b442da800016e29f1cdc24)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:16.044054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:16.104286 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e422f1fc52b442da800016e29f1cdc24'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.111278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e422f1fc52b442da800016e29f1cdc24'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.120119 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e422f1fc52b442da800016e29f1cdc24'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.120793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e422f1fc52b442da800016e29f1cdc24'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.134288 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e422f1fc52b442da800016e29f1cdc24'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.135787 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:16.146730 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1388/2791] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:27:15 2022] DELETE /identity/v3/users/e422f1fc52b442da800016e29f1cdc24 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:16.151802 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9515535-bce1-4342-ab98-5b58d7dffae3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:16.152343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9515535-bce1-4342-ab98-5b58d7dffae3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:16.152343 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9515535-bce1-4342-ab98-5b58d7dffae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:16.171399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f9515535-bce1-4342-ab98-5b58d7dffae3 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:16.172627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f9515535-bce1-4342-ab98-5b58d7dffae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:16.218184 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:16.237248 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1404/2792] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:16.247669 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:16.249380 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:16.314807 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847d96a-2ff0-46ad-aeb3-d89391c1ba8c admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:16.318981 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f727a-932b-414d-8980-1591a5f30cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:16.319604 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f727a-932b-414d-8980-1591a5f30cef service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:16.319881 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f727a-932b-414d-8980-1591a5f30cef service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:16.320152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f727a-932b-414d-8980-1591a5f30cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:16.329771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f727a-932b-414d-8980-1591a5f30cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:16.331215 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f727a-932b-414d-8980-1591a5f30cef service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:16.341231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1389/2793] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:27:16.626715 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9515535-bce1-4342-ab98-5b58d7dffae3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:16.628316 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f9515535-bce1-4342-ab98-5b58d7dffae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:16.643051 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9515535-bce1-4342-ab98-5b58d7dffae3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:16.647990 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:16.648643 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:16.648948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:16.649220 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] PATH_INFO: `/v3/projects/3f5c2fc43e7d4e00bd417dbd8642a365` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:16.650389 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5c2fc43e7d4e00bd417dbd8642a365)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:16.652282 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:16.707892 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5c2fc43e7d4e00bd417dbd8642a365', 'request_id': 'req-499bed79-9060-40be-b2ff-1f16c140848d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.721489 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5c2fc43e7d4e00bd417dbd8642a365', 'request_id': 'req-499bed79-9060-40be-b2ff-1f16c140848d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.728296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5c2fc43e7d4e00bd417dbd8642a365', 'request_id': 'req-499bed79-9060-40be-b2ff-1f16c140848d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.739772 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] The token cache is being invalidate because project 3f5c2fc43e7d4e00bd417dbd8642a365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:27:16.740063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.740721 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.742285 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1405/2794] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:27:16 2022] DELETE /identity/v3/projects/3f5c2fc43e7d4e00bd417dbd8642a365 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:16.746493 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f727a-932b-414d-8980-1591a5f30cef service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:16.757815 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f727a-932b-414d-8980-1591a5f30cef service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:16.835679 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ffa7-9091-45a4-8ac0-06c9de5d7ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:16.836508 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ffa7-9091-45a4-8ac0-06c9de5d7ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:16.837057 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ffa7-9091-45a4-8ac0-06c9de5d7ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:16.837495 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ffa7-9091-45a4-8ac0-06c9de5d7ff7 admin admin] PATH_INFO: `/v3/users/a05e7b465f8d4318b2fb44460ae64a6d` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:16.839135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5ffa7-9091-45a4-8ac0-06c9de5d7ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05e7b465f8d4318b2fb44460ae64a6d)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:16.842585 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5ffa7-9091-45a4-8ac0-06c9de5d7ff7 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:16.903838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d6a5ffa7-9091-45a4-8ac0-06c9de5d7ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05e7b465f8d4318b2fb44460ae64a6d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.916084 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d6a5ffa7-9091-45a4-8ac0-06c9de5d7ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05e7b465f8d4318b2fb44460ae64a6d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.930241 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d6a5ffa7-9091-45a4-8ac0-06c9de5d7ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05e7b465f8d4318b2fb44460ae64a6d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.931223 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d6a5ffa7-9091-45a4-8ac0-06c9de5d7ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05e7b465f8d4318b2fb44460ae64a6d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.951859 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-d6a5ffa7-9091-45a4-8ac0-06c9de5d7ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05e7b465f8d4318b2fb44460ae64a6d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:16.961646 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1390/2795] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:27:16 2022] DELETE /identity/v3/users/a05e7b465f8d4318b2fb44460ae64a6d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:17.290307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:17.291914 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:17.305604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bed79-9060-40be-b2ff-1f16c140848d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:17.370592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754fd26-3617-4011-b533-88ef658e21fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:17.371234 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754fd26-3617-4011-b533-88ef658e21fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:17.371517 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754fd26-3617-4011-b533-88ef658e21fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:17.371869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754fd26-3617-4011-b533-88ef658e21fc admin admin] PATH_INFO: `/v3/projects/8d8365cfc7314dd88a6a514e78d27142` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:17.373214 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754fd26-3617-4011-b533-88ef658e21fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d8365cfc7314dd88a6a514e78d27142)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:17.375172 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754fd26-3617-4011-b533-88ef658e21fc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:17.424380 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7754fd26-3617-4011-b533-88ef658e21fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d8365cfc7314dd88a6a514e78d27142', 'request_id': 'req-7754fd26-3617-4011-b533-88ef658e21fc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:17.431577 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7754fd26-3617-4011-b533-88ef658e21fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d8365cfc7314dd88a6a514e78d27142', 'request_id': 'req-7754fd26-3617-4011-b533-88ef658e21fc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:17.440028 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7754fd26-3617-4011-b533-88ef658e21fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d8365cfc7314dd88a6a514e78d27142', 'request_id': 'req-7754fd26-3617-4011-b533-88ef658e21fc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:17.448589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:17.454579 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7754fd26-3617-4011-b533-88ef658e21fc admin admin] The token cache is being invalidate because project 8d8365cfc7314dd88a6a514e78d27142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:27:17.454878 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7754fd26-3617-4011-b533-88ef658e21fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:17.456147 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7754fd26-3617-4011-b533-88ef658e21fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:17.458279 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1406/2796] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:27:17 2022] DELETE /identity/v3/projects/8d8365cfc7314dd88a6a514e78d27142 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:17.464637 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e991e-19e0-4b45-9c9d-df31eecbfd50 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:17.464988 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e991e-19e0-4b45-9c9d-df31eecbfd50 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:17.465255 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e991e-19e0-4b45-9c9d-df31eecbfd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:17.485955 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-633e991e-19e0-4b45-9c9d-df31eecbfd50 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:17.487187 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-633e991e-19e0-4b45-9c9d-df31eecbfd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:17.500689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:17.565868 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1391/2797] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:17.575129 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c36e5-7b17-4b89-8f5c-c16974ee9514 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:17.575659 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c36e5-7b17-4b89-8f5c-c16974ee9514 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:17.576135 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c36e5-7b17-4b89-8f5c-c16974ee9514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:17.607162 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8c2c36e5-7b17-4b89-8f5c-c16974ee9514 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:17.608752 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8c2c36e5-7b17-4b89-8f5c-c16974ee9514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:17.620811 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1407/2798] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:17.629890 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e991e-19e0-4b45-9c9d-df31eecbfd50 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:17.644506 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e991e-19e0-4b45-9c9d-df31eecbfd50 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:17.652354 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2108c-38bb-49fb-a6b5-ab2f50aad9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:17.653022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2108c-38bb-49fb-a6b5-ab2f50aad9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:17.653299 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2108c-38bb-49fb-a6b5-ab2f50aad9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:17.653574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2108c-38bb-49fb-a6b5-ab2f50aad9f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:17.654373 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2108c-38bb-49fb-a6b5-ab2f50aad9f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:27:17.654675 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2108c-38bb-49fb-a6b5-ab2f50aad9f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:17.656359 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2108c-38bb-49fb-a6b5-ab2f50aad9f9 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:17.669725 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1392/2799] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:27:17.674792 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c36e5-7b17-4b89-8f5c-c16974ee9514 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:17.687295 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c36e5-7b17-4b89-8f5c-c16974ee9514 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:17.693369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaea6d-40bc-4be5-9299-988aeaa40314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:17.693988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaea6d-40bc-4be5-9299-988aeaa40314 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:17.694260 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaea6d-40bc-4be5-9299-988aeaa40314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:17.694528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaea6d-40bc-4be5-9299-988aeaa40314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:17.695188 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeaea6d-40bc-4be5-9299-988aeaa40314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:17.697098 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeaea6d-40bc-4be5-9299-988aeaa40314 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:17.728617 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1408/2800] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:27:17 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:27:17.732941 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2108c-38bb-49fb-a6b5-ab2f50aad9f9 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:17.743694 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2108c-38bb-49fb-a6b5-ab2f50aad9f9 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:17.809625 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7876d27-ad46-46e5-a529-a5ac529864ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:17.810249 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7876d27-ad46-46e5-a529-a5ac529864ef admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:17.815309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7876d27-ad46-46e5-a529-a5ac529864ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:17.815657 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7876d27-ad46-46e5-a529-a5ac529864ef admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:17.816391 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7876d27-ad46-46e5-a529-a5ac529864ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:17.818523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7876d27-ad46-46e5-a529-a5ac529864ef admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:17.844753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1393/2801] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:27:17 2022] POST /identity/v3/users => generated 282 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:27:17.851232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaea6d-40bc-4be5-9299-988aeaa40314 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:17.865039 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaea6d-40bc-4be5-9299-988aeaa40314 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:17.871481 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cce737-4791-454b-ad29-aff06b6eefa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:17.872037 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cce737-4791-454b-ad29-aff06b6eefa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:17.872319 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cce737-4791-454b-ad29-aff06b6eefa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:17.872655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cce737-4791-454b-ad29-aff06b6eefa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:17.873393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cce737-4791-454b-ad29-aff06b6eefa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:17.875005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cce737-4791-454b-ad29-aff06b6eefa1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:17.890271 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1409/2802] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:27:17.894572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7876d27-ad46-46e5-a529-a5ac529864ef admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:17.905166 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7876d27-ad46-46e5-a529-a5ac529864ef admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:17.910752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2b72d-a5e6-4c1f-9660-8a38913f70bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:17.911421 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b72d-a5e6-4c1f-9660-8a38913f70bf admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:17.911734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b72d-a5e6-4c1f-9660-8a38913f70bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:17.912009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2b72d-a5e6-4c1f-9660-8a38913f70bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:17.912928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2b72d-a5e6-4c1f-9660-8a38913f70bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:17.914640 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2b72d-a5e6-4c1f-9660-8a38913f70bf admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:17.926594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1394/2803] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:27:17.931009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cce737-4791-454b-ad29-aff06b6eefa1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:17.942567 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cce737-4791-454b-ad29-aff06b6eefa1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:17.948457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbfbc7-723c-48fc-8a3d-ad5203a8f93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:17.949159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbfbc7-723c-48fc-8a3d-ad5203a8f93a admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:17.949436 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbfbc7-723c-48fc-8a3d-ad5203a8f93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:17.949707 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbfbc7-723c-48fc-8a3d-ad5203a8f93a admin admin] PATH_INFO: `/v3/projects/8cc17d9e66f440d1a7a2d461d6d03580/users/eab45231a31946a795294ed010b6ede5/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:17.967488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbfbc7-723c-48fc-8a3d-ad5203a8f93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc17d9e66f440d1a7a2d461d6d03580, user_id=eab45231a31946a795294ed010b6ede5, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:17.970219 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbfbc7-723c-48fc-8a3d-ad5203a8f93a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:17.987613 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1410/2804] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:27:17 2022] PUT /identity/v3/projects/8cc17d9e66f440d1a7a2d461d6d03580/users/eab45231a31946a795294ed010b6ede5/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:18.004495 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2926bb9-d3d4-4642-b70c-1ef85a04dfee None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:18.005135 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2926bb9-d3d4-4642-b70c-1ef85a04dfee None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:18.005291 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2926bb9-d3d4-4642-b70c-1ef85a04dfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:18.044658 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-d2926bb9-d3d4-4642-b70c-1ef85a04dfee None None] MFA Rules not processed for user `eab45231a31946a795294ed010b6ede5`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:18.046321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-d2926bb9-d3d4-4642-b70c-1ef85a04dfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:18.120102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1395/2805] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:18.125100 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbfbc7-723c-48fc-8a3d-ad5203a8f93a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:18.193693 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbfbc7-723c-48fc-8a3d-ad5203a8f93a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:18.203192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4ea3e-5467-4f94-b8e5-088ff1c88ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:18.203847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4ea3e-5467-4f94-b8e5-088ff1c88ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:18.204139 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4ea3e-5467-4f94-b8e5-088ff1c88ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:18.204384 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4ea3e-5467-4f94-b8e5-088ff1c88ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:18.205119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4ea3e-5467-4f94-b8e5-088ff1c88ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:18.207065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4ea3e-5467-4f94-b8e5-088ff1c88ad7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:18.241789 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1411/2806] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:27:18 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:27:18.246000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2926bb9-d3d4-4642-b70c-1ef85a04dfee None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:18.258770 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2926bb9-d3d4-4642-b70c-1ef85a04dfee None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:18.272291 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:18.333076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f9ee-c9b0-4147-9600-0f98cf7d8285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:18.333763 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f9ee-c9b0-4147-9600-0f98cf7d8285 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:18.334080 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f9ee-c9b0-4147-9600-0f98cf7d8285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:18.334414 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f9ee-c9b0-4147-9600-0f98cf7d8285 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:18.335095 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8f9ee-c9b0-4147-9600-0f98cf7d8285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:18.337188 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8f9ee-c9b0-4147-9600-0f98cf7d8285 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:18.363206 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1396/2807] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:27:18 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:27:18.368494 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4ea3e-5467-4f94-b8e5-088ff1c88ad7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:18.380059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4ea3e-5467-4f94-b8e5-088ff1c88ad7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:18.385734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141504c-7389-4a15-969a-097ffbdf4cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:18.386368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141504c-7389-4a15-969a-097ffbdf4cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:18.386665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141504c-7389-4a15-969a-097ffbdf4cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:18.386923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141504c-7389-4a15-969a-097ffbdf4cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:18.387624 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141504c-7389-4a15-969a-097ffbdf4cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:18.389299 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141504c-7389-4a15-969a-097ffbdf4cb7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:18.401305 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1412/2808] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:27:18.406317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f9ee-c9b0-4147-9600-0f98cf7d8285 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:18.416734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f9ee-c9b0-4147-9600-0f98cf7d8285 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:18.421776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df3c73-f268-47e8-8d10-6fd72e022cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:18.422459 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df3c73-f268-47e8-8d10-6fd72e022cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:18.422739 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df3c73-f268-47e8-8d10-6fd72e022cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:18.423013 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df3c73-f268-47e8-8d10-6fd72e022cd1 admin admin] PATH_INFO: `/v3/projects/13ba66c9e15a4dca80ecaada02b21d39/users/1007b39400e342419e04e21b4541f14a/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:18.440005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df3c73-f268-47e8-8d10-6fd72e022cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba66c9e15a4dca80ecaada02b21d39, user_id=1007b39400e342419e04e21b4541f14a, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:18.444189 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df3c73-f268-47e8-8d10-6fd72e022cd1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:18.467901 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1397/2809] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:27:18 2022] PUT /identity/v3/projects/13ba66c9e15a4dca80ecaada02b21d39/users/1007b39400e342419e04e21b4541f14a/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:27:18.472916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141504c-7389-4a15-969a-097ffbdf4cb7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:18.485895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141504c-7389-4a15-969a-097ffbdf4cb7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:18.559818 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb0f25-93fa-4977-8084-9a70ac9b5b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:18.560462 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb0f25-93fa-4977-8084-9a70ac9b5b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:18.560742 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb0f25-93fa-4977-8084-9a70ac9b5b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:18.561044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb0f25-93fa-4977-8084-9a70ac9b5b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:18.561757 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb0f25-93fa-4977-8084-9a70ac9b5b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:18.563399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb0f25-93fa-4977-8084-9a70ac9b5b0e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:18.574692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1413/2810] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:27:18.579339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df3c73-f268-47e8-8d10-6fd72e022cd1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:18.590847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df3c73-f268-47e8-8d10-6fd72e022cd1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:18.596427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caace1cf-de3a-44fd-b19d-2b8b2029bea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:18.597171 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caace1cf-de3a-44fd-b19d-2b8b2029bea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:18.597447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caace1cf-de3a-44fd-b19d-2b8b2029bea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:18.597886 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caace1cf-de3a-44fd-b19d-2b8b2029bea5 admin admin] PATH_INFO: `/v3/projects/13ba66c9e15a4dca80ecaada02b21d39/users/1007b39400e342419e04e21b4541f14a/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:18.600466 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caace1cf-de3a-44fd-b19d-2b8b2029bea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba66c9e15a4dca80ecaada02b21d39, user_id=1007b39400e342419e04e21b4541f14a, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:18.603272 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caace1cf-de3a-44fd-b19d-2b8b2029bea5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:18.616078 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1398/2811] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:27:18 2022] PUT /identity/v3/projects/13ba66c9e15a4dca80ecaada02b21d39/users/1007b39400e342419e04e21b4541f14a/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:18.626992 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0116756-6fb2-4b6d-9afd-02690d23a822 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:18.627264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0116756-6fb2-4b6d-9afd-02690d23a822 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:18.627546 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0116756-6fb2-4b6d-9afd-02690d23a822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:18.636430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:18.661240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d0116756-6fb2-4b6d-9afd-02690d23a822 None None] MFA Rules not processed for user `1007b39400e342419e04e21b4541f14a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:18.662658 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d0116756-6fb2-4b6d-9afd-02690d23a822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:18.735212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1414/2812] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:18.750359 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caace1cf-de3a-44fd-b19d-2b8b2029bea5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:18.753459 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-caace1cf-de3a-44fd-b19d-2b8b2029bea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:18.817503 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caace1cf-de3a-44fd-b19d-2b8b2029bea5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:18.821350 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c796da-2c4c-4b87-95ce-83095d9ac316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:18.821973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c796da-2c4c-4b87-95ce-83095d9ac316 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:18.822290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c796da-2c4c-4b87-95ce-83095d9ac316 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:18.822562 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c796da-2c4c-4b87-95ce-83095d9ac316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:18.832142 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c796da-2c4c-4b87-95ce-83095d9ac316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:18.833749 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c796da-2c4c-4b87-95ce-83095d9ac316 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:18.844866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1399/2813] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:27:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:27:18.932925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0116756-6fb2-4b6d-9afd-02690d23a822 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:18.944692 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0116756-6fb2-4b6d-9afd-02690d23a822 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:18.950253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a773618-5cee-4991-adc4-02e720c3d5e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:18.951117 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a773618-5cee-4991-adc4-02e720c3d5e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:18.951409 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a773618-5cee-4991-adc4-02e720c3d5e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:18.951785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a773618-5cee-4991-adc4-02e720c3d5e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:19.016228 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a773618-5cee-4991-adc4-02e720c3d5e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:19.017785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a773618-5cee-4991-adc4-02e720c3d5e1 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:19.027585 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1415/2814] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:27:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:27:24.043990 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c796da-2c4c-4b87-95ce-83095d9ac316 service cinder] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:24.128297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c796da-2c4c-4b87-95ce-83095d9ac316 service cinder] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:24.133519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:24.134172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:24.134452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:24.134729 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] PATH_INFO: `/v3/users/eab45231a31946a795294ed010b6ede5` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:24.135954 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab45231a31946a795294ed010b6ede5)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:24.137964 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:24.151690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:24.189698 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab45231a31946a795294ed010b6ede5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:24.197771 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab45231a31946a795294ed010b6ede5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:24.206866 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab45231a31946a795294ed010b6ede5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:24.207664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab45231a31946a795294ed010b6ede5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:24.220963 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab45231a31946a795294ed010b6ede5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:24.227445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1400/2815] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:27:24 2022] DELETE /identity/v3/users/eab45231a31946a795294ed010b6ede5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:27:24.232609 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ec69b-e624-45c4-966d-6310427ffe7e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:24.233153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ec69b-e624-45c4-966d-6310427ffe7e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:24.233286 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ec69b-e624-45c4-966d-6310427ffe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:24.252854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-707ec69b-e624-45c4-966d-6310427ffe7e None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:24.254212 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-707ec69b-e624-45c4-966d-6310427ffe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:24.331927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1416/2816] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:27:24.342220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:24.343719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:24.410264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3e42b-c789-4514-ae07-659ae88ae4c2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:24.414628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0e33d-803f-4f1f-aa28-4f4528d92ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:24.415264 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0e33d-803f-4f1f-aa28-4f4528d92ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:24.415540 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0e33d-803f-4f1f-aa28-4f4528d92ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:24.415811 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0e33d-803f-4f1f-aa28-4f4528d92ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:24.425353 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0e33d-803f-4f1f-aa28-4f4528d92ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:24.426800 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0e33d-803f-4f1f-aa28-4f4528d92ad6 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:24.436773 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1401/2817] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:27:24.736224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ec69b-e624-45c4-966d-6310427ffe7e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:24.737463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-707ec69b-e624-45c4-966d-6310427ffe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:24.750629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ec69b-e624-45c4-966d-6310427ffe7e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:24.757463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:24.758224 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:24.758574 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:24.758933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] PATH_INFO: `/v3/projects/8cc17d9e66f440d1a7a2d461d6d03580` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:24.760205 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc17d9e66f440d1a7a2d461d6d03580)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:24.762232 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:24.790660 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:24.820528 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc17d9e66f440d1a7a2d461d6d03580', 'request_id': 'req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:24.829529 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc17d9e66f440d1a7a2d461d6d03580', 'request_id': 'req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:24.835216 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc17d9e66f440d1a7a2d461d6d03580', 'request_id': 'req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:24.846722 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] The token cache is being invalidate because project 8cc17d9e66f440d1a7a2d461d6d03580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:27:24.847019 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:24.847771 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:24.849337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1417/2818] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:27:24 2022] DELETE /identity/v3/projects/8cc17d9e66f440d1a7a2d461d6d03580 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:24.853718 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0e33d-803f-4f1f-aa28-4f4528d92ad6 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:24.864703 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0e33d-803f-4f1f-aa28-4f4528d92ad6 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:24.930355 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a85cc2-49f0-4d39-a387-81a42ae70229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:24.930925 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a85cc2-49f0-4d39-a387-81a42ae70229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:24.931201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a85cc2-49f0-4d39-a387-81a42ae70229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:24.931500 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a85cc2-49f0-4d39-a387-81a42ae70229 admin admin] PATH_INFO: `/v3/users/1007b39400e342419e04e21b4541f14a` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:24.932754 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a85cc2-49f0-4d39-a387-81a42ae70229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1007b39400e342419e04e21b4541f14a)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:24.934793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a85cc2-49f0-4d39-a387-81a42ae70229 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:24.980533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:24.994278 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e7a85cc2-49f0-4d39-a387-81a42ae70229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1007b39400e342419e04e21b4541f14a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:25.002926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e7a85cc2-49f0-4d39-a387-81a42ae70229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1007b39400e342419e04e21b4541f14a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:25.014893 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e7a85cc2-49f0-4d39-a387-81a42ae70229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1007b39400e342419e04e21b4541f14a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:25.015726 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e7a85cc2-49f0-4d39-a387-81a42ae70229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1007b39400e342419e04e21b4541f14a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:25.033407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e7a85cc2-49f0-4d39-a387-81a42ae70229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1007b39400e342419e04e21b4541f14a'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:25.040446 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1402/2819] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:27:24 2022] DELETE /identity/v3/users/1007b39400e342419e04e21b4541f14a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:25.367403 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:25.371078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:25.392078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc7b86-fe3a-43b9-9602-6d95e3e5a89c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:25.467941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722d8b4-1f53-4881-89ed-a8eff63920b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:25.468651 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722d8b4-1f53-4881-89ed-a8eff63920b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:25.469026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722d8b4-1f53-4881-89ed-a8eff63920b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:25.469311 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722d8b4-1f53-4881-89ed-a8eff63920b5 admin admin] PATH_INFO: `/v3/projects/13ba66c9e15a4dca80ecaada02b21d39` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:25.470934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722d8b4-1f53-4881-89ed-a8eff63920b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ba66c9e15a4dca80ecaada02b21d39)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:25.474493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722d8b4-1f53-4881-89ed-a8eff63920b5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:25.524771 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3722d8b4-1f53-4881-89ed-a8eff63920b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ba66c9e15a4dca80ecaada02b21d39', 'request_id': 'req-3722d8b4-1f53-4881-89ed-a8eff63920b5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:25.533668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3722d8b4-1f53-4881-89ed-a8eff63920b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ba66c9e15a4dca80ecaada02b21d39', 'request_id': 'req-3722d8b4-1f53-4881-89ed-a8eff63920b5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:25.539668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3722d8b4-1f53-4881-89ed-a8eff63920b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ba66c9e15a4dca80ecaada02b21d39', 'request_id': 'req-3722d8b4-1f53-4881-89ed-a8eff63920b5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:25.551923 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3722d8b4-1f53-4881-89ed-a8eff63920b5 admin admin] The token cache is being invalidate because project 13ba66c9e15a4dca80ecaada02b21d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:27:25.552195 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3722d8b4-1f53-4881-89ed-a8eff63920b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:25.553068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3722d8b4-1f53-4881-89ed-a8eff63920b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:25.554687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1418/2820] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:27:25 2022] DELETE /identity/v3/projects/13ba66c9e15a4dca80ecaada02b21d39 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:25.559834 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed04e4f-0eea-42c7-bac6-40c3b7555158 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:25.560369 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed04e4f-0eea-42c7-bac6-40c3b7555158 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:25.560478 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed04e4f-0eea-42c7-bac6-40c3b7555158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:25.582445 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-1ed04e4f-0eea-42c7-bac6-40c3b7555158 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:25.583687 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1ed04e4f-0eea-42c7-bac6-40c3b7555158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:25.652793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1403/2821] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:25.660595 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919b8c1-57af-40eb-b24f-498abdde58d7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:25.660946 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919b8c1-57af-40eb-b24f-498abdde58d7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:25.661253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919b8c1-57af-40eb-b24f-498abdde58d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:25.683046 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6919b8c1-57af-40eb-b24f-498abdde58d7 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:25.684296 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6919b8c1-57af-40eb-b24f-498abdde58d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:25.693933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1419/2822] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:25.698799 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed04e4f-0eea-42c7-bac6-40c3b7555158 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:25.711936 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed04e4f-0eea-42c7-bac6-40c3b7555158 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:25.718905 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbde86f-12a3-413b-8ed7-0e5e2215d859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:25.719838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbde86f-12a3-413b-8ed7-0e5e2215d859 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:25.720125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbde86f-12a3-413b-8ed7-0e5e2215d859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:25.720410 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbde86f-12a3-413b-8ed7-0e5e2215d859 admin admin] PATH_INFO: `/v3/domains` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:25.721177 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbde86f-12a3-413b-8ed7-0e5e2215d859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80395) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:27:25.721491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbde86f-12a3-413b-8ed7-0e5e2215d859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:25.723106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbde86f-12a3-413b-8ed7-0e5e2215d859 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:25.735379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1404/2823] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 07:27:25.740114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919b8c1-57af-40eb-b24f-498abdde58d7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:25.750812 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919b8c1-57af-40eb-b24f-498abdde58d7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:25.758000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b271fa0-a5ab-48d9-ace2-6805c3f606d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:25.758000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b271fa0-a5ab-48d9-ace2-6805c3f606d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:25.758472 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b271fa0-a5ab-48d9-ace2-6805c3f606d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:25.758756 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b271fa0-a5ab-48d9-ace2-6805c3f606d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:25.759456 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b271fa0-a5ab-48d9-ace2-6805c3f606d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:25.761441 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b271fa0-a5ab-48d9-ace2-6805c3f606d4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:25.793794 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1420/2824] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:27:25 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:27:25.800121 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbde86f-12a3-413b-8ed7-0e5e2215d859 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:25.814906 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbde86f-12a3-413b-8ed7-0e5e2215d859 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:25.888548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac22f5-28e9-453b-b837-01c244473f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:25.889239 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac22f5-28e9-453b-b837-01c244473f11 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:25.889516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac22f5-28e9-453b-b837-01c244473f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:25.889796 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac22f5-28e9-453b-b837-01c244473f11 admin admin] PATH_INFO: `/v3/users` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:25.890494 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac22f5-28e9-453b-b837-01c244473f11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:25.892709 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac22f5-28e9-453b-b837-01c244473f11 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:25.920170 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1405/2825] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:27:25 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:27:25.983808 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b271fa0-a5ab-48d9-ace2-6805c3f606d4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:25.995966 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b271fa0-a5ab-48d9-ace2-6805c3f606d4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:26.001112 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21602799-b91c-42ac-ae62-1455aa025aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:26.001736 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21602799-b91c-42ac-ae62-1455aa025aee admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:26.002005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21602799-b91c-42ac-ae62-1455aa025aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:26.002272 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21602799-b91c-42ac-ae62-1455aa025aee admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:26.002948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21602799-b91c-42ac-ae62-1455aa025aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:26.004526 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21602799-b91c-42ac-ae62-1455aa025aee admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:26.015826 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1421/2826] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:27:26.020943 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac22f5-28e9-453b-b837-01c244473f11 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:26.036447 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac22f5-28e9-453b-b837-01c244473f11 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:26.045097 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaec58-d3ea-4275-9441-5b66bf7fe744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:26.045743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaec58-d3ea-4275-9441-5b66bf7fe744 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:26.046014 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaec58-d3ea-4275-9441-5b66bf7fe744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:26.046284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaec58-d3ea-4275-9441-5b66bf7fe744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:26.046989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaec58-d3ea-4275-9441-5b66bf7fe744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:26.048711 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaec58-d3ea-4275-9441-5b66bf7fe744 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:26.060917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1406/2827] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:27:26.065426 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21602799-b91c-42ac-ae62-1455aa025aee admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:26.070950 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:26.077063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21602799-b91c-42ac-ae62-1455aa025aee admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:26.082921 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43696bb-9d67-4cf4-912e-185280be75e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:26.083612 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43696bb-9d67-4cf4-912e-185280be75e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:26.084256 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43696bb-9d67-4cf4-912e-185280be75e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:26.084687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43696bb-9d67-4cf4-912e-185280be75e6 admin admin] PATH_INFO: `/v3/projects/d0d79fa7d5aa4f3ca24ea285ea9fe273/users/237c36ca81e34f87870b71d2e80cd37d/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:26.100833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43696bb-9d67-4cf4-912e-185280be75e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d79fa7d5aa4f3ca24ea285ea9fe273, user_id=237c36ca81e34f87870b71d2e80cd37d, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:26.103522 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43696bb-9d67-4cf4-912e-185280be75e6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:26.118695 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1422/2828] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:27:26 2022] PUT /identity/v3/projects/d0d79fa7d5aa4f3ca24ea285ea9fe273/users/237c36ca81e34f87870b71d2e80cd37d/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:26.133062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87ab90-caeb-45ee-b857-b7b7fae8964a None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:26.133343 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87ab90-caeb-45ee-b857-b7b7fae8964a None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:26.133612 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87ab90-caeb-45ee-b857-b7b7fae8964a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:26.170029 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-2e87ab90-caeb-45ee-b857-b7b7fae8964a None None] MFA Rules not processed for user `237c36ca81e34f87870b71d2e80cd37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:26.171293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2e87ab90-caeb-45ee-b857-b7b7fae8964a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:26.177783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:26.260838 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1407/2829] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:26.272868 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43696bb-9d67-4cf4-912e-185280be75e6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:26.275363 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e43696bb-9d67-4cf4-912e-185280be75e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:26.345802 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43696bb-9d67-4cf4-912e-185280be75e6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:26.349827 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a4cfc-de74-44d4-8cf6-3106b11a0d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:26.350446 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4cfc-de74-44d4-8cf6-3106b11a0d5a service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:26.350758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4cfc-de74-44d4-8cf6-3106b11a0d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:26.351005 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4cfc-de74-44d4-8cf6-3106b11a0d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:26.364126 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a4cfc-de74-44d4-8cf6-3106b11a0d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:26.365628 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a4cfc-de74-44d4-8cf6-3106b11a0d5a service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:26.376782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1423/2830] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:27:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:27:30.988947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97729a2d-f8ad-48ad-85ca-ea5773f295b4 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:30.989560 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97729a2d-f8ad-48ad-85ca-ea5773f295b4 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:30.989560 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97729a2d-f8ad-48ad-85ca-ea5773f295b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:31.014045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-97729a2d-f8ad-48ad-85ca-ea5773f295b4 None None] MFA Rules not processed for user `237c36ca81e34f87870b71d2e80cd37d`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:31.015256 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-97729a2d-f8ad-48ad-85ca-ea5773f295b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:31.022943 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1408/2831] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:27:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:36.371452 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:41.009145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=27 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:49.963969 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a4cfc-de74-44d4-8cf6-3106b11a0d5a service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:49.965493 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fa7a4cfc-de74-44d4-8cf6-3106b11a0d5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:50.032376 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a4cfc-de74-44d4-8cf6-3106b11a0d5a service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:50.035925 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0d929-41b0-4c71-9710-535ff20846e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:50.036542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0d929-41b0-4c71-9710-535ff20846e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:50.036816 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0d929-41b0-4c71-9710-535ff20846e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:50.037117 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0d929-41b0-4c71-9710-535ff20846e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:50.038928 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e5b0d929-41b0-4c71-9710-535ff20846e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:50.108068 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0d929-41b0-4c71-9710-535ff20846e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:50.109627 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0d929-41b0-4c71-9710-535ff20846e4 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:50.120933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1424/2832] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:27:54.013152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97729a2d-f8ad-48ad-85ca-ea5773f295b4 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:54.015623 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-97729a2d-f8ad-48ad-85ca-ea5773f295b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:54.116793 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97729a2d-f8ad-48ad-85ca-ea5773f295b4 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:54.121920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea16fb2-c2fe-49c2-881d-2c8522d86959 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:54.122579 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea16fb2-c2fe-49c2-881d-2c8522d86959 service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:54.122855 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea16fb2-c2fe-49c2-881d-2c8522d86959 service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:54.123146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea16fb2-c2fe-49c2-881d-2c8522d86959 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:54.124888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cea16fb2-c2fe-49c2-881d-2c8522d86959 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:54.137148 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea16fb2-c2fe-49c2-881d-2c8522d86959 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:54.138743 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea16fb2-c2fe-49c2-881d-2c8522d86959 service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:54.148801 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1409/2833] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:27:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:27:54.769428 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a834a-9206-402d-b7fd-1d60dd940cea None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:54.769984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a834a-9206-402d-b7fd-1d60dd940cea None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:54.770160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a834a-9206-402d-b7fd-1d60dd940cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:54.792817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-721a834a-9206-402d-b7fd-1d60dd940cea None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:54.794118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-721a834a-9206-402d-b7fd-1d60dd940cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:54.861412 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1425/2834] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:27:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:54.911546 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea16fb2-c2fe-49c2-881d-2c8522d86959 service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:54.913105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-cea16fb2-c2fe-49c2-881d-2c8522d86959 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:54.989216 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea16fb2-c2fe-49c2-881d-2c8522d86959 service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:54.996381 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a728a3-e3e2-4ce4-a3a2-c5d86f933f62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:54.997051 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a728a3-e3e2-4ce4-a3a2-c5d86f933f62 service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:54.997351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a728a3-e3e2-4ce4-a3a2-c5d86f933f62 service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:54.997622 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a728a3-e3e2-4ce4-a3a2-c5d86f933f62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:55.007046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a728a3-e3e2-4ce4-a3a2-c5d86f933f62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:55.008701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a728a3-e3e2-4ce4-a3a2-c5d86f933f62 service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:55.018201 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1410/2835] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:27:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:27:55.662117 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d569371-7315-40c5-ad51-14dc722b919b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:55.662399 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d569371-7315-40c5-ad51-14dc722b919b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:55.662679 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d569371-7315-40c5-ad51-14dc722b919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:55.682094 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4d569371-7315-40c5-ad51-14dc722b919b None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:55.683301 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4d569371-7315-40c5-ad51-14dc722b919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:55.691115 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1426/2836] 10.222.0.27 () {58 vars in 967 bytes} [Fri Aug 5 07:27:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:55.707928 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a728a3-e3e2-4ce4-a3a2-c5d86f933f62 service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:55.719415 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a728a3-e3e2-4ce4-a3a2-c5d86f933f62 service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:55.724671 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a01ce-ebfa-464a-847b-462652931f02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:55.725438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a01ce-ebfa-464a-847b-462652931f02 service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:55.725816 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a01ce-ebfa-464a-847b-462652931f02 service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:55.726317 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a01ce-ebfa-464a-847b-462652931f02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:55.735939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a01ce-ebfa-464a-847b-462652931f02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:55.737609 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a01ce-ebfa-464a-847b-462652931f02 service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:55.746574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1411/2837] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:27:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:27:56.019894 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e692680-6a39-41f4-9101-3516a73f55d5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:56.020440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e692680-6a39-41f4-9101-3516a73f55d5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:56.020440 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e692680-6a39-41f4-9101-3516a73f55d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:56.044635 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0e692680-6a39-41f4-9101-3516a73f55d5 None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:56.046011 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0e692680-6a39-41f4-9101-3516a73f55d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:56.058002 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1427/2838] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Aug 5 07:27:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:56.071742 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a01ce-ebfa-464a-847b-462652931f02 service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:56.089024 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a01ce-ebfa-464a-847b-462652931f02 service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:56.095329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2234e31-a8e9-4d32-9e09-7515a65495cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:56.096477 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2234e31-a8e9-4d32-9e09-7515a65495cc service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:56.096655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2234e31-a8e9-4d32-9e09-7515a65495cc service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:56.097137 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2234e31-a8e9-4d32-9e09-7515a65495cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:56.108227 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2234e31-a8e9-4d32-9e09-7515a65495cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:56.110019 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2234e31-a8e9-4d32-9e09-7515a65495cc service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:56.119832 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1412/2839] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:27:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:27:56.495151 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73739d-ae6e-4dae-9719-a46882a758ca None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:56.495689 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73739d-ae6e-4dae-9719-a46882a758ca None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:56.496201 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73739d-ae6e-4dae-9719-a46882a758ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:56.521360 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-de73739d-ae6e-4dae-9719-a46882a758ca None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:27:56.522840 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-de73739d-ae6e-4dae-9719-a46882a758ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:56.530393 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1428/2840] 10.222.0.27 () {58 vars in 967 bytes} [Fri Aug 5 07:27:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:27:56.543847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2234e31-a8e9-4d32-9e09-7515a65495cc service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:56.557139 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2234e31-a8e9-4d32-9e09-7515a65495cc service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:56.567189 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4f15f-aacd-4071-b36b-63e49ece81d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:56.568126 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4f15f-aacd-4071-b36b-63e49ece81d3 service swift] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:56.568573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4f15f-aacd-4071-b36b-63e49ece81d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:56.569055 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4f15f-aacd-4071-b36b-63e49ece81d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:56.579835 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4f15f-aacd-4071-b36b-63e49ece81d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:56.587184 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4f15f-aacd-4071-b36b-63e49ece81d3 service swift] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:56.596652 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1413/2841] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:27:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:27:57.542604 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73739d-ae6e-4dae-9719-a46882a758ca None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:57.545733 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-de73739d-ae6e-4dae-9719-a46882a758ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:57.566078 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73739d-ae6e-4dae-9719-a46882a758ca None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:57.571954 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:57.572791 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:57.573252 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:57.573515 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] PATH_INFO: `/v3/users/43ef613541cb4fd49faa3a3cec1a58c8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:57.591000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ef613541cb4fd49faa3a3cec1a58c8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:57.593941 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:57.620664 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:57.650525 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ef613541cb4fd49faa3a3cec1a58c8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:57.651183 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ef613541cb4fd49faa3a3cec1a58c8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:57.659868 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ef613541cb4fd49faa3a3cec1a58c8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:57.660572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ef613541cb4fd49faa3a3cec1a58c8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:57.674638 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ef613541cb4fd49faa3a3cec1a58c8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:57.692032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1429/2842] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:27:57 2022] DELETE /identity/v3/users/43ef613541cb4fd49faa3a3cec1a58c8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:57.890103 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4f15f-aacd-4071-b36b-63e49ece81d3 service swift] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:57.902872 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4f15f-aacd-4071-b36b-63e49ece81d3 service swift] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:57.949351 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:57.968329 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:57.969011 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:57.969295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:57.969572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] PATH_INFO: `/v3/projects/2720b0660de14a19a05ef57efaa01cd8` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:57.980517 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2720b0660de14a19a05ef57efaa01cd8)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:57.982482 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:58.032920 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2720b0660de14a19a05ef57efaa01cd8', 'request_id': 'req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.041178 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2720b0660de14a19a05ef57efaa01cd8', 'request_id': 'req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.047323 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2720b0660de14a19a05ef57efaa01cd8', 'request_id': 'req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.060070 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] The token cache is being invalidate because project 2720b0660de14a19a05ef57efaa01cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:27:58.060265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.060930 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.062528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1414/2843] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:27:57 2022] DELETE /identity/v3/projects/2720b0660de14a19a05ef57efaa01cd8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:58.066668 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:58.068179 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:58.082167 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17042ee-9f8d-49a0-a5b4-303245989bf0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:58.143620 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:58.144264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:58.144538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:58.144805 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] PATH_INFO: `/v3/users/28bbe33fea2247088a9d439d27c53fd3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:58.158907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28bbe33fea2247088a9d439d27c53fd3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:58.160856 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:58.215059 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28bbe33fea2247088a9d439d27c53fd3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.215782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28bbe33fea2247088a9d439d27c53fd3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.227233 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28bbe33fea2247088a9d439d27c53fd3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.227895 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28bbe33fea2247088a9d439d27c53fd3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.242310 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28bbe33fea2247088a9d439d27c53fd3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.255889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1430/2844] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:27:58 2022] DELETE /identity/v3/users/28bbe33fea2247088a9d439d27c53fd3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:58.441685 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:58.443516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:58.457822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39c3fb-f616-4865-8141-c7f9bcf10bd2 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:27:58.535454 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adf797-9f04-43a9-9b66-f747e28cd5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:27:58.536120 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adf797-9f04-43a9-9b66-f747e28cd5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:27:58.536393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adf797-9f04-43a9-9b66-f747e28cd5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:27:58.536664 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adf797-9f04-43a9-9b66-f747e28cd5c5 admin admin] PATH_INFO: `/v3/projects/68876c6b41f342d88572f44e1ebd6efd` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:27:58.549220 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adf797-9f04-43a9-9b66-f747e28cd5c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68876c6b41f342d88572f44e1ebd6efd)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:27:58.551384 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adf797-9f04-43a9-9b66-f747e28cd5c5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:27:58.605761 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-55adf797-9f04-43a9-9b66-f747e28cd5c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68876c6b41f342d88572f44e1ebd6efd', 'request_id': 'req-55adf797-9f04-43a9-9b66-f747e28cd5c5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.609766 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:27:58.615908 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-55adf797-9f04-43a9-9b66-f747e28cd5c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68876c6b41f342d88572f44e1ebd6efd', 'request_id': 'req-55adf797-9f04-43a9-9b66-f747e28cd5c5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.624300 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-55adf797-9f04-43a9-9b66-f747e28cd5c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68876c6b41f342d88572f44e1ebd6efd', 'request_id': 'req-55adf797-9f04-43a9-9b66-f747e28cd5c5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.637688 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-55adf797-9f04-43a9-9b66-f747e28cd5c5 admin admin] The token cache is being invalidate because project 68876c6b41f342d88572f44e1ebd6efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:27:58.637970 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-55adf797-9f04-43a9-9b66-f747e28cd5c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.638638 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-55adf797-9f04-43a9-9b66-f747e28cd5c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:27:58.640191 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1415/2845] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:27:58 2022] DELETE /identity/v3/projects/68876c6b41f342d88572f44e1ebd6efd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:27:59.986823 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:27:59.988424 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:27:59.999086 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:00.003591 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390c7eb-5d7b-4c42-9ccd-dc8d30e0cb4e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:00.076412 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:00.077114 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:00.077394 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:00.077665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] PATH_INFO: `/v3/users/237c36ca81e34f87870b71d2e80cd37d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:00.078930 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=237c36ca81e34f87870b71d2e80cd37d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:00.080873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:00.133008 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237c36ca81e34f87870b71d2e80cd37d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:00.133720 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237c36ca81e34f87870b71d2e80cd37d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:00.142940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237c36ca81e34f87870b71d2e80cd37d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:00.143661 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237c36ca81e34f87870b71d2e80cd37d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:00.156729 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237c36ca81e34f87870b71d2e80cd37d'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:00.170597 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1431/2846] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:27:59 2022] DELETE /identity/v3/users/237c36ca81e34f87870b71d2e80cd37d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:28:00.175270 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892c20b-c43c-4ecf-be69-c043e5e3bc11 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:00.175752 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892c20b-c43c-4ecf-be69-c043e5e3bc11 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:00.175878 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892c20b-c43c-4ecf-be69-c043e5e3bc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:00.196296 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-9892c20b-c43c-4ecf-be69-c043e5e3bc11 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:28:00.197519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9892c20b-c43c-4ecf-be69-c043e5e3bc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:00.269529 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1416/2847] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:28:00.279685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:00.281209 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:00.347246 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6002a-9d7e-4639-8856-506e11b5c5e8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:00.351751 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f506cf-8f10-4d56-a7c1-2ba68346c840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:00.352382 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f506cf-8f10-4d56-a7c1-2ba68346c840 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:00.352664 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f506cf-8f10-4d56-a7c1-2ba68346c840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:00.352970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f506cf-8f10-4d56-a7c1-2ba68346c840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:00.364071 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f506cf-8f10-4d56-a7c1-2ba68346c840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:00.365610 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f506cf-8f10-4d56-a7c1-2ba68346c840 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:00.376974 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1432/2848] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:28:00.574772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892c20b-c43c-4ecf-be69-c043e5e3bc11 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:00.576520 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-9892c20b-c43c-4ecf-be69-c043e5e3bc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:00.591919 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892c20b-c43c-4ecf-be69-c043e5e3bc11 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:00.597271 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:00.598196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:00.598627 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:00.599107 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557 admin admin] PATH_INFO: `/v3/projects/d0d79fa7d5aa4f3ca24ea285ea9fe273` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:00.601813 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d79fa7d5aa4f3ca24ea285ea9fe273)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:00.604784 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:00.666169 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'request_id': 'req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:00.675856 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'request_id': 'req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:00.683337 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d79fa7d5aa4f3ca24ea285ea9fe273', 'request_id': 'req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:00.698041 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557 admin admin] The token cache is being invalidate because project d0d79fa7d5aa4f3ca24ea285ea9fe273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:28:00.698335 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:00.699165 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-4ed21dc4-1e8d-4577-b3b0-9d9c3aba6557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:00.701007 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1417/2849] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:28:00 2022] DELETE /identity/v3/projects/d0d79fa7d5aa4f3ca24ea285ea9fe273 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:28:00.707584 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125d424-6f4f-4a30-8178-aa733951ac5b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:00.707871 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125d424-6f4f-4a30-8178-aa733951ac5b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:00.708096 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125d424-6f4f-4a30-8178-aa733951ac5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:00.731197 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9125d424-6f4f-4a30-8178-aa733951ac5b None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:28:00.732460 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9125d424-6f4f-4a30-8178-aa733951ac5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:00.758916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:00.808396 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1433/2850] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:28:00.817027 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3b2e1-e29f-4d5c-a27e-4b4e4ced7129 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:00.817334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3b2e1-e29f-4d5c-a27e-4b4e4ced7129 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:00.817642 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3b2e1-e29f-4d5c-a27e-4b4e4ced7129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:00.839973 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-40c3b2e1-e29f-4d5c-a27e-4b4e4ced7129 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:28:00.841507 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-40c3b2e1-e29f-4d5c-a27e-4b4e4ced7129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:00.850586 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1418/2851] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:28:00.855007 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125d424-6f4f-4a30-8178-aa733951ac5b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:00.866026 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125d424-6f4f-4a30-8178-aa733951ac5b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:00.871535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a46041-26a4-4649-92d5-1bbe6f786735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:00.872331 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a46041-26a4-4649-92d5-1bbe6f786735 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:00.872614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a46041-26a4-4649-92d5-1bbe6f786735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:00.872887 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a46041-26a4-4649-92d5-1bbe6f786735 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:00.873736 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a46041-26a4-4649-92d5-1bbe6f786735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:28:00.873942 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a46041-26a4-4649-92d5-1bbe6f786735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:00.875676 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a46041-26a4-4649-92d5-1bbe6f786735 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:00.892149 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1434/2852] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:28:00.895073 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3b2e1-e29f-4d5c-a27e-4b4e4ced7129 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:00.905363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3b2e1-e29f-4d5c-a27e-4b4e4ced7129 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:00.910510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336ebff-7e46-488f-b7ae-6eac9f8b8bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:00.911141 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336ebff-7e46-488f-b7ae-6eac9f8b8bed admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:00.911427 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336ebff-7e46-488f-b7ae-6eac9f8b8bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:00.911689 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336ebff-7e46-488f-b7ae-6eac9f8b8bed admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:00.912405 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336ebff-7e46-488f-b7ae-6eac9f8b8bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:00.914528 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336ebff-7e46-488f-b7ae-6eac9f8b8bed admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:00.949235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1419/2853] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:28:00 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:28:00.953977 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a46041-26a4-4649-92d5-1bbe6f786735 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:00.965113 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a46041-26a4-4649-92d5-1bbe6f786735 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:01.043980 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0332e4b-0a64-4445-a788-d36f3bafa1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:01.044705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0332e4b-0a64-4445-a788-d36f3bafa1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:01.044834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0332e4b-0a64-4445-a788-d36f3bafa1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:01.045264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0332e4b-0a64-4445-a788-d36f3bafa1b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:01.045988 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0332e4b-0a64-4445-a788-d36f3bafa1b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:01.048023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0332e4b-0a64-4445-a788-d36f3bafa1b7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:01.077506 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1435/2854] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:28:00 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:28:01.079009 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336ebff-7e46-488f-b7ae-6eac9f8b8bed admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:01.090246 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336ebff-7e46-488f-b7ae-6eac9f8b8bed admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:01.095396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942529b1-31ea-4c0d-b73a-6e5dd5dbad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:01.096026 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942529b1-31ea-4c0d-b73a-6e5dd5dbad83 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:01.096308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942529b1-31ea-4c0d-b73a-6e5dd5dbad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:01.096577 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942529b1-31ea-4c0d-b73a-6e5dd5dbad83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:01.097325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942529b1-31ea-4c0d-b73a-6e5dd5dbad83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:01.098952 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942529b1-31ea-4c0d-b73a-6e5dd5dbad83 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:01.111309 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1420/2855] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:28:01.115538 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0332e4b-0a64-4445-a788-d36f3bafa1b7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:01.129105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0332e4b-0a64-4445-a788-d36f3bafa1b7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:01.135181 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbca52d-80bd-4f5e-a324-c4c5c00fc564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:01.135817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbca52d-80bd-4f5e-a324-c4c5c00fc564 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:01.136095 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbca52d-80bd-4f5e-a324-c4c5c00fc564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:01.136368 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbca52d-80bd-4f5e-a324-c4c5c00fc564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:01.137294 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbca52d-80bd-4f5e-a324-c4c5c00fc564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:01.138920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbca52d-80bd-4f5e-a324-c4c5c00fc564 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:01.153608 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1436/2856] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:28:01.158125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942529b1-31ea-4c0d-b73a-6e5dd5dbad83 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:01.169636 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942529b1-31ea-4c0d-b73a-6e5dd5dbad83 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:01.174526 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163ba6e-45fb-461b-9300-c5e3db7c14fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:01.175207 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163ba6e-45fb-461b-9300-c5e3db7c14fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:01.175490 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163ba6e-45fb-461b-9300-c5e3db7c14fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:01.176036 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163ba6e-45fb-461b-9300-c5e3db7c14fe admin admin] PATH_INFO: `/v3/projects/3cb5b787fed94e7091a4ff793951d8f0/users/4fbc21934e84415e93f29aa5073716f7/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:01.193105 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163ba6e-45fb-461b-9300-c5e3db7c14fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb5b787fed94e7091a4ff793951d8f0, user_id=4fbc21934e84415e93f29aa5073716f7, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:01.195812 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163ba6e-45fb-461b-9300-c5e3db7c14fe admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:01.210291 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1421/2857] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:28:01 2022] PUT /identity/v3/projects/3cb5b787fed94e7091a4ff793951d8f0/users/4fbc21934e84415e93f29aa5073716f7/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:28:01.215869 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb77d26-66b7-470d-91a4-379897537b12 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:01.216153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb77d26-66b7-470d-91a4-379897537b12 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:01.216424 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb77d26-66b7-470d-91a4-379897537b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:01.237106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-deb77d26-66b7-470d-91a4-379897537b12 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:28:01.238323 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-deb77d26-66b7-470d-91a4-379897537b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:01.314817 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1437/2858] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:28:01.325619 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163ba6e-45fb-461b-9300-c5e3db7c14fe admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:01.327680 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-e163ba6e-45fb-461b-9300-c5e3db7c14fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:01.338558 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:01.411018 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163ba6e-45fb-461b-9300-c5e3db7c14fe admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:01.416196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29778fd5-7960-44e9-9333-4eea7b6f84a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:01.416864 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29778fd5-7960-44e9-9333-4eea7b6f84a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:01.417157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29778fd5-7960-44e9-9333-4eea7b6f84a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:01.417438 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29778fd5-7960-44e9-9333-4eea7b6f84a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:01.428565 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29778fd5-7960-44e9-9333-4eea7b6f84a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:01.431172 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29778fd5-7960-44e9-9333-4eea7b6f84a8 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:01.444753 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1422/2859] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:28:05.943655 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef7e87-b35e-4c7e-a01f-d8c354bdb2b9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:05.944508 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef7e87-b35e-4c7e-a01f-d8c354bdb2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:05.944508 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef7e87-b35e-4c7e-a01f-d8c354bdb2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:05.974388 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-46ef7e87-b35e-4c7e-a01f-d8c354bdb2b9 None None] MFA Rules not processed for user `4fbc21934e84415e93f29aa5073716f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:28:05.975650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-46ef7e87-b35e-4c7e-a01f-d8c354bdb2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:05.999330 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:06.060058 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1438/2860] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:28:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:28:06.064991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29778fd5-7960-44e9-9333-4eea7b6f84a8 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:06.076090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29778fd5-7960-44e9-9333-4eea7b6f84a8 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:06.081046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1a676-2b05-4b7b-8aa1-d98b6e64a8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:06.081665 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1a676-2b05-4b7b-8aa1-d98b6e64a8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:06.081966 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1a676-2b05-4b7b-8aa1-d98b6e64a8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:06.082238 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1a676-2b05-4b7b-8aa1-d98b6e64a8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:06.082907 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1a676-2b05-4b7b-8aa1-d98b6e64a8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:06.084827 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1a676-2b05-4b7b-8aa1-d98b6e64a8d3 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:06.119376 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1423/2861] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:28:06 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 07:28:06.123629 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef7e87-b35e-4c7e-a01f-d8c354bdb2b9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:06.137071 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef7e87-b35e-4c7e-a01f-d8c354bdb2b9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:06.197314 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41748-4378-440c-82dd-8d8e1708391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:06.197889 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41748-4378-440c-82dd-8d8e1708391c admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:06.198166 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41748-4378-440c-82dd-8d8e1708391c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:06.198427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41748-4378-440c-82dd-8d8e1708391c admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:06.199103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f41748-4378-440c-82dd-8d8e1708391c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:06.201066 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f41748-4378-440c-82dd-8d8e1708391c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:06.226542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1439/2862] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:28:06 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:28:06.232398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1a676-2b05-4b7b-8aa1-d98b6e64a8d3 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:06.243166 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1a676-2b05-4b7b-8aa1-d98b6e64a8d3 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:06.248085 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80293ee-a8bb-4150-a969-419ebc9254e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:06.248699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80293ee-a8bb-4150-a969-419ebc9254e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:06.249012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80293ee-a8bb-4150-a969-419ebc9254e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:06.249290 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80293ee-a8bb-4150-a969-419ebc9254e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:06.249986 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80293ee-a8bb-4150-a969-419ebc9254e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:06.251606 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80293ee-a8bb-4150-a969-419ebc9254e1 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:06.263218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1424/2863] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:28:06.267770 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41748-4378-440c-82dd-8d8e1708391c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:06.280541 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41748-4378-440c-82dd-8d8e1708391c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:06.286105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157fe2d-9c67-4514-ab58-586ff37a142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:06.286805 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157fe2d-9c67-4514-ab58-586ff37a142a admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:06.287103 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157fe2d-9c67-4514-ab58-586ff37a142a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:06.287425 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157fe2d-9c67-4514-ab58-586ff37a142a admin admin] PATH_INFO: `/v3/projects/6521bc76167c43e3a3467e8fd2c687c6/users/15ac0e1d39fc4143b3becb318f216ed6/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:06.303984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157fe2d-9c67-4514-ab58-586ff37a142a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6521bc76167c43e3a3467e8fd2c687c6, user_id=15ac0e1d39fc4143b3becb318f216ed6, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:06.306777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157fe2d-9c67-4514-ab58-586ff37a142a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:06.322843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1440/2864] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:28:06 2022] PUT /identity/v3/projects/6521bc76167c43e3a3467e8fd2c687c6/users/15ac0e1d39fc4143b3becb318f216ed6/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:28:06.328668 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80293ee-a8bb-4150-a969-419ebc9254e1 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:06.340338 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80293ee-a8bb-4150-a969-419ebc9254e1 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:06.401398 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5b70d-5a92-450e-88bf-fc3c18ec648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:06.402032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5b70d-5a92-450e-88bf-fc3c18ec648f admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:06.402307 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5b70d-5a92-450e-88bf-fc3c18ec648f admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:06.402573 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5b70d-5a92-450e-88bf-fc3c18ec648f admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:06.403265 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5b70d-5a92-450e-88bf-fc3c18ec648f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:06.404867 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5b70d-5a92-450e-88bf-fc3c18ec648f admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:06.415615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1425/2865] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:28:06.420161 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157fe2d-9c67-4514-ab58-586ff37a142a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:06.432288 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157fe2d-9c67-4514-ab58-586ff37a142a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:06.437471 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b06d3-452c-4862-9a73-d0b77e47ba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:06.438369 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b06d3-452c-4862-9a73-d0b77e47ba49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:06.438646 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b06d3-452c-4862-9a73-d0b77e47ba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:06.438920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b06d3-452c-4862-9a73-d0b77e47ba49 admin admin] PATH_INFO: `/v3/projects/6521bc76167c43e3a3467e8fd2c687c6/users/15ac0e1d39fc4143b3becb318f216ed6/roles/86cc3f5017af47bdbd356a87243cdcce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:06.446258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b06d3-452c-4862-9a73-d0b77e47ba49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6521bc76167c43e3a3467e8fd2c687c6, user_id=15ac0e1d39fc4143b3becb318f216ed6, role_id=86cc3f5017af47bdbd356a87243cdcce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:06.446258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b06d3-452c-4862-9a73-d0b77e47ba49 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:06.457313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1441/2866] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:28:06 2022] PUT /identity/v3/projects/6521bc76167c43e3a3467e8fd2c687c6/users/15ac0e1d39fc4143b3becb318f216ed6/roles/86cc3f5017af47bdbd356a87243cdcce => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:28:06.545358 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccd109-375b-4bbd-94f1-188c04af068e None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:06.545961 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccd109-375b-4bbd-94f1-188c04af068e None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:06.546597 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccd109-375b-4bbd-94f1-188c04af068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:06.569339 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b06d3-452c-4862-9a73-d0b77e47ba49 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:06.572710 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4f3b06d3-452c-4862-9a73-d0b77e47ba49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:06.579721 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-84ccd109-375b-4bbd-94f1-188c04af068e None None] MFA Rules not processed for user `a8662b6620724850b0bae866c518a100`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:28:06.581235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-84ccd109-375b-4bbd-94f1-188c04af068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:06.669099 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1426/2867] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:28:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:28:06.688542 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b06d3-452c-4862-9a73-d0b77e47ba49 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:06.699307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a074ef-0bab-4ad0-92b5-94692088cb87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:06.700790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a074ef-0bab-4ad0-92b5-94692088cb87 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:06.701198 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a074ef-0bab-4ad0-92b5-94692088cb87 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:06.701570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a074ef-0bab-4ad0-92b5-94692088cb87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:06.704793 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-66a074ef-0bab-4ad0-92b5-94692088cb87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:06.737258 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:06.818192 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a074ef-0bab-4ad0-92b5-94692088cb87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:06.819903 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a074ef-0bab-4ad0-92b5-94692088cb87 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:06.832934 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1442/2868] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:28:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 07:28:08.483822 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccd109-375b-4bbd-94f1-188c04af068e None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:08.485452 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-84ccd109-375b-4bbd-94f1-188c04af068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:08.506779 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:08.651433 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccd109-375b-4bbd-94f1-188c04af068e None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:08.657684 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b603dcd-626d-4bd5-aa61-3e111294b734 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:08.659046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b603dcd-626d-4bd5-aa61-3e111294b734 service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:08.659568 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b603dcd-626d-4bd5-aa61-3e111294b734 service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:08.660106 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b603dcd-626d-4bd5-aa61-3e111294b734 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:08.662492 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3b603dcd-626d-4bd5-aa61-3e111294b734 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:08.684444 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b603dcd-626d-4bd5-aa61-3e111294b734 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:08.686947 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b603dcd-626d-4bd5-aa61-3e111294b734 service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:08.704693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1427/2869] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:28:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:28:14.468298 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9af44-36db-411f-926d-74fcd6d237a3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:14.468833 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9af44-36db-411f-926d-74fcd6d237a3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:14.468961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9af44-36db-411f-926d-74fcd6d237a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:14.499378 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-22c9af44-36db-411f-926d-74fcd6d237a3 None None] MFA Rules not processed for user `15ac0e1d39fc4143b3becb318f216ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:28:14.500681 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-22c9af44-36db-411f-926d-74fcd6d237a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:14.580332 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1443/2870] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:28:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:28:14.594702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b603dcd-626d-4bd5-aa61-3e111294b734 service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:14.596922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3b603dcd-626d-4bd5-aa61-3e111294b734 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:14.613532 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b603dcd-626d-4bd5-aa61-3e111294b734 service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:14.623081 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45293cc-bca0-4ad7-b6ad-89be5f32a664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:14.623857 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45293cc-bca0-4ad7-b6ad-89be5f32a664 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:14.624235 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45293cc-bca0-4ad7-b6ad-89be5f32a664 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:14.624516 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45293cc-bca0-4ad7-b6ad-89be5f32a664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:14.717676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45293cc-bca0-4ad7-b6ad-89be5f32a664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:14.719420 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45293cc-bca0-4ad7-b6ad-89be5f32a664 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:14.731489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1428/2871] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:28:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:28:15.896145 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8cffd-b331-4fe1-89a0-f43b4a7547a5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:15.896665 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8cffd-b331-4fe1-89a0-f43b4a7547a5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:15.896783 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8cffd-b331-4fe1-89a0-f43b4a7547a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:15.917835 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-17c8cffd-b331-4fe1-89a0-f43b4a7547a5 None None] MFA Rules not processed for user `4fbc21934e84415e93f29aa5073716f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:28:15.919307 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-17c8cffd-b331-4fe1-89a0-f43b4a7547a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:15.926790 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1444/2872] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:28:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:28:19.410102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281be2b-a2d8-4461-852b-09d26fef5054 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:19.410676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281be2b-a2d8-4461-852b-09d26fef5054 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:19.410676 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281be2b-a2d8-4461-852b-09d26fef5054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:19.433588 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-4281be2b-a2d8-4461-852b-09d26fef5054 None None] MFA Rules not processed for user `0dc4cfe4a3ce4e34a1b664d99eb34d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:28:19.434852 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4281be2b-a2d8-4461-852b-09d26fef5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:19.502706 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1429/2873] 10.222.0.27 () {58 vars in 967 bytes} [Fri Aug 5 07:28:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:28:19.518366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8cffd-b331-4fe1-89a0-f43b4a7547a5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:19.520148 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-17c8cffd-b331-4fe1-89a0-f43b4a7547a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:19.598843 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8cffd-b331-4fe1-89a0-f43b4a7547a5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:19.604263 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4339c-fd3f-4668-9a14-e8b4a2dae7b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d83b456cec84bc5ab02a190099c0baf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:19.604883 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4339c-fd3f-4668-9a14-e8b4a2dae7b6 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:19.605202 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4339c-fd3f-4668-9a14-e8b4a2dae7b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:19.605441 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4339c-fd3f-4668-9a14-e8b4a2dae7b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:19.615118 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4339c-fd3f-4668-9a14-e8b4a2dae7b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:19.616775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4339c-fd3f-4668-9a14-e8b4a2dae7b6 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:19.626920 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1445/2874] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Aug 5 07:28:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 07:28:20.010222 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281be2b-a2d8-4461-852b-09d26fef5054 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:20.011839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4281be2b-a2d8-4461-852b-09d26fef5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:20.067189 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:20.073157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281be2b-a2d8-4461-852b-09d26fef5054 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:20.077145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbce6d4-daae-4222-99e2-f8e864f9d1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:20.077797 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbce6d4-daae-4222-99e2-f8e864f9d1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:20.078066 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbce6d4-daae-4222-99e2-f8e864f9d1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:20.078333 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbce6d4-daae-4222-99e2-f8e864f9d1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:20.080218 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-0dbce6d4-daae-4222-99e2-f8e864f9d1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:20.163363 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbce6d4-daae-4222-99e2-f8e864f9d1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:20.164950 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbce6d4-daae-4222-99e2-f8e864f9d1b6 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:20.175393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1430/2875] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:28:27.098266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4339c-fd3f-4668-9a14-e8b4a2dae7b6 service swift] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:27.098266 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6be4339c-fd3f-4668-9a14-e8b4a2dae7b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:27.116562 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4339c-fd3f-4668-9a14-e8b4a2dae7b6 service swift] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:27.121391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:27.122063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:27.122317 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:27.122589 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] PATH_INFO: `/v3/users/e383fda8f4ce4ddc841552c751f1a7bf` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:27.123834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e383fda8f4ce4ddc841552c751f1a7bf)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:27.125799 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:27.146957 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:27.185510 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e383fda8f4ce4ddc841552c751f1a7bf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:27.186283 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e383fda8f4ce4ddc841552c751f1a7bf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:27.194935 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e383fda8f4ce4ddc841552c751f1a7bf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:27.195593 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e383fda8f4ce4ddc841552c751f1a7bf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:27.207961 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e383fda8f4ce4ddc841552c751f1a7bf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:27.220240 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1446/2876] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:28:27 2022] DELETE /identity/v3/users/e383fda8f4ce4ddc841552c751f1a7bf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:28:27.686068 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbce6d4-daae-4222-99e2-f8e864f9d1b6 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:27.696879 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbce6d4-daae-4222-99e2-f8e864f9d1b6 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:27.761624 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:27.762666 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:27.762948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:27.763202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] PATH_INFO: `/v3/projects/1d6a92e28cc44d6b9abe831fb219eea0` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:27.764644 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6a92e28cc44d6b9abe831fb219eea0)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:27.767046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:27.828404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6a92e28cc44d6b9abe831fb219eea0', 'request_id': 'req-32d9db7a-e32c-4549-ad55-66bce8c313e5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:27.837121 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6a92e28cc44d6b9abe831fb219eea0', 'request_id': 'req-32d9db7a-e32c-4549-ad55-66bce8c313e5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:27.843401 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6a92e28cc44d6b9abe831fb219eea0', 'request_id': 'req-32d9db7a-e32c-4549-ad55-66bce8c313e5'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:27.855295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] The token cache is being invalidate because project 1d6a92e28cc44d6b9abe831fb219eea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:28:27.855574 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:27.856283 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:27.857934 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1431/2877] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:28:27 2022] DELETE /identity/v3/projects/1d6a92e28cc44d6b9abe831fb219eea0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:28:27.862144 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:27.863675 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:27.878252 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1adc56-e782-4388-988e-4eed40972255 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:27.939981 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:27.940592 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:27.940848 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:27.941158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] PATH_INFO: `/v3/users/37213692959f425b983852fec0f872ce` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:27.942614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=37213692959f425b983852fec0f872ce)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:27.944551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:27.995880 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37213692959f425b983852fec0f872ce'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:27.996570 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37213692959f425b983852fec0f872ce'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:28.005270 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37213692959f425b983852fec0f872ce'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:28.006533 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37213692959f425b983852fec0f872ce'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:28.019952 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37213692959f425b983852fec0f872ce'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:28.032048 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1447/2878] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:28:27 2022] DELETE /identity/v3/users/37213692959f425b983852fec0f872ce => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:28:28.217911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:28.219653 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:28.236146 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9db7a-e32c-4549-ad55-66bce8c313e5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:28.267259 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:28.312294 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:28.313012 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:28.313297 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:28.313580 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] PATH_INFO: `/v3/projects/d1ddc228dd00477198281e67f48933df` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:28.314762 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ddc228dd00477198281e67f48933df)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:28.316702 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:28.367303 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ddc228dd00477198281e67f48933df', 'request_id': 'req-3b3e2f69-265f-4319-b343-746222a76765'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:28.376203 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ddc228dd00477198281e67f48933df', 'request_id': 'req-3b3e2f69-265f-4319-b343-746222a76765'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:28.382476 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ddc228dd00477198281e67f48933df', 'request_id': 'req-3b3e2f69-265f-4319-b343-746222a76765'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:28.393803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] The token cache is being invalidate because project d1ddc228dd00477198281e67f48933df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:28:28.394086 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:28.394767 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:28:28.396368 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1432/2879] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:28:28 2022] DELETE /identity/v3/projects/d1ddc228dd00477198281e67f48933df => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:28:38.028593 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=74,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:38.390772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=39,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:28:46.509427 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:46.511050 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:46.576766 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f9814-67e5-4f69-bcb4-93d4e1a972aa admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:46.636907 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3a48a-2f5e-4b40-91da-7a22fd452d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:46.637825 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3a48a-2f5e-4b40-91da-7a22fd452d70 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:46.637825 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3a48a-2f5e-4b40-91da-7a22fd452d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:46.638063 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3a48a-2f5e-4b40-91da-7a22fd452d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:46.639996 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-48d3a48a-2f5e-4b40-91da-7a22fd452d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:46.650571 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3a48a-2f5e-4b40-91da-7a22fd452d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:46.652032 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3a48a-2f5e-4b40-91da-7a22fd452d70 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:46.661289 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1448/2880] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:28:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:28:49.426357 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:49.428776 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:49.442378 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e2f69-265f-4319-b343-746222a76765 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:49.446615 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abd69c-bd27-4354-8bc4-88f6ab800d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:49.447252 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abd69c-bd27-4354-8bc4-88f6ab800d3f service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:49.447527 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abd69c-bd27-4354-8bc4-88f6ab800d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:49.447795 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abd69c-bd27-4354-8bc4-88f6ab800d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:49.449777 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-86abd69c-bd27-4354-8bc4-88f6ab800d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:49.546548 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abd69c-bd27-4354-8bc4-88f6ab800d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:49.547957 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abd69c-bd27-4354-8bc4-88f6ab800d3f service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:49.559984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1433/2881] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:28:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:28:51.973340 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3a48a-2f5e-4b40-91da-7a22fd452d70 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:28:51.975020 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-48d3a48a-2f5e-4b40-91da-7a22fd452d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:51.986552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3a48a-2f5e-4b40-91da-7a22fd452d70 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:28:51.991082 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f824ef-ec7d-497f-b848-61827dbb8124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:28:51.991705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f824ef-ec7d-497f-b848-61827dbb8124 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:28:51.991983 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f824ef-ec7d-497f-b848-61827dbb8124 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:28:51.992254 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f824ef-ec7d-497f-b848-61827dbb8124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:28:51.994402 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-85f824ef-ec7d-497f-b848-61827dbb8124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:28:52.010153 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f824ef-ec7d-497f-b848-61827dbb8124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:28:52.011648 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f824ef-ec7d-497f-b848-61827dbb8124 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:28:52.023598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1449/2882] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:28:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:28:59.554683 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=34 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:29:02.018128 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=52 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:29:12.502717 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abd69c-bd27-4354-8bc4-88f6ab800d3f service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:12.512277 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abd69c-bd27-4354-8bc4-88f6ab800d3f service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:12.516008 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d158e9-d8b2-4f7a-b29a-1faaca86a379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:12.516628 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d158e9-d8b2-4f7a-b29a-1faaca86a379 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:12.516931 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d158e9-d8b2-4f7a-b29a-1faaca86a379 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:12.517213 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d158e9-d8b2-4f7a-b29a-1faaca86a379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:12.518984 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-29d158e9-d8b2-4f7a-b29a-1faaca86a379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:29:12.587576 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d158e9-d8b2-4f7a-b29a-1faaca86a379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:12.589076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d158e9-d8b2-4f7a-b29a-1faaca86a379 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:12.598758 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1434/2883] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:29:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:29:19.959204 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f824ef-ec7d-497f-b848-61827dbb8124 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:19.960758 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-85f824ef-ec7d-497f-b848-61827dbb8124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:29:20.033882 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f824ef-ec7d-497f-b848-61827dbb8124 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:20.039337 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3add1ae-3029-4b7d-b01f-16c3c6636d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:20.040041 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3add1ae-3029-4b7d-b01f-16c3c6636d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:20.040322 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3add1ae-3029-4b7d-b01f-16c3c6636d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:20.040591 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3add1ae-3029-4b7d-b01f-16c3c6636d44 admin admin] PATH_INFO: `/v3/users/a8662b6620724850b0bae866c518a100` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:20.041876 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3add1ae-3029-4b7d-b01f-16c3c6636d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8662b6620724850b0bae866c518a100)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:20.043782 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3add1ae-3029-4b7d-b01f-16c3c6636d44 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:20.100559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d3add1ae-3029-4b7d-b01f-16c3c6636d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8662b6620724850b0bae866c518a100'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:20.101211 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d3add1ae-3029-4b7d-b01f-16c3c6636d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8662b6620724850b0bae866c518a100'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:20.110338 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d3add1ae-3029-4b7d-b01f-16c3c6636d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8662b6620724850b0bae866c518a100'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:20.110956 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d3add1ae-3029-4b7d-b01f-16c3c6636d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8662b6620724850b0bae866c518a100'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:20.123514 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d3add1ae-3029-4b7d-b01f-16c3c6636d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8662b6620724850b0bae866c518a100'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:20.137326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1450/2884] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:29:19 2022] DELETE /identity/v3/users/a8662b6620724850b0bae866c518a100 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:29:20.330491 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d158e9-d8b2-4f7a-b29a-1faaca86a379 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:20.341976 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d158e9-d8b2-4f7a-b29a-1faaca86a379 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:20.400145 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6c82c-e043-4860-9a17-65aecc25d39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:20.400803 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c82c-e043-4860-9a17-65aecc25d39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:20.401114 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c82c-e043-4860-9a17-65aecc25d39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:20.401385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6c82c-e043-4860-9a17-65aecc25d39d admin admin] PATH_INFO: `/v3/projects/f5b80306557f466c911aba552768c24e` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:20.402575 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6c82c-e043-4860-9a17-65aecc25d39d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b80306557f466c911aba552768c24e)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:20.404519 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6c82c-e043-4860-9a17-65aecc25d39d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:20.452374 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a7f6c82c-e043-4860-9a17-65aecc25d39d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b80306557f466c911aba552768c24e', 'request_id': 'req-a7f6c82c-e043-4860-9a17-65aecc25d39d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:20.461125 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a7f6c82c-e043-4860-9a17-65aecc25d39d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b80306557f466c911aba552768c24e', 'request_id': 'req-a7f6c82c-e043-4860-9a17-65aecc25d39d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:20.466883 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a7f6c82c-e043-4860-9a17-65aecc25d39d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b80306557f466c911aba552768c24e', 'request_id': 'req-a7f6c82c-e043-4860-9a17-65aecc25d39d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:20.478293 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a7f6c82c-e043-4860-9a17-65aecc25d39d admin admin] The token cache is being invalidate because project f5b80306557f466c911aba552768c24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:29:20.478575 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a7f6c82c-e043-4860-9a17-65aecc25d39d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:20.479378 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-a7f6c82c-e043-4860-9a17-65aecc25d39d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:20.481144 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1435/2885] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:29:20 2022] DELETE /identity/v3/projects/f5b80306557f466c911aba552768c24e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:29:20.486978 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c0252-26af-460c-8bd7-fa2987c1e964 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:20.487332 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c0252-26af-460c-8bd7-fa2987c1e964 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:20.487642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c0252-26af-460c-8bd7-fa2987c1e964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:20.508418 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-474c0252-26af-460c-8bd7-fa2987c1e964 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:29:20.509687 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-474c0252-26af-460c-8bd7-fa2987c1e964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:29:20.573650 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1451/2886] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:29:20.582647 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e30f0-f34a-49fc-8061-82808240fa78 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:20.582948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e30f0-f34a-49fc-8061-82808240fa78 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:20.583254 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e30f0-f34a-49fc-8061-82808240fa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:20.603567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-6a3e30f0-f34a-49fc-8061-82808240fa78 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:29:20.604851 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-6a3e30f0-f34a-49fc-8061-82808240fa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:29:20.613260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1436/2887] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:29:20.618741 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c0252-26af-460c-8bd7-fa2987c1e964 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:20.629649 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c0252-26af-460c-8bd7-fa2987c1e964 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:20.636734 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8756b2-9dcc-4eca-b20a-d78f1ecf1e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:20.637412 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8756b2-9dcc-4eca-b20a-d78f1ecf1e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:20.637834 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8756b2-9dcc-4eca-b20a-d78f1ecf1e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:20.638133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8756b2-9dcc-4eca-b20a-d78f1ecf1e44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:20.638948 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8756b2-9dcc-4eca-b20a-d78f1ecf1e44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 07:29:20.639155 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8756b2-9dcc-4eca-b20a-d78f1ecf1e44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:20.640769 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8756b2-9dcc-4eca-b20a-d78f1ecf1e44 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:20.655326 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1452/2888] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Aug 5 07:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 07:29:20.659863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e30f0-f34a-49fc-8061-82808240fa78 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:20.670097 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e30f0-f34a-49fc-8061-82808240fa78 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:20.675943 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97054ed9-14e8-4ac4-b9ff-de863f088d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:20.676608 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97054ed9-14e8-4ac4-b9ff-de863f088d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:20.676844 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97054ed9-14e8-4ac4-b9ff-de863f088d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:20.677152 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97054ed9-14e8-4ac4-b9ff-de863f088d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:20.677825 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97054ed9-14e8-4ac4-b9ff-de863f088d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:20.679896 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97054ed9-14e8-4ac4-b9ff-de863f088d96 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:20.696349 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:29:20.713474 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1437/2889] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Aug 5 07:29:20 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:29:20.718016 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8756b2-9dcc-4eca-b20a-d78f1ecf1e44 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:20.728441 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8756b2-9dcc-4eca-b20a-d78f1ecf1e44 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:20.732344 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:29:20.792702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674484f-aa98-4010-80aa-26124e9aeb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:20.793603 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674484f-aa98-4010-80aa-26124e9aeb0d admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:20.793984 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674484f-aa98-4010-80aa-26124e9aeb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:20.794345 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674484f-aa98-4010-80aa-26124e9aeb0d admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:20.795366 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674484f-aa98-4010-80aa-26124e9aeb0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:20.798280 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674484f-aa98-4010-80aa-26124e9aeb0d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:20.828432 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1453/2890] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Aug 5 07:29:20 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 07:29:20.832932 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97054ed9-14e8-4ac4-b9ff-de863f088d96 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:20.844989 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97054ed9-14e8-4ac4-b9ff-de863f088d96 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:20.850449 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80799ef-e370-4208-8af5-05f0f9ae7b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:20.851054 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80799ef-e370-4208-8af5-05f0f9ae7b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:20.851339 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80799ef-e370-4208-8af5-05f0f9ae7b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:20.851658 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80799ef-e370-4208-8af5-05f0f9ae7b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:20.852359 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80799ef-e370-4208-8af5-05f0f9ae7b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:20.854076 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80799ef-e370-4208-8af5-05f0f9ae7b81 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:20.864967 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1438/2891] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:29:20.870771 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674484f-aa98-4010-80aa-26124e9aeb0d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:20.884728 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674484f-aa98-4010-80aa-26124e9aeb0d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:20.891243 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2d9f3-daba-414c-81c8-34fd12246845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:20.892175 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2d9f3-daba-414c-81c8-34fd12246845 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:20.892599 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2d9f3-daba-414c-81c8-34fd12246845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:20.892916 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2d9f3-daba-414c-81c8-34fd12246845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:20.894010 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2d9f3-daba-414c-81c8-34fd12246845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:20.896565 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2d9f3-daba-414c-81c8-34fd12246845 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:20.913164 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1454/2892] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Aug 5 07:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 07:29:20.918005 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80799ef-e370-4208-8af5-05f0f9ae7b81 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:20.928888 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80799ef-e370-4208-8af5-05f0f9ae7b81 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:20.934719 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34832f-16c3-431c-b050-8a8e6a660af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:20.935379 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34832f-16c3-431c-b050-8a8e6a660af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:20.935662 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34832f-16c3-431c-b050-8a8e6a660af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:20.935923 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34832f-16c3-431c-b050-8a8e6a660af5 admin admin] PATH_INFO: `/v3/projects/532ebe0ec2c14abcad5cd6a44e2efb21/users/53d71a23334a43cd9bced0b9759d7c01/roles/2d65d41d83b24e36b4a751ac3f7fb178` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:20.952991 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34832f-16c3-431c-b050-8a8e6a660af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532ebe0ec2c14abcad5cd6a44e2efb21, user_id=53d71a23334a43cd9bced0b9759d7c01, role_id=2d65d41d83b24e36b4a751ac3f7fb178)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:20.955654 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34832f-16c3-431c-b050-8a8e6a660af5 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:20.972922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1439/2893] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Aug 5 07:29:20 2022] PUT /identity/v3/projects/532ebe0ec2c14abcad5cd6a44e2efb21/users/53d71a23334a43cd9bced0b9759d7c01/roles/2d65d41d83b24e36b4a751ac3f7fb178 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:29:20.986000 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1e458-7fd8-4b83-a783-51bbef6d8f8e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:20.986572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1e458-7fd8-4b83-a783-51bbef6d8f8e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:20.986572 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1e458-7fd8-4b83-a783-51bbef6d8f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:21.024401 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3fc1e458-7fd8-4b83-a783-51bbef6d8f8e None None] MFA Rules not processed for user `53d71a23334a43cd9bced0b9759d7c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:29:21.025678 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3fc1e458-7fd8-4b83-a783-51bbef6d8f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:29:21.101596 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1455/2894] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:29:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:29:21.115582 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34832f-16c3-431c-b050-8a8e6a660af5 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:21.118567 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-2a34832f-16c3-431c-b050-8a8e6a660af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:29:21.183175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34832f-16c3-431c-b050-8a8e6a660af5 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:21.187408 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116c624-5275-4820-83af-3640e4120eb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd44bcb27daeb4116835bbfb5dcb1dc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:21.188040 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116c624-5275-4820-83af-3640e4120eb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:21.188306 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116c624-5275-4820-83af-3640e4120eb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:21.188566 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116c624-5275-4820-83af-3640e4120eb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:21.197196 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116c624-5275-4820-83af-3640e4120eb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:21.198572 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116c624-5275-4820-83af-3640e4120eb0 service cinder] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:21.207396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1440/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:29:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:29:30.410936 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1e458-7fd8-4b83-a783-51bbef6d8f8e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:30.482737 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1e458-7fd8-4b83-a783-51bbef6d8f8e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:30.489253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:30.489976 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:30.490261 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:30.490536 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] PATH_INFO: `/v3/users/53d71a23334a43cd9bced0b9759d7c01` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:30.491870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d71a23334a43cd9bced0b9759d7c01)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:30.493847 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:30.513105 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:29:30.549386 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d71a23334a43cd9bced0b9759d7c01'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:30.550052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d71a23334a43cd9bced0b9759d7c01'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:30.558969 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d71a23334a43cd9bced0b9759d7c01'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:30.559924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d71a23334a43cd9bced0b9759d7c01'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:30.572265 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d71a23334a43cd9bced0b9759d7c01'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:30.584605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1456/2896] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:29:30 2022] DELETE /identity/v3/users/53d71a23334a43cd9bced0b9759d7c01 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:29:30.589321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d21384-c875-483e-8043-e9a20edec274 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:30.589948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d21384-c875-483e-8043-e9a20edec274 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:30.589948 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d21384-c875-483e-8043-e9a20edec274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:30.610922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-18d21384-c875-483e-8043-e9a20edec274 None None] MFA Rules not processed for user `1acd68042e0349f6afed23e5889b5da6`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:29:30.612251 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-18d21384-c875-483e-8043-e9a20edec274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:29:30.680561 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1441/2897] 10.222.0.27 () {58 vars in 958 bytes} [Fri Aug 5 07:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:29:30.690777 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:30.692253 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:29:30.750870 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84cb9e-10f2-40e6-b7ea-15a670a212c4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:30.755312 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c4468-f8f4-4d82-adc2-d15d955e7187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:30.755933 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c4468-f8f4-4d82-adc2-d15d955e7187 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:30.756207 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c4468-f8f4-4d82-adc2-d15d955e7187 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:30.756478 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c4468-f8f4-4d82-adc2-d15d955e7187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:30.766488 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c4468-f8f4-4d82-adc2-d15d955e7187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:30.767912 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c4468-f8f4-4d82-adc2-d15d955e7187 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:30.777605 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1457/2898] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:29:31.068404 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d21384-c875-483e-8043-e9a20edec274 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:29:31.070056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-18d21384-c875-483e-8043-e9a20edec274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:29:31.082997 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d21384-c875-483e-8043-e9a20edec274 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:29:31.088959 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:29:31.089632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:29:31.089911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:29:31.090217 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] PATH_INFO: `/v3/projects/532ebe0ec2c14abcad5cd6a44e2efb21` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:29:31.091510 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=532ebe0ec2c14abcad5cd6a44e2efb21)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:29:31.093701 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:29:31.143634 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532ebe0ec2c14abcad5cd6a44e2efb21', 'request_id': 'req-24b84cfb-ce39-424c-919f-e4d859217841'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:31.152533 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532ebe0ec2c14abcad5cd6a44e2efb21', 'request_id': 'req-24b84cfb-ce39-424c-919f-e4d859217841'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:31.154911 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:29:31.160289 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532ebe0ec2c14abcad5cd6a44e2efb21', 'request_id': 'req-24b84cfb-ce39-424c-919f-e4d859217841'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:31.172728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] The token cache is being invalidate because project 532ebe0ec2c14abcad5cd6a44e2efb21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:29:31.173046 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:31.173693 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:29:31.175242 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1442/2899] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:29:31 2022] DELETE /identity/v3/projects/532ebe0ec2c14abcad5cd6a44e2efb21 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:29:40.773511 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=9,keystone:SELECT=46,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:29:41.169899 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=5,keystone:DELETE=1 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:30:11.176940 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c4468-f8f4-4d82-adc2-d15d955e7187 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:30:11.186698 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c4468-f8f4-4d82-adc2-d15d955e7187 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:30:11.238977 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a810ce-1529-421a-a8e4-373524b1356a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:30:11.239614 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a810ce-1529-421a-a8e4-373524b1356a service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:30:11.239900 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a810ce-1529-421a-a8e4-373524b1356a service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:30:11.240177 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a810ce-1529-421a-a8e4-373524b1356a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:30:11.242119 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-23a810ce-1529-421a-a8e4-373524b1356a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:30:11.251987 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a810ce-1529-421a-a8e4-373524b1356a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:30:11.253467 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a810ce-1529-421a-a8e4-373524b1356a service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:30:11.263013 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1458/2900] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:30:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:30:21.258854 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=26 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:31:41.833489 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:31:41.834983 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:31:41.848571 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b84cfb-ce39-424c-919f-e4d859217841 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:31:41.852569 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251b0bf-1bb8-4509-a946-2be4aea4339e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:31:41.853396 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251b0bf-1bb8-4509-a946-2be4aea4339e service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:31:41.853728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251b0bf-1bb8-4509-a946-2be4aea4339e service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:31:41.854032 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251b0bf-1bb8-4509-a946-2be4aea4339e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:31:41.856485 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-c251b0bf-1bb8-4509-a946-2be4aea4339e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:31:41.867181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251b0bf-1bb8-4509-a946-2be4aea4339e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:31:41.868772 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251b0bf-1bb8-4509-a946-2be4aea4339e service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:31:41.877607 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1443/2901] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:31:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:31:42.020159 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715cdc3-17e9-4bba-9551-ff85c4fe232e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:31:42.020759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715cdc3-17e9-4bba-9551-ff85c4fe232e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:31:42.020759 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715cdc3-17e9-4bba-9551-ff85c4fe232e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:31:42.022133 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1459/2902] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:31:42.028260 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48758ae-3f18-4623-9562-5c169d4d8543 None None] REQUEST_METHOD: `POST` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:31:42.028686 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48758ae-3f18-4623-9562-5c169d4d8543 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:31:42.029157 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48758ae-3f18-4623-9562-5c169d4d8543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:31:42.069648 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.auth.core [None req-f48758ae-3f18-4623-9562-5c169d4d8543 None None] MFA Rules not processed for user `9c4ce8a3f876467f93e7c9efd9e33390`. Rule list: `[]` (Enabled: `True`). {{(pid=80395) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:31:42.070980 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-f48758ae-3f18-4623-9562-5c169d4d8543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:31:42.078564 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1444/2903] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:31:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 07:31:42.091391 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715cdc3-17e9-4bba-9551-ff85c4fe232e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:31:42.093185 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c715cdc3-17e9-4bba-9551-ff85c4fe232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:31:42.106708 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715cdc3-17e9-4bba-9551-ff85c4fe232e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:31:42.110230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579341b9-a223-478e-9b21-9d05edf68e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:31:42.110862 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579341b9-a223-478e-9b21-9d05edf68e25 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:31:42.111135 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579341b9-a223-478e-9b21-9d05edf68e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:31:42.111398 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579341b9-a223-478e-9b21-9d05edf68e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:31:42.119116 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579341b9-a223-478e-9b21-9d05edf68e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:31:42.120559 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579341b9-a223-478e-9b21-9d05edf68e25 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:31:42.129044 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1460/2904] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:31:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:31:42.217090 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98a868-0790-437e-af27-b39e3db99d38 None None] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:31:42.217385 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98a868-0790-437e-af27-b39e3db99d38 None None] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:31:42.217786 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98a868-0790-437e-af27-b39e3db99d38 None None] PATH_INFO: `/` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:31:42.219917 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1445/2905] 10.222.0.27 () {54 vars in 921 bytes} [Fri Aug 5 07:31:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 07:31:42.228160 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab52c83-d474-472b-a636-823f5c96ca78 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:31:42.228348 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab52c83-d474-472b-a636-823f5c96ca78 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:31:42.228642 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab52c83-d474-472b-a636-823f5c96ca78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:31:42.270711 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5ab52c83-d474-472b-a636-823f5c96ca78 None None] MFA Rules not processed for user `555de6e5c8c44f40a6433b3d2ffc52f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 07:31:42.271917 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5ab52c83-d474-472b-a636-823f5c96ca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:31:42.343561 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1461/2906] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Aug 5 07:31:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 07:31:42.356926 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98a868-0790-437e-af27-b39e3db99d38 None None] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:31:42.368936 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98a868-0790-437e-af27-b39e3db99d38 None None] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:31:42.372661 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d19d-21a0-429f-a786-80349e44cb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:31:42.373308 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d19d-21a0-429f-a786-80349e44cb7d service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:31:42.373591 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d19d-21a0-429f-a786-80349e44cb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:31:42.373863 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d19d-21a0-429f-a786-80349e44cb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:31:42.385102 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862d19d-21a0-429f-a786-80349e44cb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:31:42.386547 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862d19d-21a0-429f-a786-80349e44cb7d service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:31:42.397639 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1446/2907] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:31:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:31:42.462789 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab52c83-d474-472b-a636-823f5c96ca78 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:31:42.464619 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5ab52c83-d474-472b-a636-823f5c96ca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:31:42.543463 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab52c83-d474-472b-a636-823f5c96ca78 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:31:42.549598 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d2cf0-2f1a-4d2b-a396-df7c74ab423c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:31:42.550217 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2cf0-2f1a-4d2b-a396-df7c74ab423c service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:31:42.550501 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2cf0-2f1a-4d2b-a396-df7c74ab423c service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:31:42.550774 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2cf0-2f1a-4d2b-a396-df7c74ab423c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:31:42.552938 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8f7d2cf0-2f1a-4d2b-a396-df7c74ab423c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:31:42.566009 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d2cf0-2f1a-4d2b-a396-df7c74ab423c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:31:42.567587 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d2cf0-2f1a-4d2b-a396-df7c74ab423c service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:31:42.577785 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1462/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:31:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:31:44.324295 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d19d-21a0-429f-a786-80349e44cb7d service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:31:44.325655 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-b862d19d-21a0-429f-a786-80349e44cb7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:31:44.345147 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d19d-21a0-429f-a786-80349e44cb7d service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:31:44.372202 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e810d13-e9f0-4765-a7fe-4a2eb872f755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:31:44.373212 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e810d13-e9f0-4765-a7fe-4a2eb872f755 service nova] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:31:44.373783 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e810d13-e9f0-4765-a7fe-4a2eb872f755 service nova] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:31:44.374228 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e810d13-e9f0-4765-a7fe-4a2eb872f755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:31:44.378226 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-4e810d13-e9f0-4765-a7fe-4a2eb872f755 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:31:44.406341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e810d13-e9f0-4765-a7fe-4a2eb872f755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:31:44.407958 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e810d13-e9f0-4765-a7fe-4a2eb872f755 service nova] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:31:44.422594 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1447/2909] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:31:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:31:52.573496 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=75 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:31:54.417547 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=27 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:33:16.443007 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d2cf0-2f1a-4d2b-a396-df7c74ab423c service placement] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:33:16.444647 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8f7d2cf0-2f1a-4d2b-a396-df7c74ab423c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:33:16.536552 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d2cf0-2f1a-4d2b-a396-df7c74ab423c service placement] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:33:16.542662 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77233dcb-871d-436b-9f72-76a2c0bfcaa5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:33:16.543267 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233dcb-871d-436b-9f72-76a2c0bfcaa5 service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:33:16.543551 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233dcb-871d-436b-9f72-76a2c0bfcaa5 service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:33:16.543824 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233dcb-871d-436b-9f72-76a2c0bfcaa5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:33:16.546134 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-77233dcb-871d-436b-9f72-76a2c0bfcaa5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:33:16.559230 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77233dcb-871d-436b-9f72-76a2c0bfcaa5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:33:16.560841 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77233dcb-871d-436b-9f72-76a2c0bfcaa5 service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:33:16.571530 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1463/2910] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:33:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:33:21.316022 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e810d13-e9f0-4765-a7fe-4a2eb872f755 service nova] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:33:21.355523 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e810d13-e9f0-4765-a7fe-4a2eb872f755 service nova] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:33:21.359423 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9de65-d7be-489d-a404-ec3990a35de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:33:21.360028 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9de65-d7be-489d-a404-ec3990a35de1 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:33:21.360301 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9de65-d7be-489d-a404-ec3990a35de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:33:21.360598 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9de65-d7be-489d-a404-ec3990a35de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:33:21.362617 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-90c9de65-d7be-489d-a404-ec3990a35de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:33:21.438044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9de65-d7be-489d-a404-ec3990a35de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:33:21.440044 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9de65-d7be-489d-a404-ec3990a35de1 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:33:21.450407 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1448/2911] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:33:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:33:22.354457 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77233dcb-871d-436b-9f72-76a2c0bfcaa5 service placement] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:33:22.380158 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77233dcb-871d-436b-9f72-76a2c0bfcaa5 service placement] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:33:22.386666 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b52108-1e77-40a0-973d-cc227625b6f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '555de6e5c8c44f40a6433b3d2ffc52f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:33:22.387313 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b52108-1e77-40a0-973d-cc227625b6f4 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:33:22.387594 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b52108-1e77-40a0-973d-cc227625b6f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:33:22.387867 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b52108-1e77-40a0-973d-cc227625b6f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:33:22.389724 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d6b52108-1e77-40a0-973d-cc227625b6f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:33:22.403888 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b52108-1e77-40a0-973d-cc227625b6f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:33:22.405524 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b52108-1e77-40a0-973d-cc227625b6f4 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:33:22.418873 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1464/2912] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:33:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:33:26.253922 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9de65-d7be-489d-a404-ec3990a35de1 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:33:26.263498 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9de65-d7be-489d-a404-ec3990a35de1 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:33:26.268325 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681bebf-de1f-47cb-baeb-623168646300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c4ce8a3f876467f93e7c9efd9e33390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:33:26.268513 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681bebf-de1f-47cb-baeb-623168646300 service neutron] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:33:26.269175 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681bebf-de1f-47cb-baeb-623168646300 service neutron] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:33:26.269475 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681bebf-de1f-47cb-baeb-623168646300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:33:26.271286 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-1681bebf-de1f-47cb-baeb-623168646300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:33:26.373056 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681bebf-de1f-47cb-baeb-623168646300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:33:26.374470 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681bebf-de1f-47cb-baeb-623168646300 service neutron] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:33:26.394366 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1449/2913] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:33:29.973252 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b52108-1e77-40a0-973d-cc227625b6f4 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:33:29.986057 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b52108-1e77-40a0-973d-cc227625b6f4 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:33:29.992705 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e437b-3ff1-41e4-b4a3-af420e302d87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:33:29.993392 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e437b-3ff1-41e4-b4a3-af420e302d87 service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:33:29.993672 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e437b-3ff1-41e4-b4a3-af420e302d87 service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:33:29.993953 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e437b-3ff1-41e4-b4a3-af420e302d87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:33:29.996600 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c42e437b-3ff1-41e4-b4a3-af420e302d87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:33:30.012022 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e437b-3ff1-41e4-b4a3-af420e302d87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:33:30.014004 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e437b-3ff1-41e4-b4a3-af420e302d87 service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:33:30.027799 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1465/2914] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:33:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:33:32.984789 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681bebf-de1f-47cb-baeb-623168646300 service neutron] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:33:32.998699 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681bebf-de1f-47cb-baeb-623168646300 service neutron] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:33:33.005975 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d672837-66a9-44b7-ae9d-a9264d69d167 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:33:33.006839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672837-66a9-44b7-ae9d-a9264d69d167 service placement] REQUEST_METHOD: `GET` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:33:33.007346 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672837-66a9-44b7-ae9d-a9264d69d167 service placement] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:33:33.007847 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672837-66a9-44b7-ae9d-a9264d69d167 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:33:33.010023 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-7d672837-66a9-44b7-ae9d-a9264d69d167 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:33:33.023394 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d672837-66a9-44b7-ae9d-a9264d69d167 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:33:33.025045 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d672837-66a9-44b7-ae9d-a9264d69d167 service placement] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:33:33.038468 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1450/2915] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:33:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:33:33.085123 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e437b-3ff1-41e4-b4a3-af420e302d87 service placement] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:33:33.087023 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c42e437b-3ff1-41e4-b4a3-af420e302d87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:33:33.100685 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e437b-3ff1-41e4-b4a3-af420e302d87 service placement] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:33:33.105329 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:33:33.105970 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:33:33.106264 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:33:33.106547 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] PATH_INFO: `/v3/users/4fbc21934e84415e93f29aa5073716f7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:33:33.107702 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fbc21934e84415e93f29aa5073716f7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:33:33.109667 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:33:33.158065 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fbc21934e84415e93f29aa5073716f7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.158775 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fbc21934e84415e93f29aa5073716f7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.167927 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fbc21934e84415e93f29aa5073716f7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.168535 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fbc21934e84415e93f29aa5073716f7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.181349 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fbc21934e84415e93f29aa5073716f7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.195106 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1466/2916] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:33:33 2022] DELETE /identity/v3/users/4fbc21934e84415e93f29aa5073716f7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:33:33.389992 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d672837-66a9-44b7-ae9d-a9264d69d167 service placement] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:33:33.401713 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d672837-66a9-44b7-ae9d-a9264d69d167 service placement] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:33:33.425559 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=100 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:33:33.463181 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:33:33.463839 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:33:33.464121 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:33:33.464393 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] PATH_INFO: `/v3/projects/3cb5b787fed94e7091a4ff793951d8f0` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:33:33.465690 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb5b787fed94e7091a4ff793951d8f0)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:33:33.467656 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:33:33.528939 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb5b787fed94e7091a4ff793951d8f0', 'request_id': 'req-ea362d65-f7c9-4d89-8357-cdac92303ff4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.539824 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb5b787fed94e7091a4ff793951d8f0', 'request_id': 'req-ea362d65-f7c9-4d89-8357-cdac92303ff4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.545728 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb5b787fed94e7091a4ff793951d8f0', 'request_id': 'req-ea362d65-f7c9-4d89-8357-cdac92303ff4'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.557321 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] The token cache is being invalidate because project 3cb5b787fed94e7091a4ff793951d8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:33:33.557602 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.558334 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.559963 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1451/2917] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:33:33 2022] DELETE /identity/v3/projects/3cb5b787fed94e7091a4ff793951d8f0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:33:33.564081 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:33:33.565639 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:33:33.579449 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069bdf6-4728-41df-a8a2-039680d569f8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:33:33.593236 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:33:33.640351 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:33:33.641027 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:33:33.641309 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:33:33.641583 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] PATH_INFO: `/v3/users/15ac0e1d39fc4143b3becb318f216ed6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:33:33.642837 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ac0e1d39fc4143b3becb318f216ed6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:33:33.644789 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:33:33.695977 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ac0e1d39fc4143b3becb318f216ed6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.696669 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ac0e1d39fc4143b3becb318f216ed6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.707416 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ac0e1d39fc4143b3becb318f216ed6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.708042 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ac0e1d39fc4143b3becb318f216ed6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.720242 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ac0e1d39fc4143b3becb318f216ed6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:33.733884 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1467/2918] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Aug 5 07:33:33 2022] DELETE /identity/v3/users/15ac0e1d39fc4143b3becb318f216ed6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 07:33:33.931734 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] Authenticating user token {{(pid=80395) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:33:33.933632 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.fernet_utils [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80395) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:33:33.950284 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea362d65-f7c9-4d89-8357-cdac92303ff4 admin admin] Validating token access rules against request {{(pid=80395) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:33:34.009455 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7042ade-a720-413f-b84a-62055a60753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1acd68042e0349f6afed23e5889b5da6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0ce80734b754922ab08055a8061587e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80395) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:33:34.010231 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7042ade-a720-413f-b84a-62055a60753d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:33:34.010341 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7042ade-a720-413f-b84a-62055a60753d admin admin] SCRIPT_NAME: `/identity` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:33:34.010626 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7042ade-a720-413f-b84a-62055a60753d admin admin] PATH_INFO: `/v3/projects/6521bc76167c43e3a3467e8fd2c687c6` {{(pid=80395) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:33:34.011828 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7042ade-a720-413f-b84a-62055a60753d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6521bc76167c43e3a3467e8fd2c687c6)` {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:33:34.013794 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7042ade-a720-413f-b84a-62055a60753d admin admin] RBAC: Authorization granted {{(pid=80395) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:33:34.064336 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e7042ade-a720-413f-b84a-62055a60753d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6521bc76167c43e3a3467e8fd2c687c6', 'request_id': 'req-e7042ade-a720-413f-b84a-62055a60753d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:34.073070 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e7042ade-a720-413f-b84a-62055a60753d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6521bc76167c43e3a3467e8fd2c687c6', 'request_id': 'req-e7042ade-a720-413f-b84a-62055a60753d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:34.074345 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:33:34.080000 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e7042ade-a720-413f-b84a-62055a60753d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6521bc76167c43e3a3467e8fd2c687c6', 'request_id': 'req-e7042ade-a720-413f-b84a-62055a60753d'} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:34.092575 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e7042ade-a720-413f-b84a-62055a60753d admin admin] The token cache is being invalidate because project 6521bc76167c43e3a3467e8fd2c687c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80395) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 07:33:34.092861 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e7042ade-a720-413f-b84a-62055a60753d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:34.093536 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG keystone.notifications [None req-e7042ade-a720-413f-b84a-62055a60753d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80395) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 07:33:34.095062 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: [pid: 80395|app: 0|req: 1452/2919] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Aug 5 07:33:33 2022] DELETE /identity/v3/projects/6521bc76167c43e3a3467e8fd2c687c6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 07:33:43.729787 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:33:44.089704 dv-cinder-852007-1-iscsi devstack@keystone.service[80395]: DEBUG dbcounter [-] [80395] Writing DB stats keystone:DELETE=2,keystone:SELECT=5 {{(pid=80395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 07:38:21.430085 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 07:38:21.431762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:38:21.514430 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7f144-9b46-4491-ae69-4be0eb46d7f7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 07:38:21.576654 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24353a5-4ba8-49ed-948f-2f4f4f3f2f08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33213d31b1394cdfb5b447f4f4952b53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b560f1bcf347f6b8b885cc02d52e33', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 07:38:21.577218 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24353a5-4ba8-49ed-948f-2f4f4f3f2f08 service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 07:38:21.577495 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24353a5-4ba8-49ed-948f-2f4f4f3f2f08 service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 07:38:21.577762 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24353a5-4ba8-49ed-948f-2f4f4f3f2f08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 07:38:21.579924 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f24353a5-4ba8-49ed-948f-2f4f4f3f2f08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 07:38:21.591591 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24353a5-4ba8-49ed-948f-2f4f4f3f2f08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 07:38:21.593189 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24353a5-4ba8-49ed-948f-2f4f4f3f2f08 service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 07:38:21.603052 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1468/2920] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Aug 5 07:38:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 07:38:31.598995 dv-cinder-852007-1-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=58 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}